2024-05-10T13:49:01.382 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T13:49:01.382 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219 --name dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi --owner scheduled_dang@sidious.arb.redhat.com --verbose --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} -- /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/orig.config.yaml 2024-05-10T13:49:01.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T13:49:01.505 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219 branch: wip-dang-obj-state description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7701219' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-dang-obj-state ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-dang-obj-state sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 owner: scheduled_dang@sidious.arb.redhat.com priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2189 sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 sleep_before_teardown: 0 suite: rgw suite_branch: wip-dang-obj-state suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJiduOxAmO/MABrCKSOVU34H443J7P4Laq509Rd/Ph/8gq1zYv6OXZQyrP1/NDeKpg3HyOLqPf+P7kEfi1nZ7U= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyZxTL71kJa9cHapAb6a70E7lAdq4EYTk0Bti5PvxazbFdWhf/I9ACUlzDTQKpJUnXCUS43xQTt9BLw4R9kz/4= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_09:33:25 tube: smithi user: dang verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T13:49:01.505 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa; will attempt to use it 2024-05-10T13:49:01.506 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa/tasks 2024-05-10T13:49:01.506 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T13:49:01.508 INFO:teuthology.task.internal:Checking packages... 2024-05-10T13:49:01.533 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7ef97a7233c4db41f8dc134b8d64f95427147ce5' 2024-05-10T13:49:01.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T13:49:01.533 INFO:teuthology.packaging:ref: None 2024-05-10T13:49:01.533 INFO:teuthology.packaging:tag: None 2024-05-10T13:49:01.533 INFO:teuthology.packaging:branch: wip-dang-obj-state 2024-05-10T13:49:01.533 INFO:teuthology.packaging:sha1: 7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T13:49:01.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-dang-obj-state 2024-05-10T13:49:01.753 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3577-g7ef97a72-1jammy 2024-05-10T13:49:01.754 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T13:49:01.763 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T13:49:01.763 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T13:49:01.787 INFO:teuthology.task.internal:Saving configuration 2024-05-10T13:49:01.801 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T13:49:01.811 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T13:49:01.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 13:43:17.988372', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDhTFlJHSwDX09sxRYCrpa3wRon4c6zd9WS49FnzNs2n'} 2024-05-10T13:49:01.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 13:43:17.990849', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI9JbmA5hLErYNjtQA3lS9j6bYKHaK6u6n7Mwh4zewy'} 2024-05-10T13:49:01.863 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T13:49:01.871 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-10T13:49:01.871 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-10T13:49:01.871 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T13:49:01.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a3d79b0d0>, signals=[15]) 2024-05-10T13:49:01.964 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T13:49:01.972 INFO:teuthology.task.internal:Opening connections... 2024-05-10T13:49:01.972 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T13:49:01.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:49:02.061 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T13:49:02.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:49:02.142 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T13:49:02.150 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-05-10T13:49:02.155 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-05-10T13:49:02.156 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-10T13:49:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-10T13:49:02.202 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-10T13:49:02.202 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-10T13:49:02.202 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-05-10T13:49:02.202 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-05-10T13:49:02.223 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-05-10T13:49:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-05-10T13:49:02.233 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-05-10T13:49:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-10T13:49:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-10T13:49:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-10T13:49:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-10T13:49:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2024-05-10T13:49:02.284 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-05-10T13:49:02.315 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T13:49:02.327 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T13:49:02.353 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T13:49:02.354 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-05-10T13:49:02.357 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-05-10T13:49:02.361 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T13:49:02.379 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T13:49:02.379 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-05-10T13:49:02.411 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-05-10T13:49:02.433 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T13:49:02.494 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T13:49:02.514 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-10T13:49:02.514 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-10T13:49:02.514 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T13:49:02.515 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T13:49:02.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T13:49:02.520 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-05-10T13:49:02.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T13:49:02.522 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-05-10T13:49:02.566 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-05-10T13:49:02.566 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.15.0-56-generic 2024-05-10T13:49:02.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-05-10T13:49:02.569 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-56-generic 2024-05-10T13:49:02.569 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.15.0-56-generic 2024-05-10T13:49:02.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-05-10T13:49:02.712 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-05-10T13:49:02.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-05-10T13:49:02.932 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-10T13:49:02.982 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:49:02.989 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-10T13:49:03.041 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:49:03.041 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-10T13:49:03.122 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-10T13:49:03.140 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-10T13:49:03.287 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-10T13:49:03.292 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-10T13:49:03.294 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-10T13:49:03.295 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-10T13:49:03.295 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-10T13:49:03.317 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-10T13:49:03.321 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T13:49:03.321 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-10T13:49:03.329 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-10T13:49:03.334 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-10T13:49:03.336 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-10T13:49:03.336 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-10T13:49:03.336 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-10T13:49:03.337 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-10T13:49:03.354 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-10T13:49:03.403 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-10T13:49:03.405 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-10T13:49:03.486 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-10T13:49:03.545 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-10T13:49:03.625 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-10T13:49:03.827 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-10T13:49:03.844 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-10T13:49:03.853 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-10T13:49:03.854 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-10T13:49:03.855 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-10T13:49:03.857 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-10T13:49:03.897 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-10T13:49:03.912 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-10T13:49:03.913 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-10T13:49:03.914 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-10T13:49:03.935 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-10T13:49:03.948 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-10T13:49:03.974 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-10T13:49:03.979 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-10T13:49:03.979 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T13:49:03.979 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-10T13:49:03.986 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T13:49:03.990 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-10T13:49:03.990 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-10T13:49:03.992 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-10T13:49:03.994 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-10T13:49:04.053 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-10T13:49:04.061 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T13:49:04.150 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-10T13:49:04.168 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-10T13:49:04.227 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-10T13:49:04.573 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-10T13:49:04.579 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-10T13:49:04.593 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-10T13:49:04.593 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-10T13:49:04.596 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-10T13:49:04.784 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-10T13:49:04.812 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-10T13:49:04.821 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-10T13:49:04.834 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-10T13:49:04.836 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-10T13:49:04.836 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-10T13:49:04.838 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-10T13:49:04.839 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-10T13:49:04.839 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-10T13:49:04.866 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-10T13:49:04.869 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-10T13:49:04.923 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-10T13:49:04.944 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-10T13:49:04.946 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-10T13:49:04.946 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-10T13:49:04.949 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-10T13:49:04.950 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-10T13:49:04.950 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-10T13:49:04.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-10T13:49:04.959 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-10T13:49:05.034 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-10T13:49:05.118 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-10T13:49:05.124 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-10T13:49:05.210 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-10T13:49:05.229 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-10T13:49:05.281 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-10T13:49:05.312 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-10T13:49:05.317 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-10T13:49:05.372 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-10T13:49:05.404 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-10T13:49:09.637 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 13.4 MB in 3s (5,286 kB/s) 2024-05-10T13:49:10.057 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 13.4 MB in 3s (5,269 kB/s) 2024-05-10T13:49:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:49:11.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T13:49:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:49:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-05-10T13:49:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-05-10T13:49:11.426 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:49:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:49:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:49:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:49:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-10T13:49:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: python2.7-minimal 2024-05-10T13:49:11.427 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:49:11.428 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-05-10T13:49:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T13:49:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-10T13:49:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-10T13:49:11.430 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-05-10T13:49:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-10T13:49:11.430 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-05-10T13:49:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: thermald 2024-05-10T13:49:11.479 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-05-10T13:49:11.479 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T13:49:11.479 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-10T13:49:11.482 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-10T13:49:11.482 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2024-05-10T13:49:11.482 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-10T13:49:11.529 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:49:11.540 INFO:teuthology.orchestra.run.smithi130.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T13:49:11.540 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 113 MB of archives. 2024-05-10T13:49:11.540 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-10T13:49:11.540 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-10T13:49:11.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T13:49:11.610 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:49:11.814 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-05-10T13:49:11.814 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-05-10T13:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-10T13:49:12.001 INFO:teuthology.orchestra.run.smithi016.stdout: python2.7-minimal 2024-05-10T13:49:12.001 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:49:12.002 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-05-10T13:49:12.002 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T13:49:12.002 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-10T13:49:12.003 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-10T13:49:12.004 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-05-10T13:49:12.004 INFO:teuthology.orchestra.run.smithi016.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-10T13:49:12.004 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-05-10T13:49:12.004 INFO:teuthology.orchestra.run.smithi016.stdout: thermald 2024-05-10T13:49:12.053 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-05-10T13:49:12.053 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T13:49:12.054 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-10T13:49:12.054 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-10T13:49:12.055 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-05-10T13:49:12.056 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-10T13:49:12.113 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-10T13:49:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T13:49:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 113 MB of archives. 2024-05-10T13:49:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-10T13:49:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-10T13:49:12.349 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-10T13:49:13.127 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-10T13:49:13.430 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-10T13:49:13.876 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-10T13:49:13.876 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-10T13:49:13.876 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-10T13:49:14.221 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-10T13:49:14.264 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-10T13:49:14.656 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 113 MB in 3s (40.8 MB/s) 2024-05-10T13:49:14.681 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-10T13:49:14.681 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-10T13:49:14.681 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-10T13:49:14.831 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-10T13:49:14.842 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-10T13:49:14.866 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-10T13:49:15.298 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 113 MB in 3s (40.5 MB/s) 2024-05-10T13:49:15.482 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-10T13:49:16.889 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-10T13:49:16.896 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:17.007 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:17.505 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-10T13:49:17.509 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:17.604 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:19.509 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-10T13:49:19.530 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:19.620 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:19.855 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-10T13:49:19.877 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:19.958 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:20.054 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-10T13:49:20.074 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:20.104 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:20.742 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-10T13:49:20.763 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:20.808 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:26.547 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:26.674 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:27.041 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:27.170 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:27.500 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-10T13:49:27.522 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-10T13:49:27.566 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T13:49:27.684 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:27.794 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:28.177 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:28.297 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:28.617 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-10T13:49:28.640 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-10T13:49:28.675 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T13:49:33.583 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-10T13:49:33.620 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:33.649 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:34.370 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-10T13:49:34.408 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T13:49:34.445 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:36.279 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:36.402 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:36.776 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T13:49:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-10T13:49:37.136 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:37.940 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T13:49:38.082 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T13:49:38.557 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:49:38.557 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-10T13:49:38.557 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:49:38.557 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-10T13:49:39.105 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:39.291 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T13:49:39.412 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:39.538 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-10T13:49:39.683 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:40.540 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:41.072 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:49:41.072 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-10T13:49:41.072 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:49:41.072 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-10T13:49:41.235 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:41.941 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-10T13:49:42.067 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-10T13:49:42.210 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:42.280 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-10T13:49:42.280 INFO:teuthology.orchestra.run.smithi130.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:49:42.712 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-10T13:49:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-10T13:49:44.982 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T13:49:45.257 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-10T13:49:45.257 INFO:teuthology.orchestra.run.smithi016.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:49:56.594 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-10T13:49:56.594 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub' 2024-05-10T13:49:56.618 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T13:49:56.640 INFO:teuthology.orchestra.run.smithi130.stdout:Generating grub configuration file ... 2024-05-10T13:49:56.947 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:49:56.970 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:49:57.243 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:49:57.249 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T13:49:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T13:49:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T13:49:57.509 INFO:teuthology.orchestra.run.smithi130.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T13:49:57.509 INFO:teuthology.orchestra.run.smithi130.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T13:49:57.509 INFO:teuthology.orchestra.run.smithi130.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T13:49:57.548 INFO:teuthology.orchestra.run.smithi130.stdout:done 2024-05-10T13:49:58.047 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.106.106 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T13:49:58.072 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T13:49:58.073 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-05-10T13:49:58.073 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-05-10T13:49:58.073 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-05-10T13:49:58.073 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-05-10T13:49:58.073 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-10T13:49:58.073 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T13:49:58.073 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T13:49:58.073 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-10T13:49:58.074 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T13:49:58.074 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-05-10T13:49:58.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-05-10T13:49:58.380 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:49:58.389 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T13:49:58.409 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T13:49:58.515 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T13:49:59.773 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-10T13:49:59.773 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub' 2024-05-10T13:49:59.779 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:49:59.796 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T13:49:59.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T13:49:59.814 INFO:teuthology.orchestra.run.smithi016.stdout:Generating grub configuration file ... 2024-05-10T13:49:59.857 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:50:00.058 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-05-10T13:50:00.058 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-05-10T13:50:00.101 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:50:00.134 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T13:50:00.224 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T13:50:00.225 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:50:00.261 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T13:50:00.263 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-05-10T13:50:00.278 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.106.106 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-05-10T13:50:00.279 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-05-10T13:50:00.280 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-05-10T13:50:00.280 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-05-10T13:50:00.324 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.Q3J8gwtnK8 2024-05-10T13:50:00.324 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Q3J8gwtnK8 2024-05-10T13:50:00.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.Q3J8gwtnK8 2024-05-10T13:50:00.420 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:50:00.425 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T13:50:00.497 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.Q3J8gwtnK8 is 10KB 2024-05-10T13:50:00.500 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T13:50:00.505 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T13:50:00.509 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.Q3J8gwtnK8 2024-05-10T13:50:00.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-10T13:50:00.569 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T13:50:00.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-10T13:50:00.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-10T13:50:00.635 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-10T13:50:00.636 DEBUG:teuthology.orchestra.run.smithi130:> sudo update-grub 2024-05-10T13:50:00.670 INFO:teuthology.orchestra.run.smithi016.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T13:50:00.670 INFO:teuthology.orchestra.run.smithi016.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T13:50:00.670 INFO:teuthology.orchestra.run.smithi016.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T13:50:00.731 INFO:teuthology.orchestra.run.smithi016.stdout:done 2024-05-10T13:50:01.262 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-05-10T13:50:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.106.106 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-05-10T13:50:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-05-10T13:50:01.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-10T13:50:01.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T13:50:01.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T13:50:01.285 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-10T13:50:01.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T13:50:01.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-05-10T13:50:01.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-05-10T13:50:01.613 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T13:50:01.614 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:50:01.625 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T13:50:01.645 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T13:50:01.879 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2024-05-10T13:50:01.880 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T13:50:01.884 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-05-10T13:50:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:50:02.069 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:50:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:50:02.358 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T13:50:02.402 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T13:50:02.408 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T13:50:02.533 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T13:50:02.534 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T13:50:02.534 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T13:50:02.547 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-05-10T13:50:02.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-05-10T13:50:03.021 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:50:03.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T13:50:03.093 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:50:03.275 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-05-10T13:50:03.275 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T13:50:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T13:50:03.440 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:50:03.479 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T13:50:03.482 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-05-10T13:50:03.540 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.106.106 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-05-10T13:50:03.541 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-05-10T13:50:03.542 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-05-10T13:50:03.542 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-05-10T13:50:03.542 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-05-10T13:50:03.589 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.BMVPLaWdMT 2024-05-10T13:50:03.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BMVPLaWdMT 2024-05-10T13:50:03.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.BMVPLaWdMT 2024-05-10T13:50:03.761 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.BMVPLaWdMT is 10KB 2024-05-10T13:50:03.773 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.BMVPLaWdMT 2024-05-10T13:50:03.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-10T13:50:03.833 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T13:50:03.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-10T13:50:03.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-10T13:50:03.909 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-10T13:50:03.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo update-grub 2024-05-10T13:50:05.278 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-05-10T13:50:05.278 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T13:50:05.280 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-05-10T13:50:05.497 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T13:50:05.503 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T13:50:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T13:50:05.720 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T13:50:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T13:50:05.772 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T13:50:05.931 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T13:50:05.931 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T13:50:05.932 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T13:50:05.943 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-05-10T13:50:05.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-05-10T13:50:32.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-10T13:50:32.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:50:32.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:50:35.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-10T13:50:35.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:50:35.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:50:50.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-05-10T13:50:54.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-05-10T13:50:59.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:50:59.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:51:02.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-05-10T13:51:03.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:51:03.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:51:14.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:51:14.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:51:33.406 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-05-10T13:51:48.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:51:48.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:51:49.101 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-05-10T13:51:49.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:51:49.927 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-10T13:51:49.927 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-05-10T13:51:49.976 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-106-generic 2024-05-10T13:51:49.976 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-10T13:51:49.976 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T13:51:49.977 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-10T13:51:50.978 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-10T13:51:50.978 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-10T13:51:51.144 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-05-10T13:51:51.195 DEBUG:teuthology.parallel:result is None 2024-05-10T13:52:03.499 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T13:52:15.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:52:15.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:52:15.783 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-05-10T13:52:16.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:52:16.398 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-10T13:52:16.398 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-05-10T13:52:16.445 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-106-generic 2024-05-10T13:52:16.445 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-10T13:52:16.445 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T13:52:16.445 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-10T13:52:17.446 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-10T13:52:17.446 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-10T13:52:17.500 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-05-10T13:52:17.530 DEBUG:teuthology.parallel:result is None 2024-05-10T13:52:17.530 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T13:52:17.537 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T13:52:17.537 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T13:52:17.540 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T13:52:17.546 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T13:52:17.589 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T13:52:17.622 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T13:52:17.623 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T13:52:17.625 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T13:52:17.735 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T13:52:17.743 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T13:52:17.743 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T13:52:17.745 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T13:52:17.762 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T13:52:17.771 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T13:52:17.784 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T13:52:17.792 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T13:52:17.794 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T13:52:17.801 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T13:52:17.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T13:52:17.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T13:52:17.847 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T13:52:17.856 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T13:52:17.857 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T13:52:17.874 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T13:52:17.896 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T13:52:17.925 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T13:52:17.973 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T13:52:17.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T13:52:18.034 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T13:52:18.040 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T13:52:18.088 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T13:52:18.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T13:52:18.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-05-10T13:52:18.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-05-10T13:52:18.235 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T13:52:18.242 INFO:teuthology.task.internal:Starting timer... 2024-05-10T13:52:18.242 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T13:52:18.296 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T13:52:18.325 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-05-10T13:52:18.325 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2024-05-10T13:52:18.325 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T13:52:18.325 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-10T13:52:18.326 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T13:52:18.326 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T13:52:18.358 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-10T13:52:18.364 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-10T13:52:18.494 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T13:52:18.512 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T13:52:18.513 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T13:59:28.301 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-05-10T13:59:28.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:59:28.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:59:28.389 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-05-10T13:59:28.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-10T13:59:28.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:59:28.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T13:59:28.553 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-05-10T13:59:28.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-10T13:59:28.634 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T13:59:28.644 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T13:59:28.645 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T13:59:28.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T13:59:28.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T13:59:28.648 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T13:59:28.677 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-10T13:59:28.677 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Command line: ntpd -gq 2024-05-10T13:59:28.677 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: ---------------------------------------------------- 2024-05-10T13:59:28.678 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: ntp-4 is maintained by Network Time Foundation, 2024-05-10T13:59:28.678 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-10T13:59:28.678 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: corporation. Support and training for ntp-4 are 2024-05-10T13:59:28.678 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: available at https://www.nwtime.org/support 2024-05-10T13:59:28.678 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: ---------------------------------------------------- 2024-05-10T13:59:28.679 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: proto: precision = 0.065 usec (-24) 2024-05-10T13:59:28.679 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: basedate set to 2022-02-04 2024-05-10T13:59:28.679 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: gps base set to 2022-02-06 (week 2196) 2024-05-10T13:59:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T13:59:28.680 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T13:59:28.680 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: restrict ::: KOD does nothing without LIMITED. 2024-05-10T13:59:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen and drop on 0 v6wildcard [::]:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen normally on 2 lo 127.0.0.1:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen normally on 4 lo [::1]:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-05-10T13:59:28.681 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:28 ntpd[17179]: Listening on routing socket on fd #22 for interface updates 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Command line: ntpd -gq 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: ---------------------------------------------------- 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: ntp-4 is maintained by Network Time Foundation, 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: corporation. Support and training for ntp-4 are 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: available at https://www.nwtime.org/support 2024-05-10T13:59:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: ---------------------------------------------------- 2024-05-10T13:59:28.705 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: proto: precision = 0.045 usec (-24) 2024-05-10T13:59:28.705 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: basedate set to 2022-02-04 2024-05-10T13:59:28.705 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: gps base set to 2022-02-06 (week 2196) 2024-05-10T13:59:28.705 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T13:59:28.706 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T13:59:28.706 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-10T13:59:28.708 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: restrict ::: KOD does nothing without LIMITED. 2024-05-10T13:59:28.708 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen and drop on 0 v6wildcard [::]:123 2024-05-10T13:59:28.708 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-10T13:59:28.708 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen normally on 2 lo 127.0.0.1:123 2024-05-10T13:59:28.708 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2024-05-10T13:59:28.709 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen normally on 4 lo [::1]:123 2024-05-10T13:59:28.709 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2024-05-10T13:59:28.709 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:28 ntpd[17258]: Listening on routing socket on fd #22 for interface updates 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:29 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:30.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:30 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:30.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:30.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:30.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:30 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:31.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:31.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:31 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:32 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:32 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.680 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:33.680 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:33 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:33.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:33 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:34.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:34.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:34 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:34.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:34.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:34.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:34 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stdout:10 May 13:59:35 ntpd[17179]: ntpd: time slew -0.000207 s 2024-05-10T13:59:35.679 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.000207s 2024-05-10T13:59:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-10T13:59:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:10 May 13:59:35 ntpd[17179]: can't open /var/log/ntpstats/loopstats.20240510: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:35.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:35 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:35.726 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T13:59:35.726 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-05-10T13:59:35.726 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:35.727 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:35.727 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:35.727 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T13:59:36.705 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T13:59:36.706 INFO:teuthology.orchestra.run.smithi130.stdout:10 May 13:59:36 ntpd[17258]: ntpd: time slew -0.000855 s 2024-05-10T13:59:36.706 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.000855s 2024-05-10T13:59:36.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-10T13:59:36.706 INFO:teuthology.orchestra.run.smithi130.stderr:10 May 13:59:36 ntpd[17258]: can't open /var/log/ntpstats/loopstats.20240510: Permission denied 2024-05-10T13:59:36.766 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T13:59:36.766 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-05-10T13:59:36.766 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:36.766 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:36.766 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:36.767 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T13:59:36.767 INFO:teuthology.run_tasks:Running task install... 2024-05-10T13:59:36.775 DEBUG:teuthology.task.install:project ceph 2024-05-10T13:59:36.775 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}} 2024-05-10T13:59:36.775 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'} 2024-05-10T13:59:36.775 INFO:teuthology.task.install:Using flavor: default 2024-05-10T13:59:36.781 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T13:59:36.781 INFO:teuthology.task.install:extra packages: [] 2024-05-10T13:59:36.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-05-10T13:59:36.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2024-05-10T13:59:36.848 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-10T13:59:36.866 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-10T13:59:36.880 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-10T13:59:36.881 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-05-10T13:59:36.881 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-10T13:59:36.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T13:59:36.893 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-10T13:59:36.893 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2024-05-10T13:59:36.894 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-10T13:59:36.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T13:59:37.026 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default/ 2024-05-10T13:59:37.026 INFO:teuthology.task.install.deb:Package version is 19.0.0-3577-g7ef97a72-1jammy 2024-05-10T13:59:37.034 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default/ 2024-05-10T13:59:37.034 INFO:teuthology.task.install.deb:Package version is 19.0.0-3577-g7ef97a72-1jammy 2024-05-10T13:59:37.151 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T13:59:37.151 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-10T13:59:37.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-05-10T13:59:37.206 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T13:59:37.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-10T13:59:37.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-05-10T13:59:37.339 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:59:37.339 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T13:59:37.355 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T13:59:37.376 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T13:59:37.388 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy InRelease 2024-05-10T13:59:37.405 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T13:59:37.409 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-10T13:59:37.508 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy InRelease 2024-05-10T13:59:37.514 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T13:59:37.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-10T13:59:37.583 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-10T13:59:37.596 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T13:59:37.622 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-10T13:59:37.659 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-10T13:59:37.663 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-05-10T13:59:37.678 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T13:59:37.701 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-10T13:59:37.728 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-05-10T13:59:37.809 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 29.3 kB in 0s (64.2 kB/s) 2024-05-10T13:59:37.827 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 29.3 kB in 0s (69.9 kB/s) 2024-05-10T13:59:38.810 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:59:38.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3577-g7ef97a72-1jammy cephadm=19.0.0-3577-g7ef97a72-1jammy ceph-mds=19.0.0-3577-g7ef97a72-1jammy ceph-mgr=19.0.0-3577-g7ef97a72-1jammy ceph-common=19.0.0-3577-g7ef97a72-1jammy ceph-fuse=19.0.0-3577-g7ef97a72-1jammy ceph-test=19.0.0-3577-g7ef97a72-1jammy ceph-volume=19.0.0-3577-g7ef97a72-1jammy radosgw=19.0.0-3577-g7ef97a72-1jammy python3-rados=19.0.0-3577-g7ef97a72-1jammy python3-rgw=19.0.0-3577-g7ef97a72-1jammy python3-cephfs=19.0.0-3577-g7ef97a72-1jammy python3-rbd=19.0.0-3577-g7ef97a72-1jammy libcephfs2=19.0.0-3577-g7ef97a72-1jammy libcephfs-dev=19.0.0-3577-g7ef97a72-1jammy librados2=19.0.0-3577-g7ef97a72-1jammy librbd1=19.0.0-3577-g7ef97a72-1jammy rbd-fuse=19.0.0-3577-g7ef97a72-1jammy 2024-05-10T13:59:38.837 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:59:38.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3577-g7ef97a72-1jammy cephadm=19.0.0-3577-g7ef97a72-1jammy ceph-mds=19.0.0-3577-g7ef97a72-1jammy ceph-mgr=19.0.0-3577-g7ef97a72-1jammy ceph-common=19.0.0-3577-g7ef97a72-1jammy ceph-fuse=19.0.0-3577-g7ef97a72-1jammy ceph-test=19.0.0-3577-g7ef97a72-1jammy ceph-volume=19.0.0-3577-g7ef97a72-1jammy radosgw=19.0.0-3577-g7ef97a72-1jammy python3-rados=19.0.0-3577-g7ef97a72-1jammy python3-rgw=19.0.0-3577-g7ef97a72-1jammy python3-cephfs=19.0.0-3577-g7ef97a72-1jammy python3-rbd=19.0.0-3577-g7ef97a72-1jammy libcephfs2=19.0.0-3577-g7ef97a72-1jammy libcephfs-dev=19.0.0-3577-g7ef97a72-1jammy librados2=19.0.0-3577-g7ef97a72-1jammy librbd1=19.0.0-3577-g7ef97a72-1jammy rbd-fuse=19.0.0-3577-g7ef97a72-1jammy 2024-05-10T13:59:38.889 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-05-10T13:59:38.917 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-05-10T13:59:39.090 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-05-10T13:59:39.090 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-05-10T13:59:39.122 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-05-10T13:59:39.123 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-05-10T13:59:39.287 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:59:39.287 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:59:39.287 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:59:39.287 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:59:39.287 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T13:59:39.289 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-10T13:59:39.290 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-10T13:59:39.291 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-10T13:59:39.292 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-10T13:59:39.292 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-10T13:59:39.292 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-10T13:59:39.292 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-10T13:59:39.292 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet zip 2024-05-10T13:59:39.293 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-05-10T13:59:39.293 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-05-10T13:59:39.294 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2024-05-10T13:59:39.329 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T13:59:39.330 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T13:59:39.330 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T13:59:39.330 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T13:59:39.330 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T13:59:39.331 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T13:59:39.331 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T13:59:39.332 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-05-10T13:59:39.332 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-10T13:59:39.332 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-10T13:59:39.332 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T13:59:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet zip 2024-05-10T13:59:39.334 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-05-10T13:59:39.335 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-05-10T13:59:39.393 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-05-10T13:59:39.393 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-10T13:59:39.393 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-10T13:59:39.394 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-10T13:59:39.394 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-10T13:59:39.394 INFO:teuthology.orchestra.run.smithi130.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-10T13:59:39.394 INFO:teuthology.orchestra.run.smithi130.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-10T13:59:39.395 INFO:teuthology.orchestra.run.smithi130.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-10T13:59:39.395 INFO:teuthology.orchestra.run.smithi130.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-10T13:59:39.395 INFO:teuthology.orchestra.run.smithi130.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-10T13:59:39.395 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-10T13:59:39.396 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-10T13:59:39.397 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-10T13:59:39.397 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-10T13:59:39.397 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-10T13:59:39.397 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-10T13:59:39.397 INFO:teuthology.orchestra.run.smithi130.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-10T13:59:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-10T13:59:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-10T13:59:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-10T13:59:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-10T13:59:39.460 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-10T13:59:39.460 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 181 MB of archives. 2024-05-10T13:59:39.460 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-10T13:59:39.460 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-10T13:59:39.508 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-10T13:59:39.508 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 181 MB of archives. 2024-05-10T13:59:39.509 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-10T13:59:39.509 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-10T13:59:39.564 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-10T13:59:39.567 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-10T13:59:39.588 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-10T13:59:39.614 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3577-g7ef97a72-1jammy [3,558 kB] 2024-05-10T13:59:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-10T13:59:39.618 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-10T13:59:39.640 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-10T13:59:39.655 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-10T13:59:39.659 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-10T13:59:39.667 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3577-g7ef97a72-1jammy [3,558 kB] 2024-05-10T13:59:39.672 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-10T13:59:39.676 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-10T13:59:39.677 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-10T13:59:39.677 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-10T13:59:39.686 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-10T13:59:39.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-10T13:59:39.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-10T13:59:39.692 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-10T13:59:39.703 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-10T13:59:39.705 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-10T13:59:39.708 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-10T13:59:39.710 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-10T13:59:39.710 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-10T13:59:39.716 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-10T13:59:39.722 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-10T13:59:39.724 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-10T13:59:39.725 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-10T13:59:39.725 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-10T13:59:39.726 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-10T13:59:39.726 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-10T13:59:39.737 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-10T13:59:39.742 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-10T13:59:39.742 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-10T13:59:39.743 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-10T13:59:39.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-10T13:59:39.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-10T13:59:39.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-10T13:59:39.747 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-10T13:59:39.747 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-10T13:59:39.753 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-10T13:59:39.755 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-10T13:59:39.758 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-10T13:59:39.759 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-10T13:59:39.763 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-10T13:59:39.764 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-10T13:59:39.765 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-10T13:59:39.765 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-10T13:59:39.766 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-10T13:59:39.766 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-10T13:59:39.766 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-10T13:59:39.781 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-10T13:59:39.783 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-10T13:59:39.784 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-10T13:59:39.784 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-10T13:59:39.785 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-10T13:59:39.785 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-10T13:59:39.786 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-10T13:59:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-10T13:59:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-10T13:59:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-10T13:59:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-10T13:59:39.791 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-10T13:59:39.791 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-10T13:59:39.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-10T13:59:39.805 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-10T13:59:39.806 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-10T13:59:39.806 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-10T13:59:39.806 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-10T13:59:39.808 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-10T13:59:39.809 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-10T13:59:39.824 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-10T13:59:39.825 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-10T13:59:39.828 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-10T13:59:39.828 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-10T13:59:39.829 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-10T13:59:39.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-10T13:59:39.833 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-10T13:59:39.834 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-10T13:59:39.835 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-10T13:59:39.836 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-10T13:59:39.838 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-10T13:59:39.839 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-10T13:59:39.839 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-10T13:59:39.843 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-10T13:59:39.857 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-10T13:59:39.859 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-10T13:59:39.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-10T13:59:39.912 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-10T13:59:39.913 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-10T13:59:39.914 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-10T13:59:39.914 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-10T13:59:39.918 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-10T13:59:39.919 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-10T13:59:39.920 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-10T13:59:39.921 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-10T13:59:39.922 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-10T13:59:39.923 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-10T13:59:39.923 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-10T13:59:39.924 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-10T13:59:39.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-10T13:59:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-10T13:59:39.955 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-10T13:59:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-10T13:59:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-10T13:59:39.986 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-10T13:59:39.987 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-10T13:59:39.992 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-10T13:59:39.993 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-10T13:59:39.995 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-10T13:59:40.000 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-10T13:59:40.024 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-10T13:59:40.025 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-10T13:59:40.026 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-10T13:59:40.027 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-10T13:59:40.027 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-10T13:59:40.027 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-10T13:59:40.031 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-10T13:59:40.061 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-10T13:59:40.063 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-10T13:59:40.063 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-10T13:59:40.078 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3577-g7ef97a72-1jammy [3,224 kB] 2024-05-10T13:59:40.083 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-10T13:59:40.084 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-10T13:59:40.085 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-10T13:59:40.086 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-10T13:59:40.087 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-10T13:59:40.098 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-10T13:59:40.102 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-10T13:59:40.103 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-10T13:59:40.105 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-10T13:59:40.113 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-10T13:59:40.113 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-10T13:59:40.119 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-10T13:59:40.119 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-10T13:59:40.121 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-10T13:59:40.122 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-10T13:59:40.146 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-10T13:59:40.147 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-10T13:59:40.147 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-10T13:59:40.148 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-10T13:59:40.149 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-10T13:59:40.162 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-10T13:59:40.163 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-10T13:59:40.163 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-10T13:59:40.164 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-10T13:59:40.165 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3577-g7ef97a72-1jammy [3,224 kB] 2024-05-10T13:59:40.165 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-10T13:59:40.166 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-10T13:59:40.171 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-10T13:59:40.179 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-10T13:59:40.181 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-10T13:59:40.197 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-10T13:59:40.197 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-10T13:59:40.198 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-10T13:59:40.203 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-10T13:59:40.204 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-10T13:59:40.213 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-10T13:59:40.214 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-10T13:59:40.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-10T13:59:40.240 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-10T13:59:40.254 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-10T13:59:40.256 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-10T13:59:40.258 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-10T13:59:40.269 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-10T13:59:40.270 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-10T13:59:40.279 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-10T13:59:40.280 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-10T13:59:40.281 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-10T13:59:40.282 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-10T13:59:40.293 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-10T13:59:40.295 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-10T13:59:40.304 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3577-g7ef97a72-1jammy [714 kB] 2024-05-10T13:59:40.308 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-10T13:59:40.314 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-10T13:59:40.314 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-10T13:59:40.318 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-10T13:59:40.319 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-10T13:59:40.354 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3577-g7ef97a72-1jammy [356 kB] 2024-05-10T13:59:40.361 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3577-g7ef97a72-1jammy [32.8 kB] 2024-05-10T13:59:40.362 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3577-g7ef97a72-1jammy [180 kB] 2024-05-10T13:59:40.366 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3577-g7ef97a72-1jammy [67.4 kB] 2024-05-10T13:59:40.368 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3577-g7ef97a72-1jammy [334 kB] 2024-05-10T13:59:40.379 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3577-g7ef97a72-1jammy [714 kB] 2024-05-10T13:59:40.404 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3577-g7ef97a72-1jammy [6,880 kB] 2024-05-10T13:59:40.431 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3577-g7ef97a72-1jammy [356 kB] 2024-05-10T13:59:40.443 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3577-g7ef97a72-1jammy [32.8 kB] 2024-05-10T13:59:40.444 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3577-g7ef97a72-1jammy [180 kB] 2024-05-10T13:59:40.452 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3577-g7ef97a72-1jammy [67.4 kB] 2024-05-10T13:59:40.456 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3577-g7ef97a72-1jammy [334 kB] 2024-05-10T13:59:40.496 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3577-g7ef97a72-1jammy [6,880 kB] 2024-05-10T13:59:40.921 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3577-g7ef97a72-1jammy [112 kB] 2024-05-10T13:59:40.923 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3577-g7ef97a72-1jammy [467 kB] 2024-05-10T13:59:40.932 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3577-g7ef97a72-1jammy [25.8 MB] 2024-05-10T13:59:40.934 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3577-g7ef97a72-1jammy [112 kB] 2024-05-10T13:59:40.958 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3577-g7ef97a72-1jammy [467 kB] 2024-05-10T13:59:40.971 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3577-g7ef97a72-1jammy [25.8 MB] 2024-05-10T13:59:42.593 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3577-g7ef97a72-1jammy [5,096 kB] 2024-05-10T13:59:42.830 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3577-g7ef97a72-1jammy [244 kB] 2024-05-10T13:59:42.845 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3577-g7ef97a72-1jammy [5,096 kB] 2024-05-10T13:59:42.850 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3577-g7ef97a72-1jammy [124 kB] 2024-05-10T13:59:42.854 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3577-g7ef97a72-1jammy [1,545 kB] 2024-05-10T13:59:42.951 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3577-g7ef97a72-1jammy [6,260 kB] 2024-05-10T13:59:43.089 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3577-g7ef97a72-1jammy [244 kB] 2024-05-10T13:59:43.122 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3577-g7ef97a72-1jammy [124 kB] 2024-05-10T13:59:43.125 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3577-g7ef97a72-1jammy [1,545 kB] 2024-05-10T13:59:43.231 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3577-g7ef97a72-1jammy [6,260 kB] 2024-05-10T13:59:43.355 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3577-g7ef97a72-1jammy [22.8 MB] 2024-05-10T13:59:43.656 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3577-g7ef97a72-1jammy [22.8 MB] 2024-05-10T13:59:44.914 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3577-g7ef97a72-1jammy [14.0 kB] 2024-05-10T13:59:44.915 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3577-g7ef97a72-1jammy [870 kB] 2024-05-10T13:59:44.932 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3577-g7ef97a72-1jammy [2,442 kB] 2024-05-10T13:59:45.014 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3577-g7ef97a72-1jammy [793 kB] 2024-05-10T13:59:45.084 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3577-g7ef97a72-1jammy [148 kB] 2024-05-10T13:59:45.089 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3577-g7ef97a72-1jammy [2,279 kB] 2024-05-10T13:59:45.211 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3577-g7ef97a72-1jammy [8,625 kB] 2024-05-10T13:59:45.264 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3577-g7ef97a72-1jammy [14.0 kB] 2024-05-10T13:59:45.264 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3577-g7ef97a72-1jammy [870 kB] 2024-05-10T13:59:45.281 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3577-g7ef97a72-1jammy [2,442 kB] 2024-05-10T13:59:45.427 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3577-g7ef97a72-1jammy [793 kB] 2024-05-10T13:59:45.456 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3577-g7ef97a72-1jammy [148 kB] 2024-05-10T13:59:45.483 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3577-g7ef97a72-1jammy [2,279 kB] 2024-05-10T13:59:45.606 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3577-g7ef97a72-1jammy [8,625 kB] 2024-05-10T13:59:45.817 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3577-g7ef97a72-1jammy [14.2 kB] 2024-05-10T13:59:45.817 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3577-g7ef97a72-1jammy [51.6 MB] 2024-05-10T13:59:46.102 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3577-g7ef97a72-1jammy [14.2 kB] 2024-05-10T13:59:46.103 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3577-g7ef97a72-1jammy [51.6 MB] 2024-05-10T13:59:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3577-g7ef97a72-1jammy [124 kB] 2024-05-10T13:59:49.361 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3577-g7ef97a72-1jammy [38.9 kB] 2024-05-10T13:59:49.362 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3577-g7ef97a72-1jammy [13.6 MB] 2024-05-10T13:59:49.925 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3577-g7ef97a72-1jammy [91.6 kB] 2024-05-10T13:59:50.177 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3577-g7ef97a72-1jammy [124 kB] 2024-05-10T13:59:50.178 INFO:teuthology.orchestra.run.smithi130.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3577-g7ef97a72-1jammy [38.9 kB] 2024-05-10T13:59:50.179 INFO:teuthology.orchestra.run.smithi130.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3577-g7ef97a72-1jammy [13.6 MB] 2024-05-10T13:59:50.580 INFO:teuthology.orchestra.run.smithi130.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-dang-obj-state/7ef97a7233c4db41f8dc134b8d64f95427147ce5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3577-g7ef97a72-1jammy [91.6 kB] 2024-05-10T13:59:50.583 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 181 MB in 11s (17.2 MB/s) 2024-05-10T13:59:50.752 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-10T13:59:50.854 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-10T13:59:50.860 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-10T13:59:50.950 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T13:59:51.207 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 181 MB in 11s (16.1 MB/s) 2024-05-10T13:59:51.246 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-10T13:59:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-10T13:59:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T13:59:51.372 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-10T13:59:51.472 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-10T13:59:51.477 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-10T13:59:51.562 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T13:59:51.640 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-10T13:59:51.667 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-10T13:59:51.707 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T13:59:51.907 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-10T13:59:51.933 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-10T13:59:51.973 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T13:59:52.280 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-10T13:59:52.307 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-10T13:59:52.343 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T13:59:52.360 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-10T13:59:52.387 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:52.435 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:52.780 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-10T13:59:52.797 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-10T13:59:52.806 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:52.824 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:52.854 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:52.863 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:53.209 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-10T13:59:53.235 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:53.265 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-10T13:59:53.275 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:53.292 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:53.332 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:53.627 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-10T13:59:53.628 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-10T13:59:53.655 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T13:59:53.656 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-10T13:59:53.685 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T13:59:53.695 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T13:59:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-05-10T13:59:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-librados2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:54.021 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-10T13:59:54.031 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:54.047 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-10T13:59:54.088 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T13:59:54.399 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2024-05-10T13:59:54.425 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-librados2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:54.465 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:54.484 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-05-10T13:59:54.511 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-librbd1_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:54.551 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:54.877 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2024-05-10T13:59:54.902 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-librbd1_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:54.943 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:55.012 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-05-10T13:59:55.039 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:55.078 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:55.356 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-05-10T13:59:55.373 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:55.404 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2024-05-10T13:59:55.406 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:55.430 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:55.470 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:55.731 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2024-05-10T13:59:55.746 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:55.751 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-10T13:59:55.778 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T13:59:55.781 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:55.818 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.054 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-05-10T13:59:56.081 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:56.084 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-10T13:59:56.110 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T13:59:56.120 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.167 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.436 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2024-05-10T13:59:56.439 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-10T13:59:56.462 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:56.467 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T13:59:56.502 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.506 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.813 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-10T13:59:56.818 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-10T13:59:56.840 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T13:59:56.845 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-10T13:59:56.880 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:56.884 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T13:59:57.171 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-05-10T13:59:57.187 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-10T13:59:57.208 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-10T13:59:57.234 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-10T13:59:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T13:59:57.362 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-10T13:59:57.568 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2024-05-10T13:59:57.584 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-10T13:59:57.619 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-10T13:59:57.632 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-05-10T13:59:57.648 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:57.879 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2024-05-10T13:59:57.894 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T13:59:57.937 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T13:59:58.043 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-10T13:59:58.070 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-10T13:59:58.110 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T13:59:58.282 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-10T13:59:58.308 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-10T13:59:58.348 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T13:59:58.387 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-10T13:59:58.404 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-10T13:59:58.445 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T13:59:58.650 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-10T13:59:58.666 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-10T13:59:58.709 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T13:59:58.715 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-10T13:59:58.728 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-10T13:59:58.765 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T13:59:59.003 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-10T13:59:59.029 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-10T13:59:59.061 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T13:59:59.094 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-05-10T13:59:59.121 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-10T13:59:59.160 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-10T13:59:59.390 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua5.1. 2024-05-10T13:59:59.416 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-10T13:59:59.456 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-10T13:59:59.472 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-05-10T13:59:59.498 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-10T13:59:59.547 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-10T13:59:59.751 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-any. 2024-05-10T13:59:59.777 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-10T13:59:59.791 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-05-10T13:59:59.809 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-10T13:59:59.818 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-10T13:59:59.858 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-05-10T14:00:00.045 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package zip. 2024-05-10T14:00:00.064 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-10T14:00:00.103 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking zip (3.0-12build2) ... 2024-05-10T14:00:00.178 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-05-10T14:00:00.205 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-10T14:00:00.244 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-10T14:00:00.398 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package unzip. 2024-05-10T14:00:00.424 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-10T14:00:00.497 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-10T14:00:00.590 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-05-10T14:00:00.617 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-10T14:00:00.648 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-10T14:00:00.893 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package luarocks. 2024-05-10T14:00:00.919 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-10T14:00:00.959 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-10T14:00:01.015 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-05-10T14:00:01.042 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-librgw2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:01.081 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:01.316 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2024-05-10T14:00:01.343 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-librgw2_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:01.382 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:01.609 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-05-10T14:00:01.625 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:01.659 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:01.902 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2024-05-10T14:00:01.929 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:01.968 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:01.987 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-10T14:00:02.014 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-10T14:00:02.053 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T14:00:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-10T14:00:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-10T14:00:02.362 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T14:00:02.531 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-05-10T14:00:02.559 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:02.673 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2024-05-10T14:00:02.698 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:02.700 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:02.740 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:03.068 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-05-10T14:00:03.084 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:03.118 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:03.118 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2024-05-10T14:00:03.145 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:03.176 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:04.456 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2024-05-10T14:00:04.483 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:04.507 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-05-10T14:00:04.532 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:04.534 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:04.583 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:05.102 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-10T14:00:05.129 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-10T14:00:05.168 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-10T14:00:05.178 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-10T14:00:05.206 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-10T14:00:05.245 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-10T14:00:05.454 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2024-05-10T14:00:05.481 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-10T14:00:05.521 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T14:00:05.547 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-05-10T14:00:05.575 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-10T14:00:05.614 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T14:00:05.840 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-10T14:00:05.867 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-10T14:00:05.901 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-10T14:00:05.906 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-10T14:00:05.916 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-10T14:00:05.951 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-10T14:00:06.193 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-10T14:00:06.220 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-10T14:00:06.245 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-10T14:00:06.260 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-10T14:00:06.272 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-10T14:00:06.312 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-10T14:00:06.607 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-10T14:00:06.634 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-10T14:00:06.673 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-10T14:00:06.804 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-10T14:00:06.831 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-10T14:00:06.870 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-10T14:00:06.952 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-05-10T14:00:06.978 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-10T14:00:07.009 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-10T14:00:07.164 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2024-05-10T14:00:07.191 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-10T14:00:07.231 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-10T14:00:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-05-10T14:00:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-10T14:00:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-10T14:00:07.534 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2024-05-10T14:00:07.562 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-10T14:00:07.600 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-10T14:00:07.632 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-10T14:00:07.659 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-10T14:00:07.724 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-10T14:00:07.878 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-10T14:00:07.905 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-10T14:00:07.944 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-10T14:00:08.206 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-10T14:00:08.232 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-10T14:00:08.243 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-10T14:00:08.271 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-10T14:00:08.272 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-10T14:00:08.310 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-10T14:00:08.611 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2024-05-10T14:00:08.636 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-10T14:00:08.658 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-05-10T14:00:08.684 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-10T14:00:08.692 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-10T14:00:08.731 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-10T14:00:09.004 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2024-05-10T14:00:09.011 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-05-10T14:00:09.031 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-10T14:00:09.038 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-10T14:00:09.069 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-10T14:00:09.070 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-10T14:00:09.338 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-10T14:00:09.356 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-10T14:00:09.366 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-10T14:00:09.382 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-10T14:00:09.406 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-10T14:00:09.422 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-10T14:00:09.675 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2024-05-10T14:00:09.690 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-10T14:00:09.708 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-05-10T14:00:09.727 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T14:00:09.735 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-10T14:00:09.791 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T14:00:10.055 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-10T14:00:10.082 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-10T14:00:10.121 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-10T14:00:10.128 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-10T14:00:10.155 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-10T14:00:10.194 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-10T14:00:10.424 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-10T14:00:10.451 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-10T14:00:10.472 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-10T14:00:10.491 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-10T14:00:10.499 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-10T14:00:10.539 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-10T14:00:10.752 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2024-05-10T14:00:10.778 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-10T14:00:10.800 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-05-10T14:00:10.810 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-10T14:00:10.827 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-10T14:00:10.866 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-10T14:00:11.146 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2024-05-10T14:00:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-10T14:00:11.203 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-05-10T14:00:11.216 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T14:00:11.230 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-10T14:00:11.272 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T14:00:11.524 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2024-05-10T14:00:11.531 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-05-10T14:00:11.551 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-10T14:00:11.558 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-10T14:00:11.591 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T14:00:11.893 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2024-05-10T14:00:11.921 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-10T14:00:11.947 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T14:00:11.968 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T14:00:12.288 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-10T14:00:12.304 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-10T14:00:12.346 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T14:00:12.649 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-10T14:00:12.667 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-05-10T14:00:12.676 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-10T14:00:12.694 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-10T14:00:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-10T14:00:12.734 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T14:00:13.029 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-10T14:00:13.044 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-10T14:00:13.079 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T14:00:13.365 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-10T14:00:13.392 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-10T14:00:13.431 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-10T14:00:13.734 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-05-10T14:00:13.761 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-10T14:00:13.801 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-10T14:00:13.844 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2024-05-10T14:00:13.871 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-10T14:00:13.915 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-10T14:00:14.112 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-05-10T14:00:14.139 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-10T14:00:14.179 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T14:00:14.188 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2024-05-10T14:00:14.204 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-10T14:00:14.238 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T14:00:14.534 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-05-10T14:00:14.552 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2024-05-10T14:00:14.560 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-10T14:00:14.578 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-10T14:00:14.600 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-10T14:00:14.618 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-10T14:00:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-05-10T14:00:14.922 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-10T14:00:14.938 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2024-05-10T14:00:14.953 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-10T14:00:14.965 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-10T14:00:15.004 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-10T14:00:15.248 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-05-10T14:00:15.274 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-10T14:00:15.314 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T14:00:15.332 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2024-05-10T14:00:15.359 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-10T14:00:15.398 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T14:00:15.634 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-05-10T14:00:15.661 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-10T14:00:15.700 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T14:00:15.727 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2024-05-10T14:00:15.754 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-10T14:00:15.793 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T14:00:16.020 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-10T14:00:16.048 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-10T14:00:16.087 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T14:00:16.088 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-10T14:00:16.115 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-10T14:00:16.154 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T14:00:16.373 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-10T14:00:16.389 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:16.449 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-10T14:00:16.456 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:16.465 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:16.507 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:16.820 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-10T14:00:16.847 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:16.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:16.904 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-10T14:00:16.931 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:16.970 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:17.206 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-10T14:00:17.233 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-10T14:00:17.272 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-10T14:00:17.281 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-10T14:00:17.308 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-10T14:00:17.348 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-10T14:00:17.584 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-05-10T14:00:17.600 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-10T14:00:17.633 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-10T14:00:17.642 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2024-05-10T14:00:17.669 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-10T14:00:17.700 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-10T14:00:18.037 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2024-05-10T14:00:18.064 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:18.103 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:18.120 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-05-10T14:00:18.147 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:18.498 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2024-05-10T14:00:18.525 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:18.565 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:18.623 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-05-10T14:00:18.650 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:18.689 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:19.160 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2024-05-10T14:00:19.186 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:19.218 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:19.301 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-05-10T14:00:19.329 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:19.368 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:20.238 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2024-05-10T14:00:20.265 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-ceph_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:20.304 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-05-10T14:00:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:20.632 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2024-05-10T14:00:20.659 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:20.857 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-05-10T14:00:20.887 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:20.923 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:21.069 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2024-05-10T14:00:21.095 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:21.135 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:21.260 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-05-10T14:00:21.276 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:21.310 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:21.480 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2024-05-10T14:00:21.507 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-cephadm_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:21.546 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:21.696 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-05-10T14:00:21.724 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-cephadm_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:21.771 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:21.857 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-10T14:00:21.884 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-10T14:00:21.924 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-10T14:00:22.124 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-10T14:00:22.151 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-10T14:00:22.190 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-10T14:00:22.260 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-10T14:00:22.276 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T14:00:22.310 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:22.501 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-10T14:00:22.517 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T14:00:22.584 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:23.265 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2024-05-10T14:00:23.292 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T14:00:23.323 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:23.618 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2024-05-10T14:00:23.644 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-10T14:00:23.673 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-05-10T14:00:23.684 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T14:00:23.701 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T14:00:23.740 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:24.046 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-10T14:00:24.068 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-05-10T14:00:24.072 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:24.095 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-10T14:00:24.112 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:24.134 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T14:00:24.448 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-10T14:00:24.464 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-10T14:00:24.498 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-10T14:00:24.504 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-10T14:00:24.532 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:24.571 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:24.776 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2024-05-10T14:00:24.803 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-10T14:00:24.843 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T14:00:24.916 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-10T14:00:24.943 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-10T14:00:24.982 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-10T14:00:25.188 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-10T14:00:25.215 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:25.252 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-05-10T14:00:25.254 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:25.279 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-10T14:00:25.310 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T14:00:25.596 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-10T14:00:25.624 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:25.662 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:26.442 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-10T14:00:26.458 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-10T14:00:26.492 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T14:00:26.876 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-10T14:00:26.892 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-10T14:00:26.934 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T14:00:26.946 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2024-05-10T14:00:26.973 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-10T14:00:27.012 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T14:00:27.374 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-10T14:00:27.401 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-10T14:00:27.421 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-05-10T14:00:27.440 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-10T14:00:27.449 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-10T14:00:27.488 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T14:00:27.727 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2024-05-10T14:00:27.754 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-10T14:00:27.793 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T14:00:27.858 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-10T14:00:27.886 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-10T14:00:27.924 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-10T14:00:28.211 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-05-10T14:00:28.239 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-10T14:00:28.269 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T14:00:28.501 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-10T14:00:28.518 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:28.645 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:29.144 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-10T14:00:29.161 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:29.281 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:29.649 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2024-05-10T14:00:29.677 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-10T14:00:29.715 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-10T14:00:30.018 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-10T14:00:30.045 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-10T14:00:30.084 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-10T14:00:30.250 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-05-10T14:00:30.278 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-10T14:00:30.316 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-10T14:00:30.447 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-10T14:00:30.474 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-10T14:00:30.521 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T14:00:30.578 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-10T14:00:30.606 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-10T14:00:30.636 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-10T14:00:30.874 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2024-05-10T14:00:30.902 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-10T14:00:30.931 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-10T14:00:30.949 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-10T14:00:30.959 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-10T14:00:30.997 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T14:00:31.284 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-05-10T14:00:31.313 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-10T14:00:31.330 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2024-05-10T14:00:31.350 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-10T14:00:31.355 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-10T14:00:31.403 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-10T14:00:31.654 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-05-10T14:00:31.682 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-10T14:00:31.720 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-10T14:00:31.748 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-10T14:00:31.775 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-10T14:00:31.814 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T14:00:32.040 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-10T14:00:32.068 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-10T14:00:32.107 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T14:00:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2024-05-10T14:00:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-10T14:00:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-10T14:00:32.376 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-05-10T14:00:32.393 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-10T14:00:32.434 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-10T14:00:32.729 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-10T14:00:32.755 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-10T14:00:32.756 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-10T14:00:32.783 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-10T14:00:32.795 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T14:00:32.846 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T14:00:33.559 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-10T14:00:33.585 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-10T14:00:33.587 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:33.614 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:33.625 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:33.652 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:33.945 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-10T14:00:33.946 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-10T14:00:33.973 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-10T14:00:33.974 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-10T14:00:34.011 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T14:00:34.013 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T14:00:34.333 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-10T14:00:34.361 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T14:00:34.364 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-10T14:00:34.392 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T14:00:34.399 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T14:00:34.431 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T14:00:34.644 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-05-10T14:00:34.667 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2024-05-10T14:00:34.671 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T14:00:34.683 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T14:00:34.710 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-10T14:00:34.716 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-10T14:00:34.953 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2024-05-10T14:00:34.971 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-05-10T14:00:34.980 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-10T14:00:34.987 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-10T14:00:35.019 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-10T14:00:35.029 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-10T14:00:35.324 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-05-10T14:00:35.331 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2024-05-10T14:00:35.347 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-10T14:00:35.352 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-10T14:00:35.389 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-10T14:00:35.391 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-10T14:00:35.760 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2024-05-10T14:00:35.761 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-05-10T14:00:35.788 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:35.789 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:35.827 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:35.828 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:38.090 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2024-05-10T14:00:38.118 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:38.149 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-05-10T14:00:38.156 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:38.177 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3577-g7ef97a72-1jammy_all.deb ... 2024-05-10T14:00:38.216 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:38.459 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-10T14:00:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:38.518 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:38.528 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-10T14:00:38.557 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:38.594 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:38.838 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-10T14:00:38.865 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-10T14:00:38.904 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T14:00:38.914 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-10T14:00:38.942 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-10T14:00:39.197 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T14:00:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-10T14:00:39.262 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-10T14:00:39.291 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-10T14:00:39.610 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-10T14:00:39.639 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-10T14:00:39.654 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2024-05-10T14:00:39.682 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-10T14:00:39.685 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-10T14:00:39.720 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T14:00:40.056 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-05-10T14:00:40.085 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-10T14:00:40.122 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T14:00:40.142 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pkg-config. 2024-05-10T14:00:40.170 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-10T14:00:40.208 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T14:00:40.469 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-10T14:00:40.486 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-10T14:00:40.528 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-10T14:00:40.544 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-05-10T14:00:40.573 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-10T14:00:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T14:00:40.881 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-10T14:00:40.909 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-10T14:00:40.947 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-10T14:00:40.948 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-10T14:00:40.976 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-10T14:00:41.014 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-10T14:00:41.300 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2024-05-10T14:00:41.328 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-10T14:00:41.366 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-10T14:00:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-10T14:00:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-10T14:00:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-10T14:00:41.645 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2024-05-10T14:00:41.673 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-10T14:00:41.728 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-10T14:00:41.736 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-05-10T14:00:41.753 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-10T14:00:41.786 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-10T14:00:42.040 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2024-05-10T14:00:42.048 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-05-10T14:00:42.068 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-10T14:00:42.076 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-10T14:00:42.106 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-10T14:00:42.114 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-10T14:00:42.425 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-05-10T14:00:42.454 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-10T14:00:42.459 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2024-05-10T14:00:42.487 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-10T14:00:42.492 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-10T14:00:42.525 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-10T14:00:42.820 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-05-10T14:00:42.848 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-10T14:00:42.862 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2024-05-10T14:00:42.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-10T14:00:42.891 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-10T14:00:42.929 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T14:00:43.207 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-05-10T14:00:43.235 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-10T14:00:43.273 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T14:00:43.391 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-10T14:00:43.408 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-10T14:00:43.449 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-10T14:00:43.702 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2024-05-10T14:00:43.727 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-10T14:00:43.730 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-10T14:00:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-10T14:00:43.768 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-10T14:00:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-10T14:00:44.071 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2024-05-10T14:00:44.099 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-10T14:00:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-05-10T14:00:44.138 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T14:00:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-10T14:00:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-10T14:00:44.432 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-05-10T14:00:44.433 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2024-05-10T14:00:44.450 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-10T14:00:44.461 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-10T14:00:44.482 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T14:00:44.499 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-10T14:00:44.760 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-10T14:00:44.776 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-10T14:00:44.819 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-10T14:00:44.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-05-10T14:00:44.864 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-10T14:00:44.902 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-10T14:00:45.205 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-10T14:00:45.223 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-10T14:00:45.263 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-10T14:00:45.523 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2024-05-10T14:00:45.551 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../116-radosgw_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:45.589 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:46.001 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-05-10T14:00:46.029 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-radosgw_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:46.067 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:46.417 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2024-05-10T14:00:46.445 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:46.779 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-10T14:00:46.903 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-05-10T14:00:46.931 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3577-g7ef97a72-1jammy_amd64.deb ... 2024-05-10T14:00:46.969 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:47.030 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T14:00:47.156 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T14:00:47.266 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-10T14:00:47.423 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-10T14:00:47.524 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T14:00:47.651 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T14:00:47.745 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-10T14:00:47.923 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-10T14:00:48.154 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-10T14:00:48.233 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:48.262 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-10T14:00:48.675 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2024-05-10T14:00:48.680 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-10T14:00:48.752 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:48.831 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T14:00:49.099 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-10T14:00:49.253 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-05-10T14:00:49.375 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-10T14:00:49.400 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T14:00:49.484 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-10T14:00:49.719 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-10T14:00:49.926 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-10T14:00:49.962 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T14:00:50.088 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-10T14:00:50.178 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-10T14:00:50.304 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-10T14:00:50.390 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T14:00:50.566 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-10T14:00:50.766 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-10T14:00:50.825 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T14:00:50.951 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-10T14:00:51.026 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-10T14:00:51.269 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T14:00:51.310 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-10T14:00:51.581 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-10T14:00:51.671 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-10T14:00:51.823 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-10T14:00:51.922 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-10T14:00:52.082 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-10T14:00:52.199 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-10T14:00:52.342 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:52.450 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-10T14:00:52.585 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T14:00:52.718 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-10T14:00:52.802 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T14:00:52.962 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T14:00:52.985 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-10T14:00:53.088 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-10T14:00:53.339 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-10T14:00:53.345 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:53.613 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T14:00:53.713 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T14:00:53.714 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-10T14:00:53.746 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-10T14:00:53.801 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T14:00:53.815 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T14:00:53.924 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-10T14:00:53.927 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-10T14:00:54.183 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-10T14:00:54.328 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:54.454 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-10T14:00:54.572 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-10T14:00:54.606 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-10T14:00:54.670 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T14:00:54.730 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T14:00:54.796 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-10T14:00:54.998 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-10T14:00:55.172 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T14:00:55.282 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-10T14:00:55.316 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up zip (3.0-12build2) ... 2024-05-10T14:00:55.433 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T14:00:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T14:00:55.834 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-10T14:00:56.069 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T14:00:56.136 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-05-10T14:00:56.266 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T14:00:56.331 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T14:00:56.456 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-10T14:00:56.581 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T14:00:56.873 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-10T14:00:56.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T14:00:57.239 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T14:00:57.258 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-10T14:00:57.399 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-10T14:00:57.509 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T14:00:57.525 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T14:00:57.826 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-10T14:00:57.869 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T14:00:58.162 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T14:00:58.218 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-10T14:00:58.478 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T14:00:58.513 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-10T14:00:58.781 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-10T14:00:58.854 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T14:00:58.891 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:00:59.122 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T14:00:59.167 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1) ... 2024-05-10T14:00:59.474 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-10T14:00:59.485 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T14:00:59.742 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-10T14:00:59.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:00.169 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-05-10T14:01:00.487 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T14:01:00.657 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T14:01:00.909 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:01.045 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-10T14:01:01.320 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T14:01:01.446 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-10T14:01:01.563 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T14:01:01.717 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T14:01:01.856 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-10T14:01:01.977 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:02.099 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-10T14:01:02.111 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-10T14:01:02.371 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T14:01:02.375 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:02.472 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-10T14:01:02.502 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-10T14:01:02.590 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T14:01:02.794 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-10T14:01:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-10T14:01:03.054 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-10T14:01:03.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-10T14:01:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-10T14:01:03.426 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:03.552 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-10T14:01:03.556 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-10T14:01:03.799 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-10T14:01:03.854 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-10T14:01:04.050 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T14:01:04.088 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-10T14:01:04.176 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-10T14:01:04.314 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-10T14:01:04.452 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T14:01:04.578 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T14:01:04.582 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-10T14:01:04.841 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-10T14:01:04.854 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-10T14:01:05.156 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-10T14:01:05.276 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T14:01:05.402 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-10T14:01:05.415 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T14:01:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-10T14:01:05.667 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T14:01:05.697 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T14:01:05.756 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-10T14:01:05.804 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T14:01:06.002 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T14:01:06.080 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-10T14:01:06.128 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T14:01:06.390 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-10T14:01:06.522 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-10T14:01:06.649 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T14:01:06.756 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-10T14:01:06.775 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-10T14:01:06.874 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-10T14:01:06.901 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T14:01:06.990 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-10T14:01:07.133 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:07.228 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T14:01:07.259 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T14:01:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T14:01:07.585 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T14:01:07.730 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-10T14:01:07.911 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T14:01:07.983 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-10T14:01:08.108 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-10T14:01:08.367 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T14:01:08.413 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-10T14:01:08.493 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T14:01:08.530 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-10T14:01:08.798 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-10T14:01:08.827 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T14:01:09.083 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T14:01:09.154 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T14:01:09.415 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-10T14:01:09.419 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-10T14:01:09.514 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-10T14:01:09.782 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-10T14:01:09.823 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-10T14:01:10.050 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T14:01:10.081 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T14:01:10.409 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T14:01:10.411 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-10T14:01:10.535 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:10.661 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:10.787 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-10T14:01:10.821 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-10T14:01:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.106 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T14:01:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.350 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-10T14:01:11.450 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T14:01:11.552 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.627 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.652 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.753 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:11.778 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-10T14:01:11.879 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.087 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T14:01:12.087 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T14:01:12.115 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.242 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.367 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-10T14:01:12.588 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.627 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.706 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.728 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.832 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.854 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:12.958 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T14:01:13.076 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T14:01:13.076 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T14:01:13.530 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:13.656 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:13.816 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:13.942 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T14:01:14.104 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:14.213 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:14.339 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:14.490 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:14.617 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.184 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2024-05-10T14:01:15.203 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.304 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.405 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.523 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.553 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2024-05-10T14:01:15.649 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:15.721 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2024-05-10T14:01:15.734 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-10T14:01:15.867 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-10T14:01:16.167 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-05-10T14:01:16.220 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-10T14:01:16.485 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-05-10T14:01:16.655 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-05-10T14:01:16.668 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-10T14:01:16.751 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:16.810 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-10T14:01:16.877 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:17.118 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-10T14:01:17.339 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T14:01:17.339 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T14:01:17.592 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:17.718 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:17.829 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:18.164 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-10T14:01:18.211 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T14:01:18.211 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T14:01:18.665 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:18.670 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:18.917 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T14:01:18.917 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T14:01:19.018 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-10T14:01:19.409 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:19.471 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:19.628 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T14:01:19.629 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T14:01:19.693 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T14:01:19.694 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T14:01:20.110 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:20.198 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:20.383 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T14:01:20.383 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T14:01:20.412 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T14:01:20.412 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T14:01:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:20.891 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:20.987 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:21.147 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T14:01:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T14:01:21.362 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T14:01:21.362 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T14:01:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:21.761 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:21.866 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:21.912 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.016 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.143 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T14:01:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T14:01:22.293 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.613 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.680 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-10T14:01:22.739 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.789 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-10T14:01:22.849 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:22.933 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-10T14:01:23.000 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-3577-g7ef97a72-1jammy) ... 2024-05-10T14:01:23.361 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-10T14:01:23.479 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-10T14:01:23.697 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-10T14:01:24.085 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-10T14:01:24.774 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-10T14:01:24.780 DEBUG:teuthology.parallel:result is None 2024-05-10T14:01:24.924 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-10T14:01:25.583 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-10T14:01:25.588 DEBUG:teuthology.parallel:result is None 2024-05-10T14:01:25.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T14:01:25.807 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-05-10T14:01:25.828 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3577-g7ef97a72-1jammy 2024-05-10T14:01:25.829 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3577-g7ef97a72-1jammy 2024-05-10T14:01:25.829 INFO:teuthology.task.install:The correct ceph version 19.0.0-3577-g7ef97a72-1jammy is installed. 2024-05-10T14:01:25.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T14:01:25.981 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2024-05-10T14:01:26.001 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-3577-g7ef97a72-1jammy 2024-05-10T14:01:26.001 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3577-g7ef97a72-1jammy 2024-05-10T14:01:26.001 INFO:teuthology.task.install:The correct ceph version 19.0.0-3577-g7ef97a72-1jammy is installed. 2024-05-10T14:01:26.003 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T14:01:26.004 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:26.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T14:01:26.018 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:26.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T14:01:26.059 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T14:01:26.059 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:26.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T14:01:26.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T14:01:26.128 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:26.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T14:01:26.142 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T14:01:26.196 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T14:01:26.197 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:26.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T14:01:26.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T14:01:26.264 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:26.264 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T14:01:26.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T14:01:26.369 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T14:01:26.370 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:26.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T14:01:26.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T14:01:26.440 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:26.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T14:01:26.453 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T14:01:26.508 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T14:01:26.606 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T14:01:26.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-05-10T14:01:26.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-05-10T14:01:26.621 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T14:01:26.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T14:01:26.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T14:01:26.677 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T14:01:26.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T14:01:26.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T14:01:26.743 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T14:01:26.744 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T14:01:26.744 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219', 'branch': 'wip-dang-obj-state', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7701219', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-dang-obj-state'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dang-obj-state', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}}, 'owner': 'scheduled_dang@sidious.arb.redhat.com', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2189, 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-dang-obj-state', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5', 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJiduOxAmO/MABrCKSOVU34H443J7P4Laq509Rd/Ph/8gq1zYv6OXZQyrP1/NDeKpg3HyOLqPf+P7kEfi1nZ7U=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyZxTL71kJa9cHapAb6a70E7lAdq4EYTk0Bti5PvxazbFdWhf/I9ACUlzDTQKpJUnXCUS43xQTt9BLw4R9kz/4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_09:33:25', 'tube': 'smithi', 'user': 'dang', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T14:01:26.744 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T14:01:26.777 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T14:01:26.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T14:01:26.825 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T14:01:26.838 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:26.839 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T14:01:26.888 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T14:01:26.888 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-10 13:56:10.543147574 +0000 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-10 13:56:10.267150039 +0000 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-10 13:56:10.267150039 +0000 2024-05-10T14:01:26.937 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-05-10T14:01:26.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T14:01:26.991 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-10T14:01:26.991 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-10T14:01:26.991 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000312558 s, 1.6 MB/s 2024-05-10T14:01:26.992 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T14:01:27.045 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-10 13:56:10.991143572 +0000 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-10 13:56:10.747145752 +0000 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-10 13:56:10.747145752 +0000 2024-05-10T14:01:27.096 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-05-10T14:01:27.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T14:01:27.151 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-10T14:01:27.152 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-10T14:01:27.152 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000299322 s, 1.7 MB/s 2024-05-10T14:01:27.153 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T14:01:27.202 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-10 13:56:11.515138891 +0000 2024-05-10T14:01:27.252 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-10 13:56:11.251141250 +0000 2024-05-10T14:01:27.253 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-10 13:56:11.251141250 +0000 2024-05-10T14:01:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-05-10T14:01:27.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T14:01:27.306 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-10T14:01:27.307 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-10T14:01:27.307 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000211086 s, 2.4 MB/s 2024-05-10T14:01:27.308 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T14:01:27.358 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-05-10T14:01:27.404 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T14:01:27.404 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-10 13:56:11.987134675 +0000 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-10 13:56:11.743136856 +0000 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-10 13:56:11.743136856 +0000 2024-05-10T14:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-05-10T14:01:27.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T14:01:27.458 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-10T14:01:27.458 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-10T14:01:27.459 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000294067 s, 1.7 MB/s 2024-05-10T14:01:27.460 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T14:01:27.510 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:27.510 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:27.510 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T14:01:27.516 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T14:01:27.516 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-05-10T14:01:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-10 13:56:07.137686491 +0000 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-10 13:56:06.877688810 +0000 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-10 13:56:06.877688810 +0000 2024-05-10T14:01:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-05-10T14:01:27.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T14:01:27.621 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-10T14:01:27.621 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-10T14:01:27.621 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000418896 s, 1.2 MB/s 2024-05-10T14:01:27.622 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T14:01:27.675 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-05-10T14:01:27.722 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T14:01:27.722 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.722 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-05-10T14:01:27.722 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.723 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-10 13:56:07.637682030 +0000 2024-05-10T14:01:27.723 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-10 13:56:07.361684492 +0000 2024-05-10T14:01:27.723 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-10 13:56:07.361684492 +0000 2024-05-10T14:01:27.723 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-05-10T14:01:27.723 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T14:01:27.776 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-10T14:01:27.776 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-10T14:01:27.776 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000446043 s, 1.1 MB/s 2024-05-10T14:01:27.777 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T14:01:27.827 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-05-10T14:01:27.873 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T14:01:27.873 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:27.873 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-05-10T14:01:27.873 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:27.873 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-10 13:56:08.125677676 +0000 2024-05-10T14:01:27.874 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-10 13:56:07.861680031 +0000 2024-05-10T14:01:27.874 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-10 13:56:07.861680031 +0000 2024-05-10T14:01:27.874 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-05-10T14:01:27.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T14:01:27.928 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-10T14:01:27.928 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-10T14:01:27.928 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000423356 s, 1.2 MB/s 2024-05-10T14:01:27.929 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T14:01:27.979 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-05-10T14:01:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T14:01:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T14:01:28.027 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-05-10T14:01:28.027 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T14:01:28.028 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-10 13:56:08.629673181 +0000 2024-05-10T14:01:28.028 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-10 13:56:08.389675321 +0000 2024-05-10T14:01:28.028 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-10 13:56:08.389675321 +0000 2024-05-10T14:01:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-05-10T14:01:28.029 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T14:01:28.079 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-10T14:01:28.080 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-10T14:01:28.080 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000378691 s, 1.4 MB/s 2024-05-10T14:01:28.080 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T14:01:28.131 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:28.131 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T14:01:28.131 INFO:tasks.ceph:Generating config... 2024-05-10T14:01:28.132 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-10T14:01:28.132 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T14:01:28.132 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T14:01:28.132 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T14:01:28.132 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T14:01:28.133 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T14:01:28.133 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T14:01:28.134 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-10T14:01:28.134 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T14:01:28.134 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-10T14:01:28.134 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T14:01:28.134 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-10T14:01:28.134 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T14:01:28.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T14:01:28.170 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T14:01:28.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T14:01:28.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T14:01:28.324 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.c', '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]'), ('mon.b', '172.21.15.130')] 2024-05-10T14:01:28.325 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.130'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-10T14:01:28.326 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:28.326 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T14:01:28.372 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --addv c '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]' --add b 172.21.15.130 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-05-10T14:01:28.462035+0000 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-05-10T14:01:28.462035+0000 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-10T14:01:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-05-10T14:01:28.461 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-10T14:01:28.461 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T14:01:28.462 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T14:01:28.466 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9... 2024-05-10T14:01:28.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T14:01:28.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T14:01:28.537 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-05-10T14:01:28.537 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-05-10T14:01:28.537 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-05-10T14:01:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T14:01:28.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.130" 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.540 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.541 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-05-10T14:01:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-05-10T14:01:28.543 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-05-10T14:01:28.543 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-05-10T14:01:28.543 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-05-10T14:01:28.543 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-05-10T14:01:28.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: osd blocked scrub grace period = 3600 2024-05-10T14:01:28.544 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: osd max markdown count = 1000 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: osd shutdown pgref assert = True 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-05-10T14:01:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-05-10T14:01:28.546 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T14:01:28.547 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout: rgw relaxed s3 bucket names = True 2024-05-10T14:01:28.548 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-05-10T14:01:28.549 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-05-10T14:01:28.549 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-05-10T14:01:28.550 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-05-10T14:01:28.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-05-10T14:01:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.553 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.130" 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.554 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.555 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2024-05-10T14:01:28.556 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: osd blocked scrub grace period = 3600 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: osd max markdown count = 1000 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-05-10T14:01:28.557 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-05-10T14:01:28.558 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-05-10T14:01:28.559 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-05-10T14:01:28.559 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-05-10T14:01:28.560 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: rgw relaxed s3 bucket names = True 2024-05-10T14:01:28.562 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-05-10T14:01:28.563 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-05-10T14:01:28.563 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-05-10T14:01:28.563 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T14:01:28.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T14:01:28.643 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T14:01:28.643 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:28.643 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T14:01:28.651 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:28.651 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T14:01:28.702 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:01:28.702 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:28.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T14:01:28.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T14:01:28.768 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:28.768 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:28.820 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:01:28.820 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:28.820 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T14:01:28.820 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T14:01:28.845 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:28.845 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:28.894 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T14:01:28.894 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T14:01:28.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T14:01:28.939 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T14:01:28.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T14:01:28.988 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T14:01:29.006 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T14:01:29.006 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T14:01:29.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T14:01:29.044 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T14:01:29.055 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T14:01:29.091 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T14:01:29.102 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T14:01:29.103 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T14:01:29.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T14:01:29.116 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:29.116 INFO:tasks.ceph:role: osd.0 2024-05-10T14:01:29.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:01:29.117 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T14:01:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:29.196 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-10T14:01:29.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-10T14:01:29.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T14:01:29.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T14:01:29.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:29.312 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:29.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T14:01:29.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:29.366 INFO:tasks.ceph:role: osd.1 2024-05-10T14:01:29.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:01:29.367 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T14:01:29.420 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:29.421 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:29.445 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-10T14:01:29.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-10T14:01:29.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T14:01:29.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T14:01:29.557 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:29.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:29.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T14:01:29.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:29.613 INFO:tasks.ceph:role: osd.2 2024-05-10T14:01:29.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:01:29.614 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T14:01:29.668 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:29.668 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:29.668 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:29.668 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:29.668 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:29.669 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:29.669 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:29.692 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-10T14:01:29.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-10T14:01:29.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T14:01:29.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T14:01:29.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:29.807 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:29.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T14:01:29.865 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:29.865 INFO:tasks.ceph:role: osd.3 2024-05-10T14:01:29.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:01:29.865 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T14:01:29.922 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:29.947 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-10T14:01:29.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-10T14:01:29.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T14:01:30.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T14:01:30.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:30.069 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:30.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T14:01:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T14:01:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T14:01:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T14:01:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T14:01:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:30.181+0000 7fce628657c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T14:01:33.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T14:01:33.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T14:01:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T14:01:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T14:01:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T14:01:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T14:01:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:33.249+0000 7f3c431fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T14:01:36.208 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T14:01:36.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T14:01:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T14:01:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T14:01:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T14:01:36.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T14:01:36.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:36.349+0000 7f7a3812c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T14:01:39.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T14:01:39.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:39.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T14:01:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T14:01:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T14:01:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T14:01:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T14:01:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-10T14:01:39.465+0000 7fe6f86e17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T14:01:42.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T14:01:42.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T14:01:42.504 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:42.504 INFO:tasks.ceph:role: osd.4 2024-05-10T14:01:42.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:01:42.504 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T14:01:42.565 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:42.565 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:42.565 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:42.566 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:43.022 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-05-10T14:01:43.024 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-05-10T14:01:43.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T14:01:43.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T14:01:43.133 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:43.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:43.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T14:01:43.187 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:43.187 INFO:tasks.ceph:role: osd.5 2024-05-10T14:01:43.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:01:43.188 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:43.253 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:43.254 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:43.714 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-05-10T14:01:43.716 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-05-10T14:01:43.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T14:01:43.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T14:01:43.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:43.874 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:43.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T14:01:43.930 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:43.930 INFO:tasks.ceph:role: osd.6 2024-05-10T14:01:43.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:01:43.930 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T14:01:43.995 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:44.458 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-05-10T14:01:44.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-05-10T14:01:44.460 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T14:01:44.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T14:01:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:44.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:44.613 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T14:01:44.669 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T14:01:44.669 INFO:tasks.ceph:role: osd.7 2024-05-10T14:01:44.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:01:44.670 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T14:01:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T14:01:45.151 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-05-10T14:01:45.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-05-10T14:01:45.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T14:01:45.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T14:01:45.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:01:45.255 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T14:01:45.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:45.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T14:01:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T14:01:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T14:01:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T14:01:45.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T14:01:45.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:45.356+0000 7f12e75907c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T14:01:48.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T14:01:48.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:48.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.448+0000 7f1327dd77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T14:01:48.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.448+0000 7f1327dd77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T14:01:48.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.452+0000 7f1327dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T14:01:48.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.452+0000 7f1327dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T14:01:48.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.452+0000 7f1327dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T14:01:48.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:48.452+0000 7f1327dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T14:01:51.468 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T14:01:51.525 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:51.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.604+0000 7f3577d1c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T14:01:51.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.604+0000 7f3577d1c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T14:01:51.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.604+0000 7f3577d1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T14:01:51.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.604+0000 7f3577d1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T14:01:51.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.604+0000 7f3577d1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T14:01:51.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:51.608+0000 7f3577d1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T14:01:54.594 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T14:01:54.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:54.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T14:01:54.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T14:01:54.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T14:01:54.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T14:01:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T14:01:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-10T14:01:54.736+0000 7f6e5df6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T14:01:57.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T14:01:57.794 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T14:01:57.795 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:57.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T14:01:57.809 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:57.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T14:01:57.863 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:57.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T14:01:57.919 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:57.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T14:01:57.976 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:57.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T14:01:58.032 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T14:01:58.045 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T14:01:58.101 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T14:01:58.160 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T14:01:58.213 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T14:01:58.269 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:01:58.269 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T14:01:58.276 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:01:58.276 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T14:01:58.317 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T14:01:58.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T14:01:58.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC4KD5mSQEUOBAAZLgY9vI5s5vr67kdwR8WeA== 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC6KD5m65EECxAAdrasIavJVF2p4uZ/NOm7yw== 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC9KD5mqtfjDhAAKERGm8UxPtZXWiDZtBpvAg== 2024-05-10T14:01:58.364 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDAKD5m/F/fFBAAWRYseaXMaoZu2dLyZHYq2g== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDDKD5mBIzNGxAAiBi7SZFTLKLZNvDY+dzM0w== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC4KD5mEpIPOxAAWVyHFlsetfePuK276hf2ug== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDJKD5mjN93FRAA9KIsynQfr33UideZUiOB5g== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDMKD5m5SkcGxAAX2bQaxtJzbyW0BEQtZ626g== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDPKD5mcWZnJBAAQ6c2FE7hqjDeRDWdAk1q8Q== 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-05-10T14:01:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDSKD5mwsowLBAAeXmwr1cTsokX3qVHUdBqHQ== 2024-05-10T14:01:58.366 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-05-10T14:01:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC5KD5mMl2+AhAABn2H4Z7pHTYeryLGbrK3WA== 2024-05-10T14:01:58.366 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2024-05-10T14:01:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC5KD5mUG2aBRAAsWzdZH/QD6qfjYNpurnDwg== 2024-05-10T14:01:58.371 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-05-10T14:01:58.371 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC4KD5mSQEUOBAAZLgY9vI5s5vr67kdwR8WeA== 2024-05-10T14:01:58.371 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-05-10T14:01:58.371 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC6KD5m65EECxAAdrasIavJVF2p4uZ/NOm7yw== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC9KD5mqtfjDhAAKERGm8UxPtZXWiDZtBpvAg== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDAKD5m/F/fFBAAWRYseaXMaoZu2dLyZHYq2g== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDDKD5mBIzNGxAAiBi7SZFTLKLZNvDY+dzM0w== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC4KD5mEpIPOxAAWVyHFlsetfePuK276hf2ug== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDJKD5mjN93FRAA9KIsynQfr33UideZUiOB5g== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDMKD5m5SkcGxAAX2bQaxtJzbyW0BEQtZ626g== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDPKD5mcWZnJBAAQ6c2FE7hqjDeRDWdAk1q8Q== 2024-05-10T14:01:58.372 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-05-10T14:01:58.373 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDSKD5mwsowLBAAeXmwr1cTsokX3qVHUdBqHQ== 2024-05-10T14:01:58.373 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-05-10T14:01:58.373 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC5KD5mMl2+AhAABn2H4Z7pHTYeryLGbrK3WA== 2024-05-10T14:01:58.373 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-05-10T14:01:58.373 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC5KD5mUG2aBRAAsWzdZH/QD6qfjYNpurnDwg== 2024-05-10T14:01:58.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T14:01:58.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T14:01:58.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.465 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T14:01:58.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T14:01:58.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:58.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:59.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:59.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:59.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:59.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T14:01:59.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T14:01:59.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T14:01:59.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T14:01:59.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T14:01:59.359 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T14:01:59.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T14:01:59.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T14:01:59.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T14:01:59.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T14:01:59.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T14:01:59.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T14:01:59.669 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T14:01:59.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T14:01:59.776 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T14:01:59.787 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:59.789 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T14:01:59.833 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T14:01:59.833 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T14:01:59.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T14:01:59.836 INFO:tasks.ceph.mon.a:Started 2024-05-10T14:01:59.837 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T14:01:59.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T14:01:59.839 INFO:tasks.ceph.mon.c:Started 2024-05-10T14:01:59.839 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T14:01:59.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T14:01:59.878 INFO:tasks.ceph.mon.b:Started 2024-05-10T14:01:59.878 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T14:01:59.879 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T14:01:59.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T14:01:59.881 INFO:tasks.ceph.mgr.y:Started 2024-05-10T14:01:59.881 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T14:01:59.881 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T14:01:59.883 INFO:tasks.ceph.mgr.x:Started 2024-05-10T14:01:59.884 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T14:01:59.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T14:02:05.409 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-05-10T14:02:05.429 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T14:02:05.429 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T14:02:05.429 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:02:05.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T14:02:05.441 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:02:05.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T14:02:05.489 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:05.489+0000 7fb9a4da9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T14:02:05.498 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:02:05.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T14:02:05.554 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:02:05.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T14:02:05.556 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:05.551+0000 7f7f107f6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T14:02:05.610 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:02:05.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T14:02:05.624 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:02:05.625 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T14:02:05.681 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:02:05.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T14:02:05.737 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-10T14:02:05.737 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T14:02:05.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new f64c785c-eaab-4e55-836b-580d80434ea8 0 2024-05-10T14:02:06.001 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.001+0000 7fb9a4da9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T14:02:06.054 INFO:teuthology.orchestra.run.smithi130.stdout:0 2024-05-10T14:02:06.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new db35bdb1-1358-4158-9dc4-7ffac65632fa 1 2024-05-10T14:02:06.100 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:06.095+0000 7f7f107f6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T14:02:06.204 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.205+0000 7fb9a4da9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T14:02:06.323 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-05-10T14:02:06.336 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:06.331+0000 7f7f107f6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T14:02:06.342 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 28c46e2b-cef4-4688-956e-8da9955e626a 2 2024-05-10T14:02:06.584 INFO:teuthology.orchestra.run.smithi130.stdout:2 2024-05-10T14:02:06.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 0032870c-d3a1-43dd-9fc9-b4091efab1eb 3 2024-05-10T14:02:06.772 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.773+0000 7fb9a4da9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T14:02:06.798 INFO:teuthology.orchestra.run.smithi130.stdout:3 2024-05-10T14:02:06.815 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 2d515a59-3855-4fbe-a1e4-8c6296681688 4 2024-05-10T14:02:06.828 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.829+0000 7fb9a4da9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T14:02:06.884 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.885+0000 7fb9a4da9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T14:02:06.906 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:06.903+0000 7f7f107f6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T14:02:06.963 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:06.959+0000 7f7f107f6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T14:02:06.965 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:06.965+0000 7fb9a4da9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T14:02:07.011 INFO:teuthology.orchestra.run.smithi130.stdout:4 2024-05-10T14:02:07.018 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.015+0000 7f7f107f6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T14:02:07.020 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:07.021+0000 7fb9a4da9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T14:02:07.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 13696b08-e381-4169-8842-acf9b90c0025 5 2024-05-10T14:02:07.099 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.095+0000 7f7f107f6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T14:02:07.101 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:07.101+0000 7fb9a4da9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T14:02:07.154 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.151+0000 7f7f107f6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T14:02:07.157 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:07.157+0000 7fb9a4da9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T14:02:07.227 INFO:teuthology.orchestra.run.smithi130.stdout:5 2024-05-10T14:02:07.234 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.231+0000 7f7f107f6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T14:02:07.244 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 85508497-b5a2-42b4-88fb-10a4884bc5f4 6 2024-05-10T14:02:07.291 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.287+0000 7f7f107f6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T14:02:07.317 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:07.317+0000 7fb9a4da9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T14:02:07.382 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:07.381+0000 7fb9a4da9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T14:02:07.440 INFO:teuthology.orchestra.run.smithi130.stdout:6 2024-05-10T14:02:07.457 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new c2edb963-9e6f-45d7-a4a8-27287ec42c40 7 2024-05-10T14:02:07.462 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.459+0000 7f7f107f6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T14:02:07.526 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:07.523+0000 7f7f107f6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T14:02:07.649 INFO:teuthology.orchestra.run.smithi130.stdout:7 2024-05-10T14:02:07.665 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T14:02:07.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T14:02:07.667 INFO:tasks.ceph.osd.0:Started 2024-05-10T14:02:07.667 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T14:02:07.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T14:02:07.669 INFO:tasks.ceph.osd.1:Started 2024-05-10T14:02:07.670 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T14:02:07.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T14:02:07.672 INFO:tasks.ceph.osd.2:Started 2024-05-10T14:02:07.672 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T14:02:07.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T14:02:07.675 INFO:tasks.ceph.osd.3:Started 2024-05-10T14:02:07.675 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T14:02:07.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T14:02:07.710 INFO:tasks.ceph.osd.4:Started 2024-05-10T14:02:07.710 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T14:02:07.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T14:02:07.712 INFO:tasks.ceph.osd.5:Started 2024-05-10T14:02:07.712 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T14:02:07.712 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T14:02:07.714 INFO:tasks.ceph.osd.6:Started 2024-05-10T14:02:07.715 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T14:02:07.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T14:02:07.716 INFO:tasks.ceph.osd.7:Started 2024-05-10T14:02:07.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:07.935 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:07.936 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:07.646468+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:07.952 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T14:02:07.953 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T14:02:08.085 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:08.085+0000 7fb238ec87c0 -1 Falling back to public interface 2024-05-10T14:02:08.089 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-10T14:02:08.089 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-10T14:02:08.089 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-05-10T14:02:08.140 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:08.141+0000 7fb9a4da9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T14:02:08.186 INFO:tasks.ceph.mgr.x.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-10T14:02:08.186 INFO:tasks.ceph.mgr.x.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-10T14:02:08.186 INFO:tasks.ceph.mgr.x.smithi130.stderr: from numpy import show_config as show_numpy_config 2024-05-10T14:02:08.230 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:08.227+0000 7f7f107f6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T14:02:08.320 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:08.321+0000 7fb9a4da9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T14:02:08.329 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:08.329+0000 7f5eaf5f57c0 -1 Falling back to public interface 2024-05-10T14:02:08.330 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:08.327+0000 7f6cfb6827c0 -1 Falling back to public interface 2024-05-10T14:02:08.330 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:08.327+0000 7f45b5ab07c0 -1 Falling back to public interface 2024-05-10T14:02:08.341 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:08.339+0000 7f7e79f9b7c0 -1 Falling back to public interface 2024-05-10T14:02:08.348 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:08.349+0000 7f756d8b87c0 -1 Falling back to public interface 2024-05-10T14:02:08.355 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:08.357+0000 7f87404447c0 -1 Falling back to public interface 2024-05-10T14:02:08.361 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:08.359+0000 7f5aa66437c0 -1 Falling back to public interface 2024-05-10T14:02:08.383 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:08.379+0000 7f7f107f6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T14:02:08.484 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:08.485+0000 7fb9a4da9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T14:02:08.551 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:08.549+0000 7fb9a4da9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T14:02:08.573 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:08.571+0000 7f7f107f6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T14:02:08.643 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:08.639+0000 7f7f107f6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T14:02:08.692 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:08.693+0000 7fb9a4da9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T14:02:08.758 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:08.781 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:08.779+0000 7f7f107f6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T14:02:08.943 INFO:teuthology.misc.health.smithi016.stdout: 2024-05-10T14:02:08.943 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:07.646468+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:08.959 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T14:02:09.344 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:09.345+0000 7fb9a4da9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T14:02:09.423 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:09.421+0000 7fb9a4da9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T14:02:09.423 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:09.419+0000 7f7f107f6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T14:02:09.498 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:09.495+0000 7f7f107f6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T14:02:09.613 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:09.613+0000 7fb9a4da9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T14:02:09.682 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:09.679+0000 7f7f107f6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T14:02:09.690 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:09.689+0000 7fb9a4da9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T14:02:09.756 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:09.751+0000 7f7f107f6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T14:02:09.993 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:09.993+0000 7fb9a4da9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T14:02:10.048 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:10.043+0000 7f7f107f6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T14:02:10.058 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:10.057+0000 7fb9a4da9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T14:02:10.110 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-05-10T14:02:10.107+0000 7f7f107f6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T14:02:11.093 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:11.093+0000 7fb94b8f0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T14:02:11.093 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-10T14:02:11.093+0000 7fb94b8f0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T14:02:11.984 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:11.985+0000 7fb238ec87c0 -1 osd.1 0 log_to_monitors true 2024-05-10T14:02:12.092 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:12.087+0000 7f7e79f9b7c0 -1 osd.5 0 log_to_monitors true 2024-05-10T14:02:12.148 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:12.149+0000 7f87404447c0 -1 osd.0 0 log_to_monitors true 2024-05-10T14:02:12.215 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:12.217+0000 7f5eaf5f57c0 -1 osd.3 0 log_to_monitors true 2024-05-10T14:02:12.227 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:12.223+0000 7f45b5ab07c0 -1 osd.7 0 log_to_monitors true 2024-05-10T14:02:12.234 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:12.233+0000 7f756d8b87c0 -1 osd.2 0 log_to_monitors true 2024-05-10T14:02:12.236 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:12.235+0000 7f6cfb6827c0 -1 osd.4 0 log_to_monitors true 2024-05-10T14:02:12.242 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:12.239+0000 7f5aa66437c0 -1 osd.6 0 log_to_monitors true 2024-05-10T14:02:13.907 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:13.909+0000 7fb234e71640 -1 osd.1 0 waiting for initial osdmap 2024-05-10T14:02:13.940 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:13.941+0000 7fb22cca5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:15.379 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:15.381+0000 7f7569861640 -1 osd.2 0 waiting for initial osdmap 2024-05-10T14:02:15.396 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:15.397+0000 7f873cbff640 -1 osd.0 0 waiting for initial osdmap 2024-05-10T14:02:15.407 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:15.409+0000 7f7561695640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:15.408 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:15.409+0000 7f5eabdb0640 -1 osd.3 0 waiting for initial osdmap 2024-05-10T14:02:15.424 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:15.425+0000 7f8734221640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:15.448 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:15.449+0000 7f5ea33d2640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:15.766 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:16.058 INFO:teuthology.misc.health.smithi016.stdout: 2024-05-10T14:02:16.058 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":14,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:15.143257+0000","last_up_change":"2024-05-10T14:02:14.092317+0000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:16.073 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-10T14:02:16.246 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:16.243+0000 7f7e75f44640 -1 osd.5 0 waiting for initial osdmap 2024-05-10T14:02:16.258 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:16.255+0000 7f6cf7e3d640 -1 osd.4 0 waiting for initial osdmap 2024-05-10T14:02:16.270 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:16.267+0000 7f5aa25ec640 -1 osd.6 0 waiting for initial osdmap 2024-05-10T14:02:16.273 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:16.271+0000 7f7e6dd78640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:16.281 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:16.279+0000 7f6cef45f640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:16.286 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:16.283+0000 7f45b1a59640 -1 osd.7 0 waiting for initial osdmap 2024-05-10T14:02:16.301 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:16.299+0000 7f5a9a420640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:16.317 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:16.315+0000 7f45a988d640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:02:22.881 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:23.189 INFO:teuthology.misc.health.smithi016.stdout: 2024-05-10T14:02:23.189 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":19,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:20.538760+0000","last_up_change":"2024-05-10T14:02:16.466286+0000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6817","nonce":378234669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6819","nonce":378234669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6823","nonce":378234669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6821","nonce":378234669}]},"public_addr":"172.21.15.130:6817/378234669","cluster_addr":"172.21.15.130:6819/378234669","heartbeat_back_addr":"172.21.15.130:6823/378234669","heartbeat_front_addr":"172.21.15.130:6821/378234669","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:23.207 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T14:02:23.207 INFO:tasks.ceph:Creating RBD pool 2024-05-10T14:02:23.207 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-10T14:02:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2024-05-10T14:02:23.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-10T14:02:24.581 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-10T14:02:24.607 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T14:02:24.608 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T14:02:24.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T14:02:24.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T14:02:24.608 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T14:02:24.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:24.976 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1267629932},{"type":"v1","addr":"172.21.15.16:6833","nonce":1267629932}]},"active_addr":"172.21.15.16:6833/1267629932","active_change":"2024-05-10T14:02:10.078987+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":4204112599}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":81462917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":2250301339}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":2781948516}]}]} 2024-05-10T14:02:24.987 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T14:02:24.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T14:02:24.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:25.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:25.295 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:24.567658+0000","last_up_change":"2024-05-10T14:02:16.466286+0000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T14:02:23.522518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6817","nonce":378234669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6819","nonce":378234669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6823","nonce":378234669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6821","nonce":378234669}]},"public_addr":"172.21.15.130:6817/378234669","cluster_addr":"172.21.15.130:6819/378234669","heartbeat_back_addr":"172.21.15.130:6823/378234669","heartbeat_front_addr":"172.21.15.130:6821/378234669","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:25.318 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T14:02:25.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:02:25.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:25.617 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:02:25.575230+0000","last_up_change":"2024-05-10T14:02:16.466286+0000","last_in_change":"2024-05-10T14:02:07.646468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T14:02:23.522518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6817","nonce":378234669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6819","nonce":378234669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6823","nonce":378234669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":378234669},{"type":"v1","addr":"172.21.15.130:6821","nonce":378234669}]},"public_addr":"172.21.15.130:6817/378234669","cluster_addr":"172.21.15.130:6819/378234669","heartbeat_back_addr":"172.21.15.130:6823/378234669","heartbeat_front_addr":"172.21.15.130:6821/378234669","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:02:25.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T14:02:25.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T14:02:25.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T14:02:25.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T14:02:25.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T14:02:25.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T14:02:25.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T14:02:25.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T14:02:25.886 INFO:teuthology.orchestra.run.smithi016.stdout:64424509443 2024-05-10T14:02:25.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T14:02:25.904 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:25.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T14:02:25.911 INFO:teuthology.orchestra.run.smithi016.stdout:64424509443 2024-05-10T14:02:25.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T14:02:25.913 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:25.913 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T14:02:25.915 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:25.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T14:02:25.916 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-10T14:02:25.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T14:02:25.921 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:25.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T14:02:25.930 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:25.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T14:02:26.413 INFO:teuthology.orchestra.run.smithi016.stdout:64424509442 2024-05-10T14:02:26.414 INFO:teuthology.orchestra.run.smithi016.stdout:64424509442 2024-05-10T14:02:26.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2024-05-10T14:02:26.443 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:26.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2024-05-10T14:02:26.451 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:26.461 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:26.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-05-10T14:02:26.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-05-10T14:02:26.482 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-05-10T14:02:26.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-05-10T14:02:26.491 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:26.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-05-10T14:02:26.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2024-05-10T14:02:26.513 INFO:teuthology.orchestra.run.smithi016.stdout:64424509443 2024-05-10T14:02:26.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.2 2024-05-10T14:02:27.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T14:02:27.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T14:02:27.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T14:02:27.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T14:02:27.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T14:02:27.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T14:02:27.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T14:02:27.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T14:02:27.981 INFO:teuthology.orchestra.run.smithi016.stdout:64424509443 2024-05-10T14:02:27.985 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:28.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.7 2024-05-10T14:02:28.009 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-05-10T14:02:28.013 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.015 INFO:teuthology.orchestra.run.smithi016.stdout:64424509443 2024-05-10T14:02:28.023 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:28.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.4 2024-05-10T14:02:28.042 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-05-10T14:02:28.050 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.055 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:28.063 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-10T14:02:28.069 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-05-10T14:02:28.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-05-10T14:02:28.079 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.081 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-05-10T14:02:28.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-10T14:02:28.084 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.2 2024-05-10T14:02:28.093 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-05-10T14:02:28.100 DEBUG:teuthology.parallel:result is None 2024-05-10T14:02:28.100 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T14:02:28.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:28.422 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:28.422 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:28.439 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-10T14:02:28.094993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235708,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739012,"statfs":{"total":773094113280,"available":772852748288,"internally_reserved":0,"allocated":2945024,"data_stored":1761908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534161"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647799+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:25.647799+0000","last_peered":"2024-05-10T14:02:25.647799+0000","last_clean":"2024-05-10T14:02:25.647799+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:25.647799+0000","last_undegraded":"2024-05-10T14:02:25.647799+0000","last_fullsized":"2024-05-10T14:02:25.647799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.645974+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:25.645974+0000","last_peered":"2024-05-10T14:02:25.645974+0000","last_clean":"2024-05-10T14:02:25.645974+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:25.645974+0000","last_undegraded":"2024-05-10T14:02:25.645974+0000","last_fullsized":"2024-05-10T14:02:25.645974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647225+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:25.647225+0000","last_peered":"2024-05-10T14:02:25.647225+0000","last_clean":"2024-05-10T14:02:25.647225+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:25.647225+0000","last_undegraded":"2024-05-10T14:02:25.647225+0000","last_fullsized":"2024-05-10T14:02:25.647225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.645721+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:25.645721+0000","last_peered":"2024-05-10T14:02:25.645721+0000","last_clean":"2024-05-10T14:02:25.645721+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:25.645721+0000","last_undegraded":"2024-05-10T14:02:25.645721+0000","last_fullsized":"2024-05-10T14:02:25.645721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647623+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:25.647623+0000","last_peered":"2024-05-10T14:02:25.647623+0000","last_clean":"2024-05-10T14:02:25.647623+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:25.647623+0000","last_undegraded":"2024-05-10T14:02:25.647623+0000","last_fullsized":"2024-05-10T14:02:25.647623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.581462+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:25.581462+0000","last_peered":"2024-05-10T14:02:25.581462+0000","last_clean":"2024-05-10T14:02:25.581462+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:25.581462+0000","last_undegraded":"2024-05-10T14:02:25.581462+0000","last_fullsized":"2024-05-10T14:02:25.581462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647658+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:25.647658+0000","last_peered":"2024-05-10T14:02:25.647658+0000","last_clean":"2024-05-10T14:02:25.647658+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:25.647658+0000","last_undegraded":"2024-05-10T14:02:25.647658+0000","last_fullsized":"2024-05-10T14:02:25.647658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647684+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:25.647684+0000","last_peered":"2024-05-10T14:02:25.647684+0000","last_clean":"2024-05-10T14:02:25.647684+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:25.647684+0000","last_undegraded":"2024-05-10T14:02:25.647684+0000","last_fullsized":"2024-05-10T14:02:25.647684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647038+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:25.647038+0000","last_peered":"2024-05-10T14:02:25.647038+0000","last_clean":"2024-05-10T14:02:25.647038+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:25.647038+0000","last_undegraded":"2024-05-10T14:02:25.647038+0000","last_fullsized":"2024-05-10T14:02:25.647038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":663733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:28.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:28.722 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:28.739 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-10T14:02:28.094993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235708,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739012,"statfs":{"total":773094113280,"available":772852748288,"internally_reserved":0,"allocated":2945024,"data_stored":1761908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534161"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647799+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:25.647799+0000","last_peered":"2024-05-10T14:02:25.647799+0000","last_clean":"2024-05-10T14:02:25.647799+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:25.647799+0000","last_undegraded":"2024-05-10T14:02:25.647799+0000","last_fullsized":"2024-05-10T14:02:25.647799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.645974+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:25.645974+0000","last_peered":"2024-05-10T14:02:25.645974+0000","last_clean":"2024-05-10T14:02:25.645974+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:25.645974+0000","last_undegraded":"2024-05-10T14:02:25.645974+0000","last_fullsized":"2024-05-10T14:02:25.645974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647225+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:25.647225+0000","last_peered":"2024-05-10T14:02:25.647225+0000","last_clean":"2024-05-10T14:02:25.647225+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:25.647225+0000","last_undegraded":"2024-05-10T14:02:25.647225+0000","last_fullsized":"2024-05-10T14:02:25.647225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.645721+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:25.645721+0000","last_peered":"2024-05-10T14:02:25.645721+0000","last_clean":"2024-05-10T14:02:25.645721+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:25.645721+0000","last_undegraded":"2024-05-10T14:02:25.645721+0000","last_fullsized":"2024-05-10T14:02:25.645721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647623+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:25.647623+0000","last_peered":"2024-05-10T14:02:25.647623+0000","last_clean":"2024-05-10T14:02:25.647623+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:25.647623+0000","last_undegraded":"2024-05-10T14:02:25.647623+0000","last_fullsized":"2024-05-10T14:02:25.647623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.581462+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:25.581462+0000","last_peered":"2024-05-10T14:02:25.581462+0000","last_clean":"2024-05-10T14:02:25.581462+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:25.581462+0000","last_undegraded":"2024-05-10T14:02:25.581462+0000","last_fullsized":"2024-05-10T14:02:25.581462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647658+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:25.647658+0000","last_peered":"2024-05-10T14:02:25.647658+0000","last_clean":"2024-05-10T14:02:25.647658+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:25.647658+0000","last_undegraded":"2024-05-10T14:02:25.647658+0000","last_fullsized":"2024-05-10T14:02:25.647658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647684+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:25.647684+0000","last_peered":"2024-05-10T14:02:25.647684+0000","last_clean":"2024-05-10T14:02:25.647684+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:25.647684+0000","last_undegraded":"2024-05-10T14:02:25.647684+0000","last_fullsized":"2024-05-10T14:02:25.647684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T14:02:25.647038+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:25.647038+0000","last_peered":"2024-05-10T14:02:25.647038+0000","last_clean":"2024-05-10T14:02:25.647038+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:25.647038+0000","last_undegraded":"2024-05-10T14:02:25.647038+0000","last_fullsized":"2024-05-10T14:02:25.647038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":73365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":663733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:28.740 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T14:02:28.740 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T14:02:28.740 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T14:02:28.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T14:02:29.058 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:29.059 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T14:02:29.078 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T14:02:29.079 INFO:teuthology.run_tasks:Running task rgw... 2024-05-10T14:02:29.094 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-10T14:02:29.094 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-10T14:02:29.094 INFO:tasks.rgw:Creating data pools 2024-05-10T14:02:29.094 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-10T14:02:29.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-10T14:02:29.608 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.data' created 2024-05-10T14:02:29.638 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-10T14:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-10T14:02:30.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-10T14:02:31.655 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.index' created 2024-05-10T14:02:31.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-10T14:02:32.662 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-10T14:02:32.709 DEBUG:tasks.rgw:Pools created 2024-05-10T14:02:32.709 INFO:tasks.rgw:Starting rgw... 2024-05-10T14:02:32.709 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-10T14:02:32.709 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-10T14:02:32.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo echo -n http://smithi016.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-10T14:02:32.721 INFO:teuthology.orchestra.run.smithi016.stdout:http://smithi016.front.sepia.ceph.com:80 2024-05-10T14:02:32.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-10T14:02:32.774 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-10T14:02:32.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-10T14:02:32.820 INFO:tasks.rgw.client.0:Started 2024-05-10T14:02:32.820 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:32.820 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:32.846 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T14:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T14:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-05-10T14:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T14:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T14:02:33.848 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:33.860 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T14:02:33.861 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-05-10T14:02:33.861 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T14:02:33.861 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T14:02:33.861 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T14:02:35.863 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:35.876 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T14:02:35.876 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T14:02:35.877 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-05-10T14:02:35.877 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T14:02:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T14:02:39.877 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:39.890 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T14:02:39.890 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-05-10T14:02:39.890 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T14:02:39.890 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T14:02:39.891 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T14:02:41.867 INFO:tasks.rgw.client.0.smithi016.stdout:2024-05-10T14:02:41.868+0000 7f8296403a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-10T14:02:47.892 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-05-10T14:02:47.904 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T14:02:47.904 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-05-10T14:02:47.907 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 54903 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-10T14:02:47.908 INFO:teuthology.orchestra.run.smithi016.stdout:anonymous 2024-05-10T14:02:47.909 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-10T14:02:47.960 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-10T14:02:47.960 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-dang-obj-state'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dang-obj-state', 'sha1': '7ef97a7233c4db41f8dc134b8d64f95427147ce5'}} 2024-05-10T14:02:47.960 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-10T14:02:47.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-10T14:02:48.302 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-10T14:02:48.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T14:02:48.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:48.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:48.636 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-05-10T14:02:48.103218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249708,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725012,"statfs":{"total":773094113280,"available":772838412288,"internally_reserved":0,"allocated":4562944,"data_stored":2535870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723629+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:02:41.723629+0000","last_peered":"2024-05-10T14:02:41.723629+0000","last_clean":"2024-05-10T14:02:41.723629+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:02:41.723629+0000","last_undegraded":"2024-05-10T14:02:41.723629+0000","last_fullsized":"2024-05-10T14:02:41.723629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697033+0000","last_change":"2024-05-10T14:02:32.701008+0000","last_active":"2024-05-10T14:02:41.697033+0000","last_peered":"2024-05-10T14:02:41.697033+0000","last_clean":"2024-05-10T14:02:41.697033+0000","last_became_active":"2024-05-10T14:02:32.700023+0000","last_became_peered":"2024-05-10T14:02:32.700023+0000","last_unstale":"2024-05-10T14:02:41.697033+0000","last_undegraded":"2024-05-10T14:02:41.697033+0000","last_fullsized":"2024-05-10T14:02:41.697033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713690+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:02:41.713690+0000","last_peered":"2024-05-10T14:02:41.713690+0000","last_clean":"2024-05-10T14:02:41.713690+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:02:41.713690+0000","last_undegraded":"2024-05-10T14:02:41.713690+0000","last_fullsized":"2024-05-10T14:02:41.713690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722034+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:02:41.722034+0000","last_peered":"2024-05-10T14:02:41.722034+0000","last_clean":"2024-05-10T14:02:41.722034+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:02:41.722034+0000","last_undegraded":"2024-05-10T14:02:41.722034+0000","last_fullsized":"2024-05-10T14:02:41.722034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701872+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:02:41.701872+0000","last_peered":"2024-05-10T14:02:41.701872+0000","last_clean":"2024-05-10T14:02:41.701872+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:02:41.701872+0000","last_undegraded":"2024-05-10T14:02:41.701872+0000","last_fullsized":"2024-05-10T14:02:41.701872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736082+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:02:41.736082+0000","last_peered":"2024-05-10T14:02:41.736082+0000","last_clean":"2024-05-10T14:02:41.736082+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:02:41.736082+0000","last_undegraded":"2024-05-10T14:02:41.736082+0000","last_fullsized":"2024-05-10T14:02:41.736082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699579+0000","last_change":"2024-05-10T14:02:30.662364+0000","last_active":"2024-05-10T14:02:41.699579+0000","last_peered":"2024-05-10T14:02:41.699579+0000","last_clean":"2024-05-10T14:02:41.699579+0000","last_became_active":"2024-05-10T14:02:30.661072+0000","last_became_peered":"2024-05-10T14:02:30.661072+0000","last_unstale":"2024-05-10T14:02:41.699579+0000","last_undegraded":"2024-05-10T14:02:41.699579+0000","last_fullsized":"2024-05-10T14:02:41.699579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698775+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:02:41.698775+0000","last_peered":"2024-05-10T14:02:41.698775+0000","last_clean":"2024-05-10T14:02:41.698775+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:02:41.698775+0000","last_undegraded":"2024-05-10T14:02:41.698775+0000","last_fullsized":"2024-05-10T14:02:41.698775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723160+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:02:41.723160+0000","last_peered":"2024-05-10T14:02:41.723160+0000","last_clean":"2024-05-10T14:02:41.723160+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:02:41.723160+0000","last_undegraded":"2024-05-10T14:02:41.723160+0000","last_fullsized":"2024-05-10T14:02:41.723160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729345+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:02:41.729345+0000","last_peered":"2024-05-10T14:02:41.729345+0000","last_clean":"2024-05-10T14:02:41.729345+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:02:41.729345+0000","last_undegraded":"2024-05-10T14:02:41.729345+0000","last_fullsized":"2024-05-10T14:02:41.729345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697969+0000","last_change":"2024-05-10T14:02:30.664655+0000","last_active":"2024-05-10T14:02:41.697969+0000","last_peered":"2024-05-10T14:02:41.697969+0000","last_clean":"2024-05-10T14:02:41.697969+0000","last_became_active":"2024-05-10T14:02:30.662964+0000","last_became_peered":"2024-05-10T14:02:30.662964+0000","last_unstale":"2024-05-10T14:02:41.697969+0000","last_undegraded":"2024-05-10T14:02:41.697969+0000","last_fullsized":"2024-05-10T14:02:41.697969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736844+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:02:41.736844+0000","last_peered":"2024-05-10T14:02:41.736844+0000","last_clean":"2024-05-10T14:02:41.736844+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:02:41.736844+0000","last_undegraded":"2024-05-10T14:02:41.736844+0000","last_fullsized":"2024-05-10T14:02:41.736844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722569+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:02:41.722569+0000","last_peered":"2024-05-10T14:02:41.722569+0000","last_clean":"2024-05-10T14:02:41.722569+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:02:41.722569+0000","last_undegraded":"2024-05-10T14:02:41.722569+0000","last_fullsized":"2024-05-10T14:02:41.722569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698390+0000","last_change":"2024-05-10T14:02:32.685860+0000","last_active":"2024-05-10T14:02:41.698390+0000","last_peered":"2024-05-10T14:02:41.698390+0000","last_clean":"2024-05-10T14:02:41.698390+0000","last_became_active":"2024-05-10T14:02:32.684996+0000","last_became_peered":"2024-05-10T14:02:32.684996+0000","last_unstale":"2024-05-10T14:02:41.698390+0000","last_undegraded":"2024-05-10T14:02:41.698390+0000","last_fullsized":"2024-05-10T14:02:41.698390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698955+0000","last_change":"2024-05-10T14:02:30.659078+0000","last_active":"2024-05-10T14:02:41.698955+0000","last_peered":"2024-05-10T14:02:41.698955+0000","last_clean":"2024-05-10T14:02:41.698955+0000","last_became_active":"2024-05-10T14:02:30.658769+0000","last_became_peered":"2024-05-10T14:02:30.658769+0000","last_unstale":"2024-05-10T14:02:41.698955+0000","last_undegraded":"2024-05-10T14:02:41.698955+0000","last_fullsized":"2024-05-10T14:02:41.698955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750911+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:02:41.750911+0000","last_peered":"2024-05-10T14:02:41.750911+0000","last_clean":"2024-05-10T14:02:41.750911+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:02:41.750911+0000","last_undegraded":"2024-05-10T14:02:41.750911+0000","last_fullsized":"2024-05-10T14:02:41.750911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735435+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:02:41.735435+0000","last_peered":"2024-05-10T14:02:41.735435+0000","last_clean":"2024-05-10T14:02:41.735435+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:02:41.735435+0000","last_undegraded":"2024-05-10T14:02:41.735435+0000","last_fullsized":"2024-05-10T14:02:41.735435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723791+0000","last_change":"2024-05-10T14:02:30.670919+0000","last_active":"2024-05-10T14:02:41.723791+0000","last_peered":"2024-05-10T14:02:41.723791+0000","last_clean":"2024-05-10T14:02:41.723791+0000","last_became_active":"2024-05-10T14:02:30.670238+0000","last_became_peered":"2024-05-10T14:02:30.670238+0000","last_unstale":"2024-05-10T14:02:41.723791+0000","last_undegraded":"2024-05-10T14:02:41.723791+0000","last_fullsized":"2024-05-10T14:02:41.723791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722313+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:02:41.722313+0000","last_peered":"2024-05-10T14:02:41.722313+0000","last_clean":"2024-05-10T14:02:41.722313+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:02:41.722313+0000","last_undegraded":"2024-05-10T14:02:41.722313+0000","last_fullsized":"2024-05-10T14:02:41.722313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730693+0000","last_change":"2024-05-10T14:02:30.660232+0000","last_active":"2024-05-10T14:02:41.730693+0000","last_peered":"2024-05-10T14:02:41.730693+0000","last_clean":"2024-05-10T14:02:41.730693+0000","last_became_active":"2024-05-10T14:02:30.659541+0000","last_became_peered":"2024-05-10T14:02:30.659541+0000","last_unstale":"2024-05-10T14:02:41.730693+0000","last_undegraded":"2024-05-10T14:02:41.730693+0000","last_fullsized":"2024-05-10T14:02:41.730693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698213+0000","last_change":"2024-05-10T14:02:32.687835+0000","last_active":"2024-05-10T14:02:41.698213+0000","last_peered":"2024-05-10T14:02:41.698213+0000","last_clean":"2024-05-10T14:02:41.698213+0000","last_became_active":"2024-05-10T14:02:32.687123+0000","last_became_peered":"2024-05-10T14:02:32.687123+0000","last_unstale":"2024-05-10T14:02:41.698213+0000","last_undegraded":"2024-05-10T14:02:41.698213+0000","last_fullsized":"2024-05-10T14:02:41.698213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730216+0000","last_change":"2024-05-10T14:02:30.669888+0000","last_active":"2024-05-10T14:02:41.730216+0000","last_peered":"2024-05-10T14:02:41.730216+0000","last_clean":"2024-05-10T14:02:41.730216+0000","last_became_active":"2024-05-10T14:02:30.668900+0000","last_became_peered":"2024-05-10T14:02:30.668900+0000","last_unstale":"2024-05-10T14:02:41.730216+0000","last_undegraded":"2024-05-10T14:02:41.730216+0000","last_fullsized":"2024-05-10T14:02:41.730216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749877+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:02:41.749877+0000","last_peered":"2024-05-10T14:02:41.749877+0000","last_clean":"2024-05-10T14:02:41.749877+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:02:41.749877+0000","last_undegraded":"2024-05-10T14:02:41.749877+0000","last_fullsized":"2024-05-10T14:02:41.749877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736314+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:02:41.736314+0000","last_peered":"2024-05-10T14:02:41.736314+0000","last_clean":"2024-05-10T14:02:41.736314+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:02:41.736314+0000","last_undegraded":"2024-05-10T14:02:41.736314+0000","last_fullsized":"2024-05-10T14:02:41.736314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750188+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:02:41.750188+0000","last_peered":"2024-05-10T14:02:41.750188+0000","last_clean":"2024-05-10T14:02:41.750188+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:02:41.750188+0000","last_undegraded":"2024-05-10T14:02:41.750188+0000","last_fullsized":"2024-05-10T14:02:41.750188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703106+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:02:41.703106+0000","last_peered":"2024-05-10T14:02:41.703106+0000","last_clean":"2024-05-10T14:02:41.703106+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:02:41.703106+0000","last_undegraded":"2024-05-10T14:02:41.703106+0000","last_fullsized":"2024-05-10T14:02:41.703106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736939+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:02:41.736939+0000","last_peered":"2024-05-10T14:02:41.736939+0000","last_clean":"2024-05-10T14:02:41.736939+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:02:41.736939+0000","last_undegraded":"2024-05-10T14:02:41.736939+0000","last_fullsized":"2024-05-10T14:02:41.736939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:02:41.699945+0000","last_peered":"2024-05-10T14:02:41.699945+0000","last_clean":"2024-05-10T14:02:41.699945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:02:41.699945+0000","last_undegraded":"2024-05-10T14:02:41.699945+0000","last_fullsized":"2024-05-10T14:02:41.699945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735175+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:02:41.735175+0000","last_peered":"2024-05-10T14:02:41.735175+0000","last_clean":"2024-05-10T14:02:41.735175+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:02:41.735175+0000","last_undegraded":"2024-05-10T14:02:41.735175+0000","last_fullsized":"2024-05-10T14:02:41.735175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699404+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:02:41.699404+0000","last_peered":"2024-05-10T14:02:41.699404+0000","last_clean":"2024-05-10T14:02:41.699404+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:02:41.699404+0000","last_undegraded":"2024-05-10T14:02:41.699404+0000","last_fullsized":"2024-05-10T14:02:41.699404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723373+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:02:41.723373+0000","last_peered":"2024-05-10T14:02:41.723373+0000","last_clean":"2024-05-10T14:02:41.723373+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:02:41.723373+0000","last_undegraded":"2024-05-10T14:02:41.723373+0000","last_fullsized":"2024-05-10T14:02:41.723373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698565+0000","last_change":"2024-05-10T14:02:34.703721+0000","last_active":"2024-05-10T14:02:41.698565+0000","last_peered":"2024-05-10T14:02:41.698565+0000","last_clean":"2024-05-10T14:02:41.698565+0000","last_became_active":"2024-05-10T14:02:34.702006+0000","last_became_peered":"2024-05-10T14:02:34.702006+0000","last_unstale":"2024-05-10T14:02:41.698565+0000","last_undegraded":"2024-05-10T14:02:41.698565+0000","last_fullsized":"2024-05-10T14:02:41.698565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.095025+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:02:42.095025+0000","last_peered":"2024-05-10T14:02:42.095025+0000","last_clean":"2024-05-10T14:02:42.095025+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:02:42.095025+0000","last_undegraded":"2024-05-10T14:02:42.095025+0000","last_fullsized":"2024-05-10T14:02:42.095025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723486+0000","last_change":"2024-05-10T14:02:38.724178+0000","last_active":"2024-05-10T14:02:41.723486+0000","last_peered":"2024-05-10T14:02:41.723486+0000","last_clean":"2024-05-10T14:02:41.723486+0000","last_became_active":"2024-05-10T14:02:38.721491+0000","last_became_peered":"2024-05-10T14:02:38.721491+0000","last_unstale":"2024-05-10T14:02:41.723486+0000","last_undegraded":"2024-05-10T14:02:41.723486+0000","last_fullsized":"2024-05-10T14:02:41.723486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697119+0000","last_change":"2024-05-10T14:02:40.733937+0000","last_active":"2024-05-10T14:02:41.697119+0000","last_peered":"2024-05-10T14:02:41.697119+0000","last_clean":"2024-05-10T14:02:41.697119+0000","last_became_active":"2024-05-10T14:02:40.733205+0000","last_became_peered":"2024-05-10T14:02:40.733205+0000","last_unstale":"2024-05-10T14:02:41.697119+0000","last_undegraded":"2024-05-10T14:02:41.697119+0000","last_fullsized":"2024-05-10T14:02:41.697119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:40.961641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699407+0000","last_change":"2024-05-10T14:02:32.683159+0000","last_active":"2024-05-10T14:02:41.699407+0000","last_peered":"2024-05-10T14:02:41.699407+0000","last_clean":"2024-05-10T14:02:41.699407+0000","last_became_active":"2024-05-10T14:02:32.682442+0000","last_became_peered":"2024-05-10T14:02:32.682442+0000","last_unstale":"2024-05-10T14:02:41.699407+0000","last_undegraded":"2024-05-10T14:02:41.699407+0000","last_fullsized":"2024-05-10T14:02:41.699407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700185+0000","last_change":"2024-05-10T14:02:30.649814+0000","last_active":"2024-05-10T14:02:41.700185+0000","last_peered":"2024-05-10T14:02:41.700185+0000","last_clean":"2024-05-10T14:02:41.700185+0000","last_became_active":"2024-05-10T14:02:30.649470+0000","last_became_peered":"2024-05-10T14:02:30.649470+0000","last_unstale":"2024-05-10T14:02:41.700185+0000","last_undegraded":"2024-05-10T14:02:41.700185+0000","last_fullsized":"2024-05-10T14:02:41.700185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699003+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:02:41.699003+0000","last_peered":"2024-05-10T14:02:41.699003+0000","last_clean":"2024-05-10T14:02:41.699003+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:02:41.699003+0000","last_undegraded":"2024-05-10T14:02:41.699003+0000","last_fullsized":"2024-05-10T14:02:41.699003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.497207+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:02:42.497207+0000","last_peered":"2024-05-10T14:02:42.497207+0000","last_clean":"2024-05-10T14:02:42.497207+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:02:42.497207+0000","last_undegraded":"2024-05-10T14:02:42.497207+0000","last_fullsized":"2024-05-10T14:02:42.497207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737361+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:02:41.737361+0000","last_peered":"2024-05-10T14:02:41.737361+0000","last_clean":"2024-05-10T14:02:41.737361+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:02:41.737361+0000","last_undegraded":"2024-05-10T14:02:41.737361+0000","last_fullsized":"2024-05-10T14:02:41.737361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699324+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:02:41.699324+0000","last_peered":"2024-05-10T14:02:41.699324+0000","last_clean":"2024-05-10T14:02:41.699324+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:02:41.699324+0000","last_undegraded":"2024-05-10T14:02:41.699324+0000","last_fullsized":"2024-05-10T14:02:41.699324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703504+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:02:41.703504+0000","last_peered":"2024-05-10T14:02:41.703504+0000","last_clean":"2024-05-10T14:02:41.703504+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:02:41.703504+0000","last_undegraded":"2024-05-10T14:02:41.703504+0000","last_fullsized":"2024-05-10T14:02:41.703504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722858+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:02:41.722858+0000","last_peered":"2024-05-10T14:02:41.722858+0000","last_clean":"2024-05-10T14:02:41.722858+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:02:41.722858+0000","last_undegraded":"2024-05-10T14:02:41.722858+0000","last_fullsized":"2024-05-10T14:02:41.722858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703051+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:02:41.703051+0000","last_peered":"2024-05-10T14:02:41.703051+0000","last_clean":"2024-05-10T14:02:41.703051+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:02:41.703051+0000","last_undegraded":"2024-05-10T14:02:41.703051+0000","last_fullsized":"2024-05-10T14:02:41.703051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.552575+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:02:42.552575+0000","last_peered":"2024-05-10T14:02:42.552575+0000","last_clean":"2024-05-10T14:02:42.552575+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:02:42.552575+0000","last_undegraded":"2024-05-10T14:02:42.552575+0000","last_fullsized":"2024-05-10T14:02:42.552575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.120221+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:02:42.120221+0000","last_peered":"2024-05-10T14:02:42.120221+0000","last_clean":"2024-05-10T14:02:42.120221+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:02:42.120221+0000","last_undegraded":"2024-05-10T14:02:42.120221+0000","last_fullsized":"2024-05-10T14:02:42.120221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736065+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:02:41.736065+0000","last_peered":"2024-05-10T14:02:41.736065+0000","last_clean":"2024-05-10T14:02:41.736065+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:02:41.736065+0000","last_undegraded":"2024-05-10T14:02:41.736065+0000","last_fullsized":"2024-05-10T14:02:41.736065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699724+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:02:41.699724+0000","last_peered":"2024-05-10T14:02:41.699724+0000","last_clean":"2024-05-10T14:02:41.699724+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:02:41.699724+0000","last_undegraded":"2024-05-10T14:02:41.699724+0000","last_fullsized":"2024-05-10T14:02:41.699724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728414+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:02:41.728414+0000","last_peered":"2024-05-10T14:02:41.728414+0000","last_clean":"2024-05-10T14:02:41.728414+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:02:41.728414+0000","last_undegraded":"2024-05-10T14:02:41.728414+0000","last_fullsized":"2024-05-10T14:02:41.728414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698279+0000","last_change":"2024-05-10T14:02:34.703716+0000","last_active":"2024-05-10T14:02:41.698279+0000","last_peered":"2024-05-10T14:02:41.698279+0000","last_clean":"2024-05-10T14:02:41.698279+0000","last_became_active":"2024-05-10T14:02:34.702179+0000","last_became_peered":"2024-05-10T14:02:34.702179+0000","last_unstale":"2024-05-10T14:02:41.698279+0000","last_undegraded":"2024-05-10T14:02:41.698279+0000","last_fullsized":"2024-05-10T14:02:41.698279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.560623+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:02:42.560623+0000","last_peered":"2024-05-10T14:02:42.560623+0000","last_clean":"2024-05-10T14:02:42.560623+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:02:42.560623+0000","last_undegraded":"2024-05-10T14:02:42.560623+0000","last_fullsized":"2024-05-10T14:02:42.560623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.121638+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:02:42.121638+0000","last_peered":"2024-05-10T14:02:42.121638+0000","last_clean":"2024-05-10T14:02:42.121638+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:02:42.121638+0000","last_undegraded":"2024-05-10T14:02:42.121638+0000","last_fullsized":"2024-05-10T14:02:42.121638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697507+0000","last_change":"2024-05-10T14:02:32.683119+0000","last_active":"2024-05-10T14:02:41.697507+0000","last_peered":"2024-05-10T14:02:41.697507+0000","last_clean":"2024-05-10T14:02:41.697507+0000","last_became_active":"2024-05-10T14:02:32.682312+0000","last_became_peered":"2024-05-10T14:02:32.682312+0000","last_unstale":"2024-05-10T14:02:41.697507+0000","last_undegraded":"2024-05-10T14:02:41.697507+0000","last_fullsized":"2024-05-10T14:02:41.697507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723846+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:02:41.723846+0000","last_peered":"2024-05-10T14:02:41.723846+0000","last_clean":"2024-05-10T14:02:41.723846+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:02:41.723846+0000","last_undegraded":"2024-05-10T14:02:41.723846+0000","last_fullsized":"2024-05-10T14:02:41.723846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721723+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:02:41.721723+0000","last_peered":"2024-05-10T14:02:41.721723+0000","last_clean":"2024-05-10T14:02:41.721723+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:02:41.721723+0000","last_undegraded":"2024-05-10T14:02:41.721723+0000","last_fullsized":"2024-05-10T14:02:41.721723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.658251+0000","last_change":"2024-05-10T14:02:36.760567+0000","last_active":"2024-05-10T14:02:42.658251+0000","last_peered":"2024-05-10T14:02:42.658251+0000","last_clean":"2024-05-10T14:02:42.658251+0000","last_became_active":"2024-05-10T14:02:36.759783+0000","last_became_peered":"2024-05-10T14:02:36.759783+0000","last_unstale":"2024-05-10T14:02:42.658251+0000","last_undegraded":"2024-05-10T14:02:42.658251+0000","last_fullsized":"2024-05-10T14:02:42.658251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710454+0000","last_change":"2024-05-10T14:02:38.721490+0000","last_active":"2024-05-10T14:02:41.710454+0000","last_peered":"2024-05-10T14:02:41.710454+0000","last_clean":"2024-05-10T14:02:41.710454+0000","last_became_active":"2024-05-10T14:02:38.720706+0000","last_became_peered":"2024-05-10T14:02:38.720706+0000","last_unstale":"2024-05-10T14:02:41.710454+0000","last_undegraded":"2024-05-10T14:02:41.710454+0000","last_fullsized":"2024-05-10T14:02:41.710454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.457471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699263+0000","last_change":"2024-05-10T14:02:40.737217+0000","last_active":"2024-05-10T14:02:41.699263+0000","last_peered":"2024-05-10T14:02:41.699263+0000","last_clean":"2024-05-10T14:02:41.699263+0000","last_became_active":"2024-05-10T14:02:40.734397+0000","last_became_peered":"2024-05-10T14:02:40.734397+0000","last_unstale":"2024-05-10T14:02:41.699263+0000","last_undegraded":"2024-05-10T14:02:41.699263+0000","last_fullsized":"2024-05-10T14:02:41.699263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735805+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:02:41.735805+0000","last_peered":"2024-05-10T14:02:41.735805+0000","last_clean":"2024-05-10T14:02:41.735805+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:02:41.735805+0000","last_undegraded":"2024-05-10T14:02:41.735805+0000","last_fullsized":"2024-05-10T14:02:41.735805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723536+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:02:41.723536+0000","last_peered":"2024-05-10T14:02:41.723536+0000","last_clean":"2024-05-10T14:02:41.723536+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:02:41.723536+0000","last_undegraded":"2024-05-10T14:02:41.723536+0000","last_fullsized":"2024-05-10T14:02:41.723536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749152+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:02:41.749152+0000","last_peered":"2024-05-10T14:02:41.749152+0000","last_clean":"2024-05-10T14:02:41.749152+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:02:41.749152+0000","last_undegraded":"2024-05-10T14:02:41.749152+0000","last_fullsized":"2024-05-10T14:02:41.749152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.531159+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:02:42.531159+0000","last_peered":"2024-05-10T14:02:42.531159+0000","last_clean":"2024-05-10T14:02:42.531159+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:02:42.531159+0000","last_undegraded":"2024-05-10T14:02:42.531159+0000","last_fullsized":"2024-05-10T14:02:42.531159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701494+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:02:41.701494+0000","last_peered":"2024-05-10T14:02:41.701494+0000","last_clean":"2024-05-10T14:02:41.701494+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:02:41.701494+0000","last_undegraded":"2024-05-10T14:02:41.701494+0000","last_fullsized":"2024-05-10T14:02:41.701494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729058+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:02:41.729058+0000","last_peered":"2024-05-10T14:02:41.729058+0000","last_clean":"2024-05-10T14:02:41.729058+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:02:41.729058+0000","last_undegraded":"2024-05-10T14:02:41.729058+0000","last_fullsized":"2024-05-10T14:02:41.729058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729268+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:02:41.729268+0000","last_peered":"2024-05-10T14:02:41.729268+0000","last_clean":"2024-05-10T14:02:41.729268+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:02:41.729268+0000","last_undegraded":"2024-05-10T14:02:41.729268+0000","last_fullsized":"2024-05-10T14:02:41.729268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724485+0000","last_change":"2024-05-10T14:02:30.676357+0000","last_active":"2024-05-10T14:02:41.724485+0000","last_peered":"2024-05-10T14:02:41.724485+0000","last_clean":"2024-05-10T14:02:41.724485+0000","last_became_active":"2024-05-10T14:02:30.675551+0000","last_became_peered":"2024-05-10T14:02:30.675551+0000","last_unstale":"2024-05-10T14:02:41.724485+0000","last_undegraded":"2024-05-10T14:02:41.724485+0000","last_fullsized":"2024-05-10T14:02:41.724485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750351+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:02:41.750351+0000","last_peered":"2024-05-10T14:02:41.750351+0000","last_clean":"2024-05-10T14:02:41.750351+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:02:41.750351+0000","last_undegraded":"2024-05-10T14:02:41.750351+0000","last_fullsized":"2024-05-10T14:02:41.750351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.448177+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:02:42.448177+0000","last_peered":"2024-05-10T14:02:42.448177+0000","last_clean":"2024-05-10T14:02:42.448177+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:02:42.448177+0000","last_undegraded":"2024-05-10T14:02:42.448177+0000","last_fullsized":"2024-05-10T14:02:42.448177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.124101+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:02:42.124101+0000","last_peered":"2024-05-10T14:02:42.124101+0000","last_clean":"2024-05-10T14:02:42.124101+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:02:42.124101+0000","last_undegraded":"2024-05-10T14:02:42.124101+0000","last_fullsized":"2024-05-10T14:02:42.124101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702044+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:02:41.702044+0000","last_peered":"2024-05-10T14:02:41.702044+0000","last_clean":"2024-05-10T14:02:41.702044+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:02:41.702044+0000","last_undegraded":"2024-05-10T14:02:41.702044+0000","last_fullsized":"2024-05-10T14:02:41.702044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700475+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:02:41.700475+0000","last_peered":"2024-05-10T14:02:41.700475+0000","last_clean":"2024-05-10T14:02:41.700475+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:02:41.700475+0000","last_undegraded":"2024-05-10T14:02:41.700475+0000","last_fullsized":"2024-05-10T14:02:41.700475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699906+0000","last_change":"2024-05-10T14:02:30.668980+0000","last_active":"2024-05-10T14:02:41.699906+0000","last_peered":"2024-05-10T14:02:41.699906+0000","last_clean":"2024-05-10T14:02:41.699906+0000","last_became_active":"2024-05-10T14:02:30.666369+0000","last_became_peered":"2024-05-10T14:02:30.666369+0000","last_unstale":"2024-05-10T14:02:41.699906+0000","last_undegraded":"2024-05-10T14:02:41.699906+0000","last_fullsized":"2024-05-10T14:02:41.699906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749505+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:02:41.749505+0000","last_peered":"2024-05-10T14:02:41.749505+0000","last_clean":"2024-05-10T14:02:41.749505+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:02:41.749505+0000","last_undegraded":"2024-05-10T14:02:41.749505+0000","last_fullsized":"2024-05-10T14:02:41.749505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.057683+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:02:42.057683+0000","last_peered":"2024-05-10T14:02:42.057683+0000","last_clean":"2024-05-10T14:02:42.057683+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:02:42.057683+0000","last_undegraded":"2024-05-10T14:02:42.057683+0000","last_fullsized":"2024-05-10T14:02:42.057683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749155+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:02:41.749155+0000","last_peered":"2024-05-10T14:02:41.749155+0000","last_clean":"2024-05-10T14:02:41.749155+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:02:41.749155+0000","last_undegraded":"2024-05-10T14:02:41.749155+0000","last_fullsized":"2024-05-10T14:02:41.749155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713517+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:02:41.713517+0000","last_peered":"2024-05-10T14:02:41.713517+0000","last_clean":"2024-05-10T14:02:41.713517+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:02:41.713517+0000","last_undegraded":"2024-05-10T14:02:41.713517+0000","last_fullsized":"2024-05-10T14:02:41.713517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736946+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:02:41.736946+0000","last_peered":"2024-05-10T14:02:41.736946+0000","last_clean":"2024-05-10T14:02:41.736946+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:02:41.736946+0000","last_undegraded":"2024-05-10T14:02:41.736946+0000","last_fullsized":"2024-05-10T14:02:41.736946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702789+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:02:41.702789+0000","last_peered":"2024-05-10T14:02:41.702789+0000","last_clean":"2024-05-10T14:02:41.702789+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:02:41.702789+0000","last_undegraded":"2024-05-10T14:02:41.702789+0000","last_fullsized":"2024-05-10T14:02:41.702789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750107+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:02:41.750107+0000","last_peered":"2024-05-10T14:02:41.750107+0000","last_clean":"2024-05-10T14:02:41.750107+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:02:41.750107+0000","last_undegraded":"2024-05-10T14:02:41.750107+0000","last_fullsized":"2024-05-10T14:02:41.750107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.595124+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:02:42.595124+0000","last_peered":"2024-05-10T14:02:42.595124+0000","last_clean":"2024-05-10T14:02:42.595124+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:02:42.595124+0000","last_undegraded":"2024-05-10T14:02:42.595124+0000","last_fullsized":"2024-05-10T14:02:42.595124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701808+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:02:41.701808+0000","last_peered":"2024-05-10T14:02:41.701808+0000","last_clean":"2024-05-10T14:02:41.701808+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:02:41.701808+0000","last_undegraded":"2024-05-10T14:02:41.701808+0000","last_fullsized":"2024-05-10T14:02:41.701808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697479+0000","last_change":"2024-05-10T14:02:40.734940+0000","last_active":"2024-05-10T14:02:41.697479+0000","last_peered":"2024-05-10T14:02:41.697479+0000","last_clean":"2024-05-10T14:02:41.697479+0000","last_became_active":"2024-05-10T14:02:40.734017+0000","last_became_peered":"2024-05-10T14:02:40.734017+0000","last_unstale":"2024-05-10T14:02:41.697479+0000","last_undegraded":"2024-05-10T14:02:41.697479+0000","last_fullsized":"2024-05-10T14:02:41.697479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.803176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737690+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:02:41.737690+0000","last_peered":"2024-05-10T14:02:41.737690+0000","last_clean":"2024-05-10T14:02:41.737690+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:02:41.737690+0000","last_undegraded":"2024-05-10T14:02:41.737690+0000","last_fullsized":"2024-05-10T14:02:41.737690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729497+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:02:41.729497+0000","last_peered":"2024-05-10T14:02:41.729497+0000","last_clean":"2024-05-10T14:02:41.729497+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:02:41.729497+0000","last_undegraded":"2024-05-10T14:02:41.729497+0000","last_fullsized":"2024-05-10T14:02:41.729497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711332+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:02:41.711332+0000","last_peered":"2024-05-10T14:02:41.711332+0000","last_clean":"2024-05-10T14:02:41.711332+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:02:41.711332+0000","last_undegraded":"2024-05-10T14:02:41.711332+0000","last_fullsized":"2024-05-10T14:02:41.711332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.664676+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:02:42.664676+0000","last_peered":"2024-05-10T14:02:42.664676+0000","last_clean":"2024-05-10T14:02:42.664676+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:02:42.664676+0000","last_undegraded":"2024-05-10T14:02:42.664676+0000","last_fullsized":"2024-05-10T14:02:42.664676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.113608+0000","last_change":"2024-05-10T14:02:38.723250+0000","last_active":"2024-05-10T14:02:42.113608+0000","last_peered":"2024-05-10T14:02:42.113608+0000","last_clean":"2024-05-10T14:02:42.113608+0000","last_became_active":"2024-05-10T14:02:38.722515+0000","last_became_peered":"2024-05-10T14:02:38.722515+0000","last_unstale":"2024-05-10T14:02:42.113608+0000","last_undegraded":"2024-05-10T14:02:42.113608+0000","last_fullsized":"2024-05-10T14:02:42.113608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:43.700192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710733+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:02:41.710733+0000","last_peered":"2024-05-10T14:02:41.710733+0000","last_clean":"2024-05-10T14:02:41.710733+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:02:41.710733+0000","last_undegraded":"2024-05-10T14:02:41.710733+0000","last_fullsized":"2024-05-10T14:02:41.710733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739546+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:02:41.739546+0000","last_peered":"2024-05-10T14:02:41.739546+0000","last_clean":"2024-05-10T14:02:41.739546+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:02:41.739546+0000","last_undegraded":"2024-05-10T14:02:41.739546+0000","last_fullsized":"2024-05-10T14:02:41.739546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736410+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:02:41.736410+0000","last_peered":"2024-05-10T14:02:41.736410+0000","last_clean":"2024-05-10T14:02:41.736410+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:02:41.736410+0000","last_undegraded":"2024-05-10T14:02:41.736410+0000","last_fullsized":"2024-05-10T14:02:41.736410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698504+0000","last_change":"2024-05-10T14:02:34.704402+0000","last_active":"2024-05-10T14:02:41.698504+0000","last_peered":"2024-05-10T14:02:41.698504+0000","last_clean":"2024-05-10T14:02:41.698504+0000","last_became_active":"2024-05-10T14:02:34.703650+0000","last_became_peered":"2024-05-10T14:02:34.703650+0000","last_unstale":"2024-05-10T14:02:41.698504+0000","last_undegraded":"2024-05-10T14:02:41.698504+0000","last_fullsized":"2024-05-10T14:02:41.698504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.454896+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:02:42.454896+0000","last_peered":"2024-05-10T14:02:42.454896+0000","last_clean":"2024-05-10T14:02:42.454896+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:02:42.454896+0000","last_undegraded":"2024-05-10T14:02:42.454896+0000","last_fullsized":"2024-05-10T14:02:42.454896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.118606+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:02:42.118606+0000","last_peered":"2024-05-10T14:02:42.118606+0000","last_clean":"2024-05-10T14:02:42.118606+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:02:42.118606+0000","last_undegraded":"2024-05-10T14:02:42.118606+0000","last_fullsized":"2024-05-10T14:02:42.118606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736264+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:02:41.736264+0000","last_peered":"2024-05-10T14:02:41.736264+0000","last_clean":"2024-05-10T14:02:41.736264+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:02:41.736264+0000","last_undegraded":"2024-05-10T14:02:41.736264+0000","last_fullsized":"2024-05-10T14:02:41.736264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714000+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:02:41.714000+0000","last_peered":"2024-05-10T14:02:41.714000+0000","last_clean":"2024-05-10T14:02:41.714000+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:02:41.714000+0000","last_undegraded":"2024-05-10T14:02:41.714000+0000","last_fullsized":"2024-05-10T14:02:41.714000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699420+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:02:41.699420+0000","last_peered":"2024-05-10T14:02:41.699420+0000","last_clean":"2024-05-10T14:02:41.699420+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:02:41.699420+0000","last_undegraded":"2024-05-10T14:02:41.699420+0000","last_fullsized":"2024-05-10T14:02:41.699420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739226+0000","last_change":"2024-05-10T14:02:34.703505+0000","last_active":"2024-05-10T14:02:41.739226+0000","last_peered":"2024-05-10T14:02:41.739226+0000","last_clean":"2024-05-10T14:02:41.739226+0000","last_became_active":"2024-05-10T14:02:34.702702+0000","last_became_peered":"2024-05-10T14:02:34.702702+0000","last_unstale":"2024-05-10T14:02:41.739226+0000","last_undegraded":"2024-05-10T14:02:41.739226+0000","last_fullsized":"2024-05-10T14:02:41.739226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.587828+0000","last_change":"2024-05-10T14:02:36.699924+0000","last_active":"2024-05-10T14:02:42.587828+0000","last_peered":"2024-05-10T14:02:42.587828+0000","last_clean":"2024-05-10T14:02:42.587828+0000","last_became_active":"2024-05-10T14:02:36.699071+0000","last_became_peered":"2024-05-10T14:02:36.699071+0000","last_unstale":"2024-05-10T14:02:42.587828+0000","last_undegraded":"2024-05-10T14:02:42.587828+0000","last_fullsized":"2024-05-10T14:02:42.587828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728828+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:02:41.728828+0000","last_peered":"2024-05-10T14:02:41.728828+0000","last_clean":"2024-05-10T14:02:41.728828+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:02:41.728828+0000","last_undegraded":"2024-05-10T14:02:41.728828+0000","last_fullsized":"2024-05-10T14:02:41.728828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.712446+0000","last_change":"2024-05-10T14:02:40.734906+0000","last_active":"2024-05-10T14:02:41.712446+0000","last_peered":"2024-05-10T14:02:41.712446+0000","last_clean":"2024-05-10T14:02:41.712446+0000","last_became_active":"2024-05-10T14:02:40.734153+0000","last_became_peered":"2024-05-10T14:02:40.734153+0000","last_unstale":"2024-05-10T14:02:41.712446+0000","last_undegraded":"2024-05-10T14:02:41.712446+0000","last_fullsized":"2024-05-10T14:02:41.712446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:19.709648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729960+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:02:41.729960+0000","last_peered":"2024-05-10T14:02:41.729960+0000","last_clean":"2024-05-10T14:02:41.729960+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:02:41.729960+0000","last_undegraded":"2024-05-10T14:02:41.729960+0000","last_fullsized":"2024-05-10T14:02:41.729960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722367+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:41.722367+0000","last_peered":"2024-05-10T14:02:41.722367+0000","last_clean":"2024-05-10T14:02:41.722367+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:41.722367+0000","last_undegraded":"2024-05-10T14:02:41.722367+0000","last_fullsized":"2024-05-10T14:02:41.722367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698278+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:41.698278+0000","last_peered":"2024-05-10T14:02:41.698278+0000","last_clean":"2024-05-10T14:02:41.698278+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:41.698278+0000","last_undegraded":"2024-05-10T14:02:41.698278+0000","last_fullsized":"2024-05-10T14:02:41.698278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702298+0000","last_change":"2024-05-10T14:02:30.664055+0000","last_active":"2024-05-10T14:02:41.702298+0000","last_peered":"2024-05-10T14:02:41.702298+0000","last_clean":"2024-05-10T14:02:41.702298+0000","last_became_active":"2024-05-10T14:02:30.663754+0000","last_became_peered":"2024-05-10T14:02:30.663754+0000","last_unstale":"2024-05-10T14:02:41.702298+0000","last_undegraded":"2024-05-10T14:02:41.702298+0000","last_fullsized":"2024-05-10T14:02:41.702298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722873+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:02:41.722873+0000","last_peered":"2024-05-10T14:02:41.722873+0000","last_clean":"2024-05-10T14:02:41.722873+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:02:41.722873+0000","last_undegraded":"2024-05-10T14:02:41.722873+0000","last_fullsized":"2024-05-10T14:02:41.722873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.383888+0000","last_change":"2024-05-10T14:02:36.708452+0000","last_active":"2024-05-10T14:02:42.383888+0000","last_peered":"2024-05-10T14:02:42.383888+0000","last_clean":"2024-05-10T14:02:42.383888+0000","last_became_active":"2024-05-10T14:02:36.707872+0000","last_became_peered":"2024-05-10T14:02:36.707872+0000","last_unstale":"2024-05-10T14:02:42.383888+0000","last_undegraded":"2024-05-10T14:02:42.383888+0000","last_fullsized":"2024-05-10T14:02:42.383888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702306+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:02:41.702306+0000","last_peered":"2024-05-10T14:02:41.702306+0000","last_clean":"2024-05-10T14:02:41.702306+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:02:41.702306+0000","last_undegraded":"2024-05-10T14:02:41.702306+0000","last_fullsized":"2024-05-10T14:02:41.702306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728348+0000","last_change":"2024-05-10T14:02:40.742200+0000","last_active":"2024-05-10T14:02:41.728348+0000","last_peered":"2024-05-10T14:02:41.728348+0000","last_clean":"2024-05-10T14:02:41.728348+0000","last_became_active":"2024-05-10T14:02:40.741540+0000","last_became_peered":"2024-05-10T14:02:40.741540+0000","last_unstale":"2024-05-10T14:02:41.728348+0000","last_undegraded":"2024-05-10T14:02:41.728348+0000","last_fullsized":"2024-05-10T14:02:41.728348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:43.260808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703108+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:02:41.703108+0000","last_peered":"2024-05-10T14:02:41.703108+0000","last_clean":"2024-05-10T14:02:41.703108+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:02:41.703108+0000","last_undegraded":"2024-05-10T14:02:41.703108+0000","last_fullsized":"2024-05-10T14:02:41.703108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722060+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:41.722060+0000","last_peered":"2024-05-10T14:02:41.722060+0000","last_clean":"2024-05-10T14:02:41.722060+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:41.722060+0000","last_undegraded":"2024-05-10T14:02:41.722060+0000","last_fullsized":"2024-05-10T14:02:41.722060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702480+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:02:41.702480+0000","last_peered":"2024-05-10T14:02:41.702480+0000","last_clean":"2024-05-10T14:02:41.702480+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:02:41.702480+0000","last_undegraded":"2024-05-10T14:02:41.702480+0000","last_fullsized":"2024-05-10T14:02:41.702480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699119+0000","last_change":"2024-05-10T14:02:34.702777+0000","last_active":"2024-05-10T14:02:41.699119+0000","last_peered":"2024-05-10T14:02:41.699119+0000","last_clean":"2024-05-10T14:02:41.699119+0000","last_became_active":"2024-05-10T14:02:34.701897+0000","last_became_peered":"2024-05-10T14:02:34.701897+0000","last_unstale":"2024-05-10T14:02:41.699119+0000","last_undegraded":"2024-05-10T14:02:41.699119+0000","last_fullsized":"2024-05-10T14:02:41.699119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.576269+0000","last_change":"2024-05-10T14:02:36.699050+0000","last_active":"2024-05-10T14:02:42.576269+0000","last_peered":"2024-05-10T14:02:42.576269+0000","last_clean":"2024-05-10T14:02:42.576269+0000","last_became_active":"2024-05-10T14:02:36.698360+0000","last_became_peered":"2024-05-10T14:02:36.698360+0000","last_unstale":"2024-05-10T14:02:42.576269+0000","last_undegraded":"2024-05-10T14:02:42.576269+0000","last_fullsized":"2024-05-10T14:02:42.576269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:35:40.504956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722909+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:02:41.722909+0000","last_peered":"2024-05-10T14:02:41.722909+0000","last_clean":"2024-05-10T14:02:41.722909+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:02:41.722909+0000","last_undegraded":"2024-05-10T14:02:41.722909+0000","last_fullsized":"2024-05-10T14:02:41.722909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710600+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:02:41.710600+0000","last_peered":"2024-05-10T14:02:41.710600+0000","last_clean":"2024-05-10T14:02:41.710600+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:02:41.710600+0000","last_undegraded":"2024-05-10T14:02:41.710600+0000","last_fullsized":"2024-05-10T14:02:41.710600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714239+0000","last_change":"2024-05-10T14:02:32.685938+0000","last_active":"2024-05-10T14:02:41.714239+0000","last_peered":"2024-05-10T14:02:41.714239+0000","last_clean":"2024-05-10T14:02:41.714239+0000","last_became_active":"2024-05-10T14:02:32.685539+0000","last_became_peered":"2024-05-10T14:02:32.685539+0000","last_unstale":"2024-05-10T14:02:41.714239+0000","last_undegraded":"2024-05-10T14:02:41.714239+0000","last_fullsized":"2024-05-10T14:02:41.714239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:48.031945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749509+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:41.749509+0000","last_peered":"2024-05-10T14:02:41.749509+0000","last_clean":"2024-05-10T14:02:41.749509+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:41.749509+0000","last_undegraded":"2024-05-10T14:02:41.749509+0000","last_fullsized":"2024-05-10T14:02:41.749509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710285+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:02:41.710285+0000","last_peered":"2024-05-10T14:02:41.710285+0000","last_clean":"2024-05-10T14:02:41.710285+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:02:41.710285+0000","last_undegraded":"2024-05-10T14:02:41.710285+0000","last_fullsized":"2024-05-10T14:02:41.710285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750761+0000","last_change":"2024-05-10T14:02:34.702881+0000","last_active":"2024-05-10T14:02:41.750761+0000","last_peered":"2024-05-10T14:02:41.750761+0000","last_clean":"2024-05-10T14:02:41.750761+0000","last_became_active":"2024-05-10T14:02:34.702177+0000","last_became_peered":"2024-05-10T14:02:34.702177+0000","last_unstale":"2024-05-10T14:02:41.750761+0000","last_undegraded":"2024-05-10T14:02:41.750761+0000","last_fullsized":"2024-05-10T14:02:41.750761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:25.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.583401+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:42.583401+0000","last_peered":"2024-05-10T14:02:42.583401+0000","last_clean":"2024-05-10T14:02:42.583401+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:02:42.583401+0000","last_undegraded":"2024-05-10T14:02:42.583401+0000","last_fullsized":"2024-05-10T14:02:42.583401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700866+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:02:41.700866+0000","last_peered":"2024-05-10T14:02:41.700866+0000","last_clean":"2024-05-10T14:02:41.700866+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:02:41.700866+0000","last_undegraded":"2024-05-10T14:02:41.700866+0000","last_fullsized":"2024-05-10T14:02:41.700866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703635+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:02:41.703635+0000","last_peered":"2024-05-10T14:02:41.703635+0000","last_clean":"2024-05-10T14:02:41.703635+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:02:41.703635+0000","last_undegraded":"2024-05-10T14:02:41.703635+0000","last_fullsized":"2024-05-10T14:02:41.703635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711652+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:02:41.711652+0000","last_peered":"2024-05-10T14:02:41.711652+0000","last_clean":"2024-05-10T14:02:41.711652+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:02:41.711652+0000","last_undegraded":"2024-05-10T14:02:41.711652+0000","last_fullsized":"2024-05-10T14:02:41.711652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699043+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:41.699043+0000","last_peered":"2024-05-10T14:02:41.699043+0000","last_clean":"2024-05-10T14:02:41.699043+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:41.699043+0000","last_undegraded":"2024-05-10T14:02:41.699043+0000","last_fullsized":"2024-05-10T14:02:41.699043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736953+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:02:41.736953+0000","last_peered":"2024-05-10T14:02:41.736953+0000","last_clean":"2024-05-10T14:02:41.736953+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:02:41.736953+0000","last_undegraded":"2024-05-10T14:02:41.736953+0000","last_fullsized":"2024-05-10T14:02:41.736953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701443+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:02:41.701443+0000","last_peered":"2024-05-10T14:02:41.701443+0000","last_clean":"2024-05-10T14:02:41.701443+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:02:41.701443+0000","last_undegraded":"2024-05-10T14:02:41.701443+0000","last_fullsized":"2024-05-10T14:02:41.701443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.418290+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:02:42.418290+0000","last_peered":"2024-05-10T14:02:42.418290+0000","last_clean":"2024-05-10T14:02:42.418290+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:02:42.418290+0000","last_undegraded":"2024-05-10T14:02:42.418290+0000","last_fullsized":"2024-05-10T14:02:42.418290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729812+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:02:41.729812+0000","last_peered":"2024-05-10T14:02:41.729812+0000","last_clean":"2024-05-10T14:02:41.729812+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:02:41.729812+0000","last_undegraded":"2024-05-10T14:02:41.729812+0000","last_fullsized":"2024-05-10T14:02:41.729812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.696849+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:41.696849+0000","last_peered":"2024-05-10T14:02:41.696849+0000","last_clean":"2024-05-10T14:02:41.696849+0000","last_became_active":"2024-05-10T14:02:40.733023+0000","last_became_peered":"2024-05-10T14:02:40.733023+0000","last_unstale":"2024-05-10T14:02:41.696849+0000","last_undegraded":"2024-05-10T14:02:41.696849+0000","last_fullsized":"2024-05-10T14:02:41.696849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711637+0000","last_change":"2024-05-10T14:02:32.690026+0000","last_active":"2024-05-10T14:02:41.711637+0000","last_peered":"2024-05-10T14:02:41.711637+0000","last_clean":"2024-05-10T14:02:41.711637+0000","last_became_active":"2024-05-10T14:02:32.689610+0000","last_became_peered":"2024-05-10T14:02:32.689610+0000","last_unstale":"2024-05-10T14:02:41.711637+0000","last_undegraded":"2024-05-10T14:02:41.711637+0000","last_fullsized":"2024-05-10T14:02:41.711637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:02.876675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699731+0000","last_change":"2024-05-10T14:02:30.668078+0000","last_active":"2024-05-10T14:02:41.699731+0000","last_peered":"2024-05-10T14:02:41.699731+0000","last_clean":"2024-05-10T14:02:41.699731+0000","last_became_active":"2024-05-10T14:02:30.658626+0000","last_became_peered":"2024-05-10T14:02:30.658626+0000","last_unstale":"2024-05-10T14:02:41.699731+0000","last_undegraded":"2024-05-10T14:02:41.699731+0000","last_fullsized":"2024-05-10T14:02:41.699731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.712096+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:41.712096+0000","last_peered":"2024-05-10T14:02:41.712096+0000","last_clean":"2024-05-10T14:02:41.712096+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:41.712096+0000","last_undegraded":"2024-05-10T14:02:41.712096+0000","last_fullsized":"2024-05-10T14:02:41.712096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699306+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:02:41.699306+0000","last_peered":"2024-05-10T14:02:41.699306+0000","last_clean":"2024-05-10T14:02:41.699306+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:02:41.699306+0000","last_undegraded":"2024-05-10T14:02:41.699306+0000","last_fullsized":"2024-05-10T14:02:41.699306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.510402+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:02:42.510402+0000","last_peered":"2024-05-10T14:02:42.510402+0000","last_clean":"2024-05-10T14:02:42.510402+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:02:42.510402+0000","last_undegraded":"2024-05-10T14:02:42.510402+0000","last_fullsized":"2024-05-10T14:02:42.510402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735321+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:02:41.735321+0000","last_peered":"2024-05-10T14:02:41.735321+0000","last_clean":"2024-05-10T14:02:41.735321+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:02:41.735321+0000","last_undegraded":"2024-05-10T14:02:41.735321+0000","last_fullsized":"2024-05-10T14:02:41.735321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701269+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:02:41.701269+0000","last_peered":"2024-05-10T14:02:41.701269+0000","last_clean":"2024-05-10T14:02:41.701269+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:02:41.701269+0000","last_undegraded":"2024-05-10T14:02:41.701269+0000","last_fullsized":"2024-05-10T14:02:41.701269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700400+0000","last_change":"2024-05-10T14:02:32.684861+0000","last_active":"2024-05-10T14:02:41.700400+0000","last_peered":"2024-05-10T14:02:41.700400+0000","last_clean":"2024-05-10T14:02:41.700400+0000","last_became_active":"2024-05-10T14:02:32.683137+0000","last_became_peered":"2024-05-10T14:02:32.683137+0000","last_unstale":"2024-05-10T14:02:41.700400+0000","last_undegraded":"2024-05-10T14:02:41.700400+0000","last_fullsized":"2024-05-10T14:02:41.700400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711788+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:02:41.711788+0000","last_peered":"2024-05-10T14:02:41.711788+0000","last_clean":"2024-05-10T14:02:41.711788+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:02:41.711788+0000","last_undegraded":"2024-05-10T14:02:41.711788+0000","last_fullsized":"2024-05-10T14:02:41.711788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724733+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:41.724733+0000","last_peered":"2024-05-10T14:02:41.724733+0000","last_clean":"2024-05-10T14:02:41.724733+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:41.724733+0000","last_undegraded":"2024-05-10T14:02:41.724733+0000","last_fullsized":"2024-05-10T14:02:41.724733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728843+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:02:41.728843+0000","last_peered":"2024-05-10T14:02:41.728843+0000","last_clean":"2024-05-10T14:02:41.728843+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:02:41.728843+0000","last_undegraded":"2024-05-10T14:02:41.728843+0000","last_fullsized":"2024-05-10T14:02:41.728843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.609084+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:02:42.609084+0000","last_peered":"2024-05-10T14:02:42.609084+0000","last_clean":"2024-05-10T14:02:42.609084+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:02:42.609084+0000","last_undegraded":"2024-05-10T14:02:42.609084+0000","last_fullsized":"2024-05-10T14:02:42.609084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.119290+0000","last_change":"2024-05-10T14:02:38.720704+0000","last_active":"2024-05-10T14:02:42.119290+0000","last_peered":"2024-05-10T14:02:42.119290+0000","last_clean":"2024-05-10T14:02:42.119290+0000","last_became_active":"2024-05-10T14:02:38.719862+0000","last_became_peered":"2024-05-10T14:02:38.719862+0000","last_unstale":"2024-05-10T14:02:42.119290+0000","last_undegraded":"2024-05-10T14:02:42.119290+0000","last_fullsized":"2024-05-10T14:02:42.119290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702862+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:02:41.702862+0000","last_peered":"2024-05-10T14:02:41.702862+0000","last_clean":"2024-05-10T14:02:41.702862+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:02:41.702862+0000","last_undegraded":"2024-05-10T14:02:41.702862+0000","last_fullsized":"2024-05-10T14:02:41.702862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698432+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:02:41.698432+0000","last_peered":"2024-05-10T14:02:41.698432+0000","last_clean":"2024-05-10T14:02:41.698432+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:02:41.698432+0000","last_undegraded":"2024-05-10T14:02:41.698432+0000","last_fullsized":"2024-05-10T14:02:41.698432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699413+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:02:41.699413+0000","last_peered":"2024-05-10T14:02:41.699413+0000","last_clean":"2024-05-10T14:02:41.699413+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:02:41.699413+0000","last_undegraded":"2024-05-10T14:02:41.699413+0000","last_fullsized":"2024-05-10T14:02:41.699413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713757+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:41.713757+0000","last_peered":"2024-05-10T14:02:41.713757+0000","last_clean":"2024-05-10T14:02:41.713757+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:41.713757+0000","last_undegraded":"2024-05-10T14:02:41.713757+0000","last_fullsized":"2024-05-10T14:02:41.713757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735508+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:02:41.735508+0000","last_peered":"2024-05-10T14:02:41.735508+0000","last_clean":"2024-05-10T14:02:41.735508+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:02:41.735508+0000","last_undegraded":"2024-05-10T14:02:41.735508+0000","last_fullsized":"2024-05-10T14:02:41.735508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.567392+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:02:42.567392+0000","last_peered":"2024-05-10T14:02:42.567392+0000","last_clean":"2024-05-10T14:02:42.567392+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:02:42.567392+0000","last_undegraded":"2024-05-10T14:02:42.567392+0000","last_fullsized":"2024-05-10T14:02:42.567392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.121613+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:02:42.121613+0000","last_peered":"2024-05-10T14:02:42.121613+0000","last_clean":"2024-05-10T14:02:42.121613+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:02:42.121613+0000","last_undegraded":"2024-05-10T14:02:42.121613+0000","last_fullsized":"2024-05-10T14:02:42.121613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701042+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:02:41.701042+0000","last_peered":"2024-05-10T14:02:41.701042+0000","last_clean":"2024-05-10T14:02:41.701042+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:02:41.701042+0000","last_undegraded":"2024-05-10T14:02:41.701042+0000","last_fullsized":"2024-05-10T14:02:41.701042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735872+0000","last_change":"2024-05-10T14:02:32.671389+0000","last_active":"2024-05-10T14:02:41.735872+0000","last_peered":"2024-05-10T14:02:41.735872+0000","last_clean":"2024-05-10T14:02:41.735872+0000","last_became_active":"2024-05-10T14:02:32.670629+0000","last_became_peered":"2024-05-10T14:02:32.670629+0000","last_unstale":"2024-05-10T14:02:41.735872+0000","last_undegraded":"2024-05-10T14:02:41.735872+0000","last_fullsized":"2024-05-10T14:02:41.735872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:54.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703748+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:02:41.703748+0000","last_peered":"2024-05-10T14:02:41.703748+0000","last_clean":"2024-05-10T14:02:41.703748+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:02:41.703748+0000","last_undegraded":"2024-05-10T14:02:41.703748+0000","last_fullsized":"2024-05-10T14:02:41.703748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730411+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:41.730411+0000","last_peered":"2024-05-10T14:02:41.730411+0000","last_clean":"2024-05-10T14:02:41.730411+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:41.730411+0000","last_undegraded":"2024-05-10T14:02:41.730411+0000","last_fullsized":"2024-05-10T14:02:41.730411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698026+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:02:41.698026+0000","last_peered":"2024-05-10T14:02:41.698026+0000","last_clean":"2024-05-10T14:02:41.698026+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:02:41.698026+0000","last_undegraded":"2024-05-10T14:02:41.698026+0000","last_fullsized":"2024-05-10T14:02:41.698026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.545821+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:42.545821+0000","last_peered":"2024-05-10T14:02:42.545821+0000","last_clean":"2024-05-10T14:02:42.545821+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:02:42.545821+0000","last_undegraded":"2024-05-10T14:02:42.545821+0000","last_fullsized":"2024-05-10T14:02:42.545821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701754+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:02:41.701754+0000","last_peered":"2024-05-10T14:02:41.701754+0000","last_clean":"2024-05-10T14:02:41.701754+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:02:41.701754+0000","last_undegraded":"2024-05-10T14:02:41.701754+0000","last_fullsized":"2024-05-10T14:02:41.701754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698156+0000","last_change":"2024-05-10T14:02:40.733773+0000","last_active":"2024-05-10T14:02:41.698156+0000","last_peered":"2024-05-10T14:02:41.698156+0000","last_clean":"2024-05-10T14:02:41.698156+0000","last_became_active":"2024-05-10T14:02:40.732976+0000","last_became_peered":"2024-05-10T14:02:40.732976+0000","last_unstale":"2024-05-10T14:02:41.698156+0000","last_undegraded":"2024-05-10T14:02:41.698156+0000","last_fullsized":"2024-05-10T14:02:41.698156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701822+0000","last_change":"2024-05-10T14:02:40.734335+0000","last_active":"2024-05-10T14:02:41.701822+0000","last_peered":"2024-05-10T14:02:41.701822+0000","last_clean":"2024-05-10T14:02:41.701822+0000","last_became_active":"2024-05-10T14:02:40.733789+0000","last_became_peered":"2024-05-10T14:02:40.733789+0000","last_unstale":"2024-05-10T14:02:41.701822+0000","last_undegraded":"2024-05-10T14:02:41.701822+0000","last_fullsized":"2024-05-10T14:02:41.701822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736146+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:02:41.736146+0000","last_peered":"2024-05-10T14:02:41.736146+0000","last_clean":"2024-05-10T14:02:41.736146+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:02:41.736146+0000","last_undegraded":"2024-05-10T14:02:41.736146+0000","last_fullsized":"2024-05-10T14:02:41.736146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736019+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:02:41.736019+0000","last_peered":"2024-05-10T14:02:41.736019+0000","last_clean":"2024-05-10T14:02:41.736019+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:02:41.736019+0000","last_undegraded":"2024-05-10T14:02:41.736019+0000","last_fullsized":"2024-05-10T14:02:41.736019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711900+0000","last_change":"2024-05-10T14:02:34.706456+0000","last_active":"2024-05-10T14:02:41.711900+0000","last_peered":"2024-05-10T14:02:41.711900+0000","last_clean":"2024-05-10T14:02:41.711900+0000","last_became_active":"2024-05-10T14:02:34.705604+0000","last_became_peered":"2024-05-10T14:02:34.705604+0000","last_unstale":"2024-05-10T14:02:41.711900+0000","last_undegraded":"2024-05-10T14:02:41.711900+0000","last_fullsized":"2024-05-10T14:02:41.711900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:54.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.615984+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:02:42.615984+0000","last_peered":"2024-05-10T14:02:42.615984+0000","last_clean":"2024-05-10T14:02:42.615984+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:02:42.615984+0000","last_undegraded":"2024-05-10T14:02:42.615984+0000","last_fullsized":"2024-05-10T14:02:42.615984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697748+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:02:41.697748+0000","last_peered":"2024-05-10T14:02:41.697748+0000","last_clean":"2024-05-10T14:02:41.697748+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:02:41.697748+0000","last_undegraded":"2024-05-10T14:02:41.697748+0000","last_fullsized":"2024-05-10T14:02:41.697748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701542+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:02:41.701542+0000","last_peered":"2024-05-10T14:02:41.701542+0000","last_clean":"2024-05-10T14:02:41.701542+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:02:41.701542+0000","last_undegraded":"2024-05-10T14:02:41.701542+0000","last_fullsized":"2024-05-10T14:02:41.701542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711364+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:02:41.711364+0000","last_peered":"2024-05-10T14:02:41.711364+0000","last_clean":"2024-05-10T14:02:41.711364+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:02:41.711364+0000","last_undegraded":"2024-05-10T14:02:41.711364+0000","last_fullsized":"2024-05-10T14:02:41.711364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724489+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:02:41.724489+0000","last_peered":"2024-05-10T14:02:41.724489+0000","last_clean":"2024-05-10T14:02:41.724489+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:02:41.724489+0000","last_undegraded":"2024-05-10T14:02:41.724489+0000","last_fullsized":"2024-05-10T14:02:41.724489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703395+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:02:41.703395+0000","last_peered":"2024-05-10T14:02:41.703395+0000","last_clean":"2024-05-10T14:02:41.703395+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:02:41.703395+0000","last_undegraded":"2024-05-10T14:02:41.703395+0000","last_fullsized":"2024-05-10T14:02:41.703395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.062529+0000","last_change":"2024-05-10T14:02:36.704252+0000","last_active":"2024-05-10T14:02:42.062529+0000","last_peered":"2024-05-10T14:02:42.062529+0000","last_clean":"2024-05-10T14:02:42.062529+0000","last_became_active":"2024-05-10T14:02:36.703671+0000","last_became_peered":"2024-05-10T14:02:36.703671+0000","last_unstale":"2024-05-10T14:02:42.062529+0000","last_undegraded":"2024-05-10T14:02:42.062529+0000","last_fullsized":"2024-05-10T14:02:42.062529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722127+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:02:41.722127+0000","last_peered":"2024-05-10T14:02:41.722127+0000","last_clean":"2024-05-10T14:02:41.722127+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:02:41.722127+0000","last_undegraded":"2024-05-10T14:02:41.722127+0000","last_fullsized":"2024-05-10T14:02:41.722127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701294+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:02:41.701294+0000","last_peered":"2024-05-10T14:02:41.701294+0000","last_clean":"2024-05-10T14:02:41.701294+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:02:41.701294+0000","last_undegraded":"2024-05-10T14:02:41.701294+0000","last_fullsized":"2024-05-10T14:02:41.701294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698376+0000","last_change":"2024-05-10T14:02:32.680541+0000","last_active":"2024-05-10T14:02:41.698376+0000","last_peered":"2024-05-10T14:02:41.698376+0000","last_clean":"2024-05-10T14:02:41.698376+0000","last_became_active":"2024-05-10T14:02:32.678843+0000","last_became_peered":"2024-05-10T14:02:32.678843+0000","last_unstale":"2024-05-10T14:02:41.698376+0000","last_undegraded":"2024-05-10T14:02:41.698376+0000","last_fullsized":"2024-05-10T14:02:41.698376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698953+0000","last_change":"2024-05-10T14:02:30.657936+0000","last_active":"2024-05-10T14:02:41.698953+0000","last_peered":"2024-05-10T14:02:41.698953+0000","last_clean":"2024-05-10T14:02:41.698953+0000","last_became_active":"2024-05-10T14:02:30.657176+0000","last_became_peered":"2024-05-10T14:02:30.657176+0000","last_unstale":"2024-05-10T14:02:41.698953+0000","last_undegraded":"2024-05-10T14:02:41.698953+0000","last_fullsized":"2024-05-10T14:02:41.698953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721331+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:02:41.721331+0000","last_peered":"2024-05-10T14:02:41.721331+0000","last_clean":"2024-05-10T14:02:41.721331+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:02:41.721331+0000","last_undegraded":"2024-05-10T14:02:41.721331+0000","last_fullsized":"2024-05-10T14:02:41.721331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.524300+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:02:42.524300+0000","last_peered":"2024-05-10T14:02:42.524300+0000","last_clean":"2024-05-10T14:02:42.524300+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:02:42.524300+0000","last_undegraded":"2024-05-10T14:02:42.524300+0000","last_fullsized":"2024-05-10T14:02:42.524300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728712+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:02:41.728712+0000","last_peered":"2024-05-10T14:02:41.728712+0000","last_clean":"2024-05-10T14:02:41.728712+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:02:41.728712+0000","last_undegraded":"2024-05-10T14:02:41.728712+0000","last_fullsized":"2024-05-10T14:02:41.728712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698161+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:41.698161+0000","last_peered":"2024-05-10T14:02:41.698161+0000","last_clean":"2024-05-10T14:02:41.698161+0000","last_became_active":"2024-05-10T14:02:40.733097+0000","last_became_peered":"2024-05-10T14:02:40.733097+0000","last_unstale":"2024-05-10T14:02:41.698161+0000","last_undegraded":"2024-05-10T14:02:41.698161+0000","last_fullsized":"2024-05-10T14:02:41.698161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698817+0000","last_change":"2024-05-10T14:02:32.676636+0000","last_active":"2024-05-10T14:02:41.698817+0000","last_peered":"2024-05-10T14:02:41.698817+0000","last_clean":"2024-05-10T14:02:41.698817+0000","last_became_active":"2024-05-10T14:02:32.673068+0000","last_became_peered":"2024-05-10T14:02:32.673068+0000","last_unstale":"2024-05-10T14:02:41.698817+0000","last_undegraded":"2024-05-10T14:02:41.698817+0000","last_fullsized":"2024-05-10T14:02:41.698817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702335+0000","last_change":"2024-05-10T14:02:30.664601+0000","last_active":"2024-05-10T14:02:41.702335+0000","last_peered":"2024-05-10T14:02:41.702335+0000","last_clean":"2024-05-10T14:02:41.702335+0000","last_became_active":"2024-05-10T14:02:30.664274+0000","last_became_peered":"2024-05-10T14:02:30.664274+0000","last_unstale":"2024-05-10T14:02:41.702335+0000","last_undegraded":"2024-05-10T14:02:41.702335+0000","last_fullsized":"2024-05-10T14:02:41.702335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728694+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:02:41.728694+0000","last_peered":"2024-05-10T14:02:41.728694+0000","last_clean":"2024-05-10T14:02:41.728694+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:02:41.728694+0000","last_undegraded":"2024-05-10T14:02:41.728694+0000","last_fullsized":"2024-05-10T14:02:41.728694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.297705+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:02:42.297705+0000","last_peered":"2024-05-10T14:02:42.297705+0000","last_clean":"2024-05-10T14:02:42.297705+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:02:42.297705+0000","last_undegraded":"2024-05-10T14:02:42.297705+0000","last_fullsized":"2024-05-10T14:02:42.297705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698631+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:02:41.698631+0000","last_peered":"2024-05-10T14:02:41.698631+0000","last_clean":"2024-05-10T14:02:41.698631+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:02:41.698631+0000","last_undegraded":"2024-05-10T14:02:41.698631+0000","last_fullsized":"2024-05-10T14:02:41.698631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730159+0000","last_change":"2024-05-10T14:02:32.684577+0000","last_active":"2024-05-10T14:02:41.730159+0000","last_peered":"2024-05-10T14:02:41.730159+0000","last_clean":"2024-05-10T14:02:41.730159+0000","last_became_active":"2024-05-10T14:02:32.683843+0000","last_became_peered":"2024-05-10T14:02:32.683843+0000","last_unstale":"2024-05-10T14:02:41.730159+0000","last_undegraded":"2024-05-10T14:02:41.730159+0000","last_fullsized":"2024-05-10T14:02:41.730159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699186+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:02:41.699186+0000","last_peered":"2024-05-10T14:02:41.699186+0000","last_clean":"2024-05-10T14:02:41.699186+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:02:41.699186+0000","last_undegraded":"2024-05-10T14:02:41.699186+0000","last_fullsized":"2024-05-10T14:02:41.699186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702459+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:02:41.702459+0000","last_peered":"2024-05-10T14:02:41.702459+0000","last_clean":"2024-05-10T14:02:41.702459+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:02:41.702459+0000","last_undegraded":"2024-05-10T14:02:41.702459+0000","last_fullsized":"2024-05-10T14:02:41.702459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.643679+0000","last_change":"2024-05-10T14:02:36.696412+0000","last_active":"2024-05-10T14:02:42.643679+0000","last_peered":"2024-05-10T14:02:42.643679+0000","last_clean":"2024-05-10T14:02:42.643679+0000","last_became_active":"2024-05-10T14:02:36.695516+0000","last_became_peered":"2024-05-10T14:02:36.695516+0000","last_unstale":"2024-05-10T14:02:42.643679+0000","last_undegraded":"2024-05-10T14:02:42.643679+0000","last_fullsized":"2024-05-10T14:02:42.643679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:24.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699411+0000","last_change":"2024-05-10T14:02:38.730974+0000","last_active":"2024-05-10T14:02:41.699411+0000","last_peered":"2024-05-10T14:02:41.699411+0000","last_clean":"2024-05-10T14:02:41.699411+0000","last_became_active":"2024-05-10T14:02:38.730309+0000","last_became_peered":"2024-05-10T14:02:38.730309+0000","last_unstale":"2024-05-10T14:02:41.699411+0000","last_undegraded":"2024-05-10T14:02:41.699411+0000","last_fullsized":"2024-05-10T14:02:41.699411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702742+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:02:41.702742+0000","last_peered":"2024-05-10T14:02:41.702742+0000","last_clean":"2024-05-10T14:02:41.702742+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:02:41.702742+0000","last_undegraded":"2024-05-10T14:02:41.702742+0000","last_fullsized":"2024-05-10T14:02:41.702742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702863+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:02:41.702863+0000","last_peered":"2024-05-10T14:02:41.702863+0000","last_clean":"2024-05-10T14:02:41.702863+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:02:41.702863+0000","last_undegraded":"2024-05-10T14:02:41.702863+0000","last_fullsized":"2024-05-10T14:02:41.702863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711216+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:02:41.711216+0000","last_peered":"2024-05-10T14:02:41.711216+0000","last_clean":"2024-05-10T14:02:41.711216+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:02:41.711216+0000","last_undegraded":"2024-05-10T14:02:41.711216+0000","last_fullsized":"2024-05-10T14:02:41.711216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729917+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:02:41.729917+0000","last_peered":"2024-05-10T14:02:41.729917+0000","last_clean":"2024-05-10T14:02:41.729917+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:02:41.729917+0000","last_undegraded":"2024-05-10T14:02:41.729917+0000","last_fullsized":"2024-05-10T14:02:41.729917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.425511+0000","last_change":"2024-05-10T14:02:36.699400+0000","last_active":"2024-05-10T14:02:42.425511+0000","last_peered":"2024-05-10T14:02:42.425511+0000","last_clean":"2024-05-10T14:02:42.425511+0000","last_became_active":"2024-05-10T14:02:36.698700+0000","last_became_peered":"2024-05-10T14:02:36.698700+0000","last_unstale":"2024-05-10T14:02:42.425511+0000","last_undegraded":"2024-05-10T14:02:42.425511+0000","last_fullsized":"2024-05-10T14:02:42.425511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713101+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:02:41.713101+0000","last_peered":"2024-05-10T14:02:41.713101+0000","last_clean":"2024-05-10T14:02:41.713101+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:02:41.713101+0000","last_undegraded":"2024-05-10T14:02:41.713101+0000","last_fullsized":"2024-05-10T14:02:41.713101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728942+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:02:41.728942+0000","last_peered":"2024-05-10T14:02:41.728942+0000","last_clean":"2024-05-10T14:02:41.728942+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:02:41.728942+0000","last_undegraded":"2024-05-10T14:02:41.728942+0000","last_fullsized":"2024-05-10T14:02:41.728942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698066+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:02:41.698066+0000","last_peered":"2024-05-10T14:02:41.698066+0000","last_clean":"2024-05-10T14:02:41.698066+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:02:41.698066+0000","last_undegraded":"2024-05-10T14:02:41.698066+0000","last_fullsized":"2024-05-10T14:02:41.698066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737405+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:02:41.737405+0000","last_peered":"2024-05-10T14:02:41.737405+0000","last_clean":"2024-05-10T14:02:41.737405+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:02:41.737405+0000","last_undegraded":"2024-05-10T14:02:41.737405+0000","last_fullsized":"2024-05-10T14:02:41.737405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737618+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:02:41.737618+0000","last_peered":"2024-05-10T14:02:41.737618+0000","last_clean":"2024-05-10T14:02:41.737618+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:02:41.737618+0000","last_undegraded":"2024-05-10T14:02:41.737618+0000","last_fullsized":"2024-05-10T14:02:41.737618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.622920+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:02:42.622920+0000","last_peered":"2024-05-10T14:02:42.622920+0000","last_clean":"2024-05-10T14:02:42.622920+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:02:42.622920+0000","last_undegraded":"2024-05-10T14:02:42.622920+0000","last_fullsized":"2024-05-10T14:02:42.622920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713066+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:02:41.713066+0000","last_peered":"2024-05-10T14:02:41.713066+0000","last_clean":"2024-05-10T14:02:41.713066+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:02:41.713066+0000","last_undegraded":"2024-05-10T14:02:41.713066+0000","last_fullsized":"2024-05-10T14:02:41.713066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697390+0000","last_change":"2024-05-10T14:02:40.733960+0000","last_active":"2024-05-10T14:02:41.697390+0000","last_peered":"2024-05-10T14:02:41.697390+0000","last_clean":"2024-05-10T14:02:41.697390+0000","last_became_active":"2024-05-10T14:02:40.733072+0000","last_became_peered":"2024-05-10T14:02:40.733072+0000","last_unstale":"2024-05-10T14:02:41.697390+0000","last_undegraded":"2024-05-10T14:02:41.697390+0000","last_fullsized":"2024-05-10T14:02:41.697390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750328+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:02:41.750328+0000","last_peered":"2024-05-10T14:02:41.750328+0000","last_clean":"2024-05-10T14:02:41.750328+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:02:41.750328+0000","last_undegraded":"2024-05-10T14:02:41.750328+0000","last_fullsized":"2024-05-10T14:02:41.750328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698531+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:02:41.698531+0000","last_peered":"2024-05-10T14:02:41.698531+0000","last_clean":"2024-05-10T14:02:41.698531+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:02:41.698531+0000","last_undegraded":"2024-05-10T14:02:41.698531+0000","last_fullsized":"2024-05-10T14:02:41.698531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713394+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:02:41.713394+0000","last_peered":"2024-05-10T14:02:41.713394+0000","last_clean":"2024-05-10T14:02:41.713394+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:02:41.713394+0000","last_undegraded":"2024-05-10T14:02:41.713394+0000","last_fullsized":"2024-05-10T14:02:41.713394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.602275+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:02:42.602275+0000","last_peered":"2024-05-10T14:02:42.602275+0000","last_clean":"2024-05-10T14:02:42.602275+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:02:42.602275+0000","last_undegraded":"2024-05-10T14:02:42.602275+0000","last_fullsized":"2024-05-10T14:02:42.602275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.118640+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:02:42.118640+0000","last_peered":"2024-05-10T14:02:42.118640+0000","last_clean":"2024-05-10T14:02:42.118640+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:02:42.118640+0000","last_undegraded":"2024-05-10T14:02:42.118640+0000","last_fullsized":"2024-05-10T14:02:42.118640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721606+0000","last_change":"2024-05-10T14:02:40.736838+0000","last_active":"2024-05-10T14:02:41.721606+0000","last_peered":"2024-05-10T14:02:41.721606+0000","last_clean":"2024-05-10T14:02:41.721606+0000","last_became_active":"2024-05-10T14:02:40.735991+0000","last_became_peered":"2024-05-10T14:02:40.735991+0000","last_unstale":"2024-05-10T14:02:41.721606+0000","last_undegraded":"2024-05-10T14:02:41.721606+0000","last_fullsized":"2024-05-10T14:02:41.721606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:22.716620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735870+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:02:41.735870+0000","last_peered":"2024-05-10T14:02:41.735870+0000","last_clean":"2024-05-10T14:02:41.735870+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:02:41.735870+0000","last_undegraded":"2024-05-10T14:02:41.735870+0000","last_fullsized":"2024-05-10T14:02:41.735870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699700+0000","last_change":"2024-05-10T14:02:30.661826+0000","last_active":"2024-05-10T14:02:41.699700+0000","last_peered":"2024-05-10T14:02:41.699700+0000","last_clean":"2024-05-10T14:02:41.699700+0000","last_became_active":"2024-05-10T14:02:30.660030+0000","last_became_peered":"2024-05-10T14:02:30.660030+0000","last_unstale":"2024-05-10T14:02:41.699700+0000","last_undegraded":"2024-05-10T14:02:41.699700+0000","last_fullsized":"2024-05-10T14:02:41.699700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721935+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:02:41.721935+0000","last_peered":"2024-05-10T14:02:41.721935+0000","last_clean":"2024-05-10T14:02:41.721935+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:02:41.721935+0000","last_undegraded":"2024-05-10T14:02:41.721935+0000","last_fullsized":"2024-05-10T14:02:41.721935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.637058+0000","last_change":"2024-05-10T14:02:36.701658+0000","last_active":"2024-05-10T14:02:42.637058+0000","last_peered":"2024-05-10T14:02:42.637058+0000","last_clean":"2024-05-10T14:02:42.637058+0000","last_became_active":"2024-05-10T14:02:36.700840+0000","last_became_peered":"2024-05-10T14:02:36.700840+0000","last_unstale":"2024-05-10T14:02:42.637058+0000","last_undegraded":"2024-05-10T14:02:42.637058+0000","last_fullsized":"2024-05-10T14:02:42.637058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697349+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:02:41.697349+0000","last_peered":"2024-05-10T14:02:41.697349+0000","last_clean":"2024-05-10T14:02:41.697349+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:02:41.697349+0000","last_undegraded":"2024-05-10T14:02:41.697349+0000","last_fullsized":"2024-05-10T14:02:41.697349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724285+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:02:41.724285+0000","last_peered":"2024-05-10T14:02:41.724285+0000","last_clean":"2024-05-10T14:02:41.724285+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:02:41.724285+0000","last_undegraded":"2024-05-10T14:02:41.724285+0000","last_fullsized":"2024-05-10T14:02:41.724285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736624+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:02:41.736624+0000","last_peered":"2024-05-10T14:02:41.736624+0000","last_clean":"2024-05-10T14:02:41.736624+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:02:41.736624+0000","last_undegraded":"2024-05-10T14:02:41.736624+0000","last_fullsized":"2024-05-10T14:02:41.736624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699537+0000","last_change":"2024-05-10T14:02:30.660120+0000","last_active":"2024-05-10T14:02:41.699537+0000","last_peered":"2024-05-10T14:02:41.699537+0000","last_clean":"2024-05-10T14:02:41.699537+0000","last_became_active":"2024-05-10T14:02:30.658976+0000","last_became_peered":"2024-05-10T14:02:30.658976+0000","last_unstale":"2024-05-10T14:02:41.699537+0000","last_undegraded":"2024-05-10T14:02:41.699537+0000","last_fullsized":"2024-05-10T14:02:41.699537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697747+0000","last_change":"2024-05-10T14:02:34.700027+0000","last_active":"2024-05-10T14:02:41.697747+0000","last_peered":"2024-05-10T14:02:41.697747+0000","last_clean":"2024-05-10T14:02:41.697747+0000","last_became_active":"2024-05-10T14:02:34.699301+0000","last_became_peered":"2024-05-10T14:02:34.699301+0000","last_unstale":"2024-05-10T14:02:41.697747+0000","last_undegraded":"2024-05-10T14:02:41.697747+0000","last_fullsized":"2024-05-10T14:02:41.697747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:30:40.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.011841+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:02:42.011841+0000","last_peered":"2024-05-10T14:02:42.011841+0000","last_clean":"2024-05-10T14:02:42.011841+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:02:42.011841+0000","last_undegraded":"2024-05-10T14:02:42.011841+0000","last_fullsized":"2024-05-10T14:02:42.011841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728346+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:02:41.728346+0000","last_peered":"2024-05-10T14:02:41.728346+0000","last_clean":"2024-05-10T14:02:41.728346+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:02:41.728346+0000","last_undegraded":"2024-05-10T14:02:41.728346+0000","last_fullsized":"2024-05-10T14:02:41.728346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701980+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:02:41.701980+0000","last_peered":"2024-05-10T14:02:41.701980+0000","last_clean":"2024-05-10T14:02:41.701980+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:02:41.701980+0000","last_undegraded":"2024-05-10T14:02:41.701980+0000","last_fullsized":"2024-05-10T14:02:41.701980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698775+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:02:41.698775+0000","last_peered":"2024-05-10T14:02:41.698775+0000","last_clean":"2024-05-10T14:02:41.698775+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:02:41.698775+0000","last_undegraded":"2024-05-10T14:02:41.698775+0000","last_fullsized":"2024-05-10T14:02:41.698775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702270+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:02:41.702270+0000","last_peered":"2024-05-10T14:02:41.702270+0000","last_clean":"2024-05-10T14:02:41.702270+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:02:41.702270+0000","last_undegraded":"2024-05-10T14:02:41.702270+0000","last_fullsized":"2024-05-10T14:02:41.702270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.734981+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:02:41.734981+0000","last_peered":"2024-05-10T14:02:41.734981+0000","last_clean":"2024-05-10T14:02:41.734981+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:02:41.734981+0000","last_undegraded":"2024-05-10T14:02:41.734981+0000","last_fullsized":"2024-05-10T14:02:41.734981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.248998+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:02:42.248998+0000","last_peered":"2024-05-10T14:02:42.248998+0000","last_clean":"2024-05-10T14:02:42.248998+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:02:42.248998+0000","last_undegraded":"2024-05-10T14:02:42.248998+0000","last_fullsized":"2024-05-10T14:02:42.248998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735468+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:02:41.735468+0000","last_peered":"2024-05-10T14:02:41.735468+0000","last_clean":"2024-05-10T14:02:41.735468+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:02:41.735468+0000","last_undegraded":"2024-05-10T14:02:41.735468+0000","last_fullsized":"2024-05-10T14:02:41.735468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723896+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:02:41.723896+0000","last_peered":"2024-05-10T14:02:41.723896+0000","last_clean":"2024-05-10T14:02:41.723896+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:02:41.723896+0000","last_undegraded":"2024-05-10T14:02:41.723896+0000","last_fullsized":"2024-05-10T14:02:41.723896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735503+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:02:41.735503+0000","last_peered":"2024-05-10T14:02:41.735503+0000","last_clean":"2024-05-10T14:02:41.735503+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:02:41.735503+0000","last_undegraded":"2024-05-10T14:02:41.735503+0000","last_fullsized":"2024-05-10T14:02:41.735503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702323+0000","last_change":"2024-05-10T14:02:30.664222+0000","last_active":"2024-05-10T14:02:41.702323+0000","last_peered":"2024-05-10T14:02:41.702323+0000","last_clean":"2024-05-10T14:02:41.702323+0000","last_became_active":"2024-05-10T14:02:30.663784+0000","last_became_peered":"2024-05-10T14:02:30.663784+0000","last_unstale":"2024-05-10T14:02:41.702323+0000","last_undegraded":"2024-05-10T14:02:41.702323+0000","last_fullsized":"2024-05-10T14:02:41.702323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710218+0000","last_change":"2024-05-10T14:02:34.706054+0000","last_active":"2024-05-10T14:02:41.710218+0000","last_peered":"2024-05-10T14:02:41.710218+0000","last_clean":"2024-05-10T14:02:41.710218+0000","last_became_active":"2024-05-10T14:02:34.705486+0000","last_became_peered":"2024-05-10T14:02:34.705486+0000","last_unstale":"2024-05-10T14:02:41.710218+0000","last_undegraded":"2024-05-10T14:02:41.710218+0000","last_fullsized":"2024-05-10T14:02:41.710218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:05.822560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.319123+0000","last_change":"2024-05-10T14:02:36.695528+0000","last_active":"2024-05-10T14:02:42.319123+0000","last_peered":"2024-05-10T14:02:42.319123+0000","last_clean":"2024-05-10T14:02:42.319123+0000","last_became_active":"2024-05-10T14:02:36.694789+0000","last_became_peered":"2024-05-10T14:02:36.694789+0000","last_unstale":"2024-05-10T14:02:42.319123+0000","last_undegraded":"2024-05-10T14:02:42.319123+0000","last_fullsized":"2024-05-10T14:02:42.319123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698352+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:02:41.698352+0000","last_peered":"2024-05-10T14:02:41.698352+0000","last_clean":"2024-05-10T14:02:41.698352+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:02:41.698352+0000","last_undegraded":"2024-05-10T14:02:41.698352+0000","last_fullsized":"2024-05-10T14:02:41.698352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.738010+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:02:41.738010+0000","last_peered":"2024-05-10T14:02:41.738010+0000","last_clean":"2024-05-10T14:02:41.738010+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:02:41.738010+0000","last_undegraded":"2024-05-10T14:02:41.738010+0000","last_fullsized":"2024-05-10T14:02:41.738010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714001+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:02:41.714001+0000","last_peered":"2024-05-10T14:02:41.714001+0000","last_clean":"2024-05-10T14:02:41.714001+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:02:41.714001+0000","last_undegraded":"2024-05-10T14:02:41.714001+0000","last_fullsized":"2024-05-10T14:02:41.714001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728201+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:02:41.728201+0000","last_peered":"2024-05-10T14:02:41.728201+0000","last_clean":"2024-05-10T14:02:41.728201+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:02:41.728201+0000","last_undegraded":"2024-05-10T14:02:41.728201+0000","last_fullsized":"2024-05-10T14:02:41.728201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713480+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:02:41.713480+0000","last_peered":"2024-05-10T14:02:41.713480+0000","last_clean":"2024-05-10T14:02:41.713480+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:02:41.713480+0000","last_undegraded":"2024-05-10T14:02:41.713480+0000","last_fullsized":"2024-05-10T14:02:41.713480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749210+0000","last_change":"2024-05-10T14:02:30.663047+0000","last_active":"2024-05-10T14:02:41.749210+0000","last_peered":"2024-05-10T14:02:41.749210+0000","last_clean":"2024-05-10T14:02:41.749210+0000","last_became_active":"2024-05-10T14:02:30.662722+0000","last_became_peered":"2024-05-10T14:02:30.662722+0000","last_unstale":"2024-05-10T14:02:41.749210+0000","last_undegraded":"2024-05-10T14:02:41.749210+0000","last_fullsized":"2024-05-10T14:02:41.749210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698809+0000","last_change":"2024-05-10T14:02:32.685578+0000","last_active":"2024-05-10T14:02:41.698809+0000","last_peered":"2024-05-10T14:02:41.698809+0000","last_clean":"2024-05-10T14:02:41.698809+0000","last_became_active":"2024-05-10T14:02:32.682816+0000","last_became_peered":"2024-05-10T14:02:32.682816+0000","last_unstale":"2024-05-10T14:02:41.698809+0000","last_undegraded":"2024-05-10T14:02:41.698809+0000","last_fullsized":"2024-05-10T14:02:41.698809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698789+0000","last_change":"2024-05-10T14:02:30.667144+0000","last_active":"2024-05-10T14:02:41.698789+0000","last_peered":"2024-05-10T14:02:41.698789+0000","last_clean":"2024-05-10T14:02:41.698789+0000","last_became_active":"2024-05-10T14:02:30.666407+0000","last_became_peered":"2024-05-10T14:02:30.666407+0000","last_unstale":"2024-05-10T14:02:41.698789+0000","last_undegraded":"2024-05-10T14:02:41.698789+0000","last_fullsized":"2024-05-10T14:02:41.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711912+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:02:41.711912+0000","last_peered":"2024-05-10T14:02:41.711912+0000","last_clean":"2024-05-10T14:02:41.711912+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:02:41.711912+0000","last_undegraded":"2024-05-10T14:02:41.711912+0000","last_fullsized":"2024-05-10T14:02:41.711912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699037+0000","last_change":"2024-05-10T14:02:30.644592+0000","last_active":"2024-05-10T14:02:41.699037+0000","last_peered":"2024-05-10T14:02:41.699037+0000","last_clean":"2024-05-10T14:02:41.699037+0000","last_became_active":"2024-05-10T14:02:30.644241+0000","last_became_peered":"2024-05-10T14:02:30.644241+0000","last_unstale":"2024-05-10T14:02:41.699037+0000","last_undegraded":"2024-05-10T14:02:41.699037+0000","last_fullsized":"2024-05-10T14:02:41.699037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703801+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:02:41.703801+0000","last_peered":"2024-05-10T14:02:41.703801+0000","last_clean":"2024-05-10T14:02:41.703801+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:02:41.703801+0000","last_undegraded":"2024-05-10T14:02:41.703801+0000","last_fullsized":"2024-05-10T14:02:41.703801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701248+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:02:41.701248+0000","last_peered":"2024-05-10T14:02:41.701248+0000","last_clean":"2024-05-10T14:02:41.701248+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:02:41.701248+0000","last_undegraded":"2024-05-10T14:02:41.701248+0000","last_fullsized":"2024-05-10T14:02:41.701248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737009+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:02:41.737009+0000","last_peered":"2024-05-10T14:02:41.737009+0000","last_clean":"2024-05-10T14:02:41.737009+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:02:41.737009+0000","last_undegraded":"2024-05-10T14:02:41.737009+0000","last_fullsized":"2024-05-10T14:02:41.737009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713897+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:02:41.713897+0000","last_peered":"2024-05-10T14:02:41.713897+0000","last_clean":"2024-05-10T14:02:41.713897+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:02:41.713897+0000","last_undegraded":"2024-05-10T14:02:41.713897+0000","last_fullsized":"2024-05-10T14:02:41.713897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698106+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:02:41.698106+0000","last_peered":"2024-05-10T14:02:41.698106+0000","last_clean":"2024-05-10T14:02:41.698106+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:02:41.698106+0000","last_undegraded":"2024-05-10T14:02:41.698106+0000","last_fullsized":"2024-05-10T14:02:41.698106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730874+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:02:41.730874+0000","last_peered":"2024-05-10T14:02:41.730874+0000","last_clean":"2024-05-10T14:02:41.730874+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:02:41.730874+0000","last_undegraded":"2024-05-10T14:02:41.730874+0000","last_fullsized":"2024-05-10T14:02:41.730874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728100+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:02:41.728100+0000","last_peered":"2024-05-10T14:02:41.728100+0000","last_clean":"2024-05-10T14:02:41.728100+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:02:41.728100+0000","last_undegraded":"2024-05-10T14:02:41.728100+0000","last_fullsized":"2024-05-10T14:02:41.728100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699855+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:02:41.699855+0000","last_peered":"2024-05-10T14:02:41.699855+0000","last_clean":"2024-05-10T14:02:41.699855+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:02:41.699855+0000","last_undegraded":"2024-05-10T14:02:41.699855+0000","last_fullsized":"2024-05-10T14:02:41.699855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701992+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:02:41.701992+0000","last_peered":"2024-05-10T14:02:41.701992+0000","last_clean":"2024-05-10T14:02:41.701992+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:02:41.701992+0000","last_undegraded":"2024-05-10T14:02:41.701992+0000","last_fullsized":"2024-05-10T14:02:41.701992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697819+0000","last_change":"2024-05-10T14:02:30.656911+0000","last_active":"2024-05-10T14:02:41.697819+0000","last_peered":"2024-05-10T14:02:41.697819+0000","last_clean":"2024-05-10T14:02:41.697819+0000","last_became_active":"2024-05-10T14:02:30.650731+0000","last_became_peered":"2024-05-10T14:02:30.650731+0000","last_unstale":"2024-05-10T14:02:41.697819+0000","last_undegraded":"2024-05-10T14:02:41.697819+0000","last_fullsized":"2024-05-10T14:02:41.697819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739226+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:02:41.739226+0000","last_peered":"2024-05-10T14:02:41.739226+0000","last_clean":"2024-05-10T14:02:41.739226+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:02:41.739226+0000","last_undegraded":"2024-05-10T14:02:41.739226+0000","last_fullsized":"2024-05-10T14:02:41.739226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699011+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:02:41.699011+0000","last_peered":"2024-05-10T14:02:41.699011+0000","last_clean":"2024-05-10T14:02:41.699011+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:02:41.699011+0000","last_undegraded":"2024-05-10T14:02:41.699011+0000","last_fullsized":"2024-05-10T14:02:41.699011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750411+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:02:41.750411+0000","last_peered":"2024-05-10T14:02:41.750411+0000","last_clean":"2024-05-10T14:02:41.750411+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:02:41.750411+0000","last_undegraded":"2024-05-10T14:02:41.750411+0000","last_fullsized":"2024-05-10T14:02:41.750411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698469+0000","last_change":"2024-05-10T14:02:30.665295+0000","last_active":"2024-05-10T14:02:41.698469+0000","last_peered":"2024-05-10T14:02:41.698469+0000","last_clean":"2024-05-10T14:02:41.698469+0000","last_became_active":"2024-05-10T14:02:30.663923+0000","last_became_peered":"2024-05-10T14:02:30.663923+0000","last_unstale":"2024-05-10T14:02:41.698469+0000","last_undegraded":"2024-05-10T14:02:41.698469+0000","last_fullsized":"2024-05-10T14:02:41.698469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737089+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:02:41.737089+0000","last_peered":"2024-05-10T14:02:41.737089+0000","last_clean":"2024-05-10T14:02:41.737089+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:02:41.737089+0000","last_undegraded":"2024-05-10T14:02:41.737089+0000","last_fullsized":"2024-05-10T14:02:41.737089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699577+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:02:41.699577+0000","last_peered":"2024-05-10T14:02:41.699577+0000","last_clean":"2024-05-10T14:02:41.699577+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:02:41.699577+0000","last_undegraded":"2024-05-10T14:02:41.699577+0000","last_fullsized":"2024-05-10T14:02:41.699577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722734+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:02:41.722734+0000","last_peered":"2024-05-10T14:02:41.722734+0000","last_clean":"2024-05-10T14:02:41.722734+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:02:41.722734+0000","last_undegraded":"2024-05-10T14:02:41.722734+0000","last_fullsized":"2024-05-10T14:02:41.722734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729679+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:02:41.729679+0000","last_peered":"2024-05-10T14:02:41.729679+0000","last_clean":"2024-05-10T14:02:41.729679+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:02:41.729679+0000","last_undegraded":"2024-05-10T14:02:41.729679+0000","last_fullsized":"2024-05-10T14:02:41.729679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698783+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:02:41.698783+0000","last_peered":"2024-05-10T14:02:41.698783+0000","last_clean":"2024-05-10T14:02:41.698783+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:02:41.698783+0000","last_undegraded":"2024-05-10T14:02:41.698783+0000","last_fullsized":"2024-05-10T14:02:41.698783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724736+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:02:41.724736+0000","last_peered":"2024-05-10T14:02:41.724736+0000","last_clean":"2024-05-10T14:02:41.724736+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:02:41.724736+0000","last_undegraded":"2024-05-10T14:02:41.724736+0000","last_fullsized":"2024-05-10T14:02:41.724736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697836+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:02:41.697836+0000","last_peered":"2024-05-10T14:02:41.697836+0000","last_clean":"2024-05-10T14:02:41.697836+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:02:41.697836+0000","last_undegraded":"2024-05-10T14:02:41.697836+0000","last_fullsized":"2024-05-10T14:02:41.697836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.751331+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:02:41.751331+0000","last_peered":"2024-05-10T14:02:41.751331+0000","last_clean":"2024-05-10T14:02:41.751331+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:02:41.751331+0000","last_undegraded":"2024-05-10T14:02:41.751331+0000","last_fullsized":"2024-05-10T14:02:41.751331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721797+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:02:41.721797+0000","last_peered":"2024-05-10T14:02:41.721797+0000","last_clean":"2024-05-10T14:02:41.721797+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:02:41.721797+0000","last_undegraded":"2024-05-10T14:02:41.721797+0000","last_fullsized":"2024-05-10T14:02:41.721797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699414+0000","last_change":"2024-05-10T14:02:30.662908+0000","last_active":"2024-05-10T14:02:41.699414+0000","last_peered":"2024-05-10T14:02:41.699414+0000","last_clean":"2024-05-10T14:02:41.699414+0000","last_became_active":"2024-05-10T14:02:30.661976+0000","last_became_peered":"2024-05-10T14:02:30.661976+0000","last_unstale":"2024-05-10T14:02:41.699414+0000","last_undegraded":"2024-05-10T14:02:41.699414+0000","last_fullsized":"2024-05-10T14:02:41.699414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697554+0000","last_change":"2024-05-10T14:02:30.667582+0000","last_active":"2024-05-10T14:02:41.697554+0000","last_peered":"2024-05-10T14:02:41.697554+0000","last_clean":"2024-05-10T14:02:41.697554+0000","last_became_active":"2024-05-10T14:02:30.657669+0000","last_became_peered":"2024-05-10T14:02:30.657669+0000","last_unstale":"2024-05-10T14:02:41.697554+0000","last_undegraded":"2024-05-10T14:02:41.697554+0000","last_fullsized":"2024-05-10T14:02:41.697554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701979+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:02:41.701979+0000","last_peered":"2024-05-10T14:02:41.701979+0000","last_clean":"2024-05-10T14:02:41.701979+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:02:41.701979+0000","last_undegraded":"2024-05-10T14:02:41.701979+0000","last_fullsized":"2024-05-10T14:02:41.701979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711040+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:02:41.711040+0000","last_peered":"2024-05-10T14:02:41.711040+0000","last_clean":"2024-05-10T14:02:41.711040+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:02:41.711040+0000","last_undegraded":"2024-05-10T14:02:41.711040+0000","last_fullsized":"2024-05-10T14:02:41.711040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698744+0000","last_change":"2024-05-10T14:02:32.681773+0000","last_active":"2024-05-10T14:02:41.698744+0000","last_peered":"2024-05-10T14:02:41.698744+0000","last_clean":"2024-05-10T14:02:41.698744+0000","last_became_active":"2024-05-10T14:02:32.681013+0000","last_became_peered":"2024-05-10T14:02:32.681013+0000","last_unstale":"2024-05-10T14:02:41.698744+0000","last_undegraded":"2024-05-10T14:02:41.698744+0000","last_fullsized":"2024-05-10T14:02:41.698744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1028096,"data_stored":759905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":169313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":170698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":169368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":169273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":168439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":759747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":425984,"data_stored":169127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:48.648 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:49.027 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:49.053 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-05-10T14:02:48.103218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249708,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725012,"statfs":{"total":773094113280,"available":772838412288,"internally_reserved":0,"allocated":4562944,"data_stored":2535870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723629+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:02:41.723629+0000","last_peered":"2024-05-10T14:02:41.723629+0000","last_clean":"2024-05-10T14:02:41.723629+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:02:41.723629+0000","last_undegraded":"2024-05-10T14:02:41.723629+0000","last_fullsized":"2024-05-10T14:02:41.723629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697033+0000","last_change":"2024-05-10T14:02:32.701008+0000","last_active":"2024-05-10T14:02:41.697033+0000","last_peered":"2024-05-10T14:02:41.697033+0000","last_clean":"2024-05-10T14:02:41.697033+0000","last_became_active":"2024-05-10T14:02:32.700023+0000","last_became_peered":"2024-05-10T14:02:32.700023+0000","last_unstale":"2024-05-10T14:02:41.697033+0000","last_undegraded":"2024-05-10T14:02:41.697033+0000","last_fullsized":"2024-05-10T14:02:41.697033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713690+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:02:41.713690+0000","last_peered":"2024-05-10T14:02:41.713690+0000","last_clean":"2024-05-10T14:02:41.713690+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:02:41.713690+0000","last_undegraded":"2024-05-10T14:02:41.713690+0000","last_fullsized":"2024-05-10T14:02:41.713690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722034+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:02:41.722034+0000","last_peered":"2024-05-10T14:02:41.722034+0000","last_clean":"2024-05-10T14:02:41.722034+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:02:41.722034+0000","last_undegraded":"2024-05-10T14:02:41.722034+0000","last_fullsized":"2024-05-10T14:02:41.722034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701872+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:02:41.701872+0000","last_peered":"2024-05-10T14:02:41.701872+0000","last_clean":"2024-05-10T14:02:41.701872+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:02:41.701872+0000","last_undegraded":"2024-05-10T14:02:41.701872+0000","last_fullsized":"2024-05-10T14:02:41.701872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736082+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:02:41.736082+0000","last_peered":"2024-05-10T14:02:41.736082+0000","last_clean":"2024-05-10T14:02:41.736082+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:02:41.736082+0000","last_undegraded":"2024-05-10T14:02:41.736082+0000","last_fullsized":"2024-05-10T14:02:41.736082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699579+0000","last_change":"2024-05-10T14:02:30.662364+0000","last_active":"2024-05-10T14:02:41.699579+0000","last_peered":"2024-05-10T14:02:41.699579+0000","last_clean":"2024-05-10T14:02:41.699579+0000","last_became_active":"2024-05-10T14:02:30.661072+0000","last_became_peered":"2024-05-10T14:02:30.661072+0000","last_unstale":"2024-05-10T14:02:41.699579+0000","last_undegraded":"2024-05-10T14:02:41.699579+0000","last_fullsized":"2024-05-10T14:02:41.699579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698775+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:02:41.698775+0000","last_peered":"2024-05-10T14:02:41.698775+0000","last_clean":"2024-05-10T14:02:41.698775+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:02:41.698775+0000","last_undegraded":"2024-05-10T14:02:41.698775+0000","last_fullsized":"2024-05-10T14:02:41.698775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723160+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:02:41.723160+0000","last_peered":"2024-05-10T14:02:41.723160+0000","last_clean":"2024-05-10T14:02:41.723160+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:02:41.723160+0000","last_undegraded":"2024-05-10T14:02:41.723160+0000","last_fullsized":"2024-05-10T14:02:41.723160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729345+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:02:41.729345+0000","last_peered":"2024-05-10T14:02:41.729345+0000","last_clean":"2024-05-10T14:02:41.729345+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:02:41.729345+0000","last_undegraded":"2024-05-10T14:02:41.729345+0000","last_fullsized":"2024-05-10T14:02:41.729345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697969+0000","last_change":"2024-05-10T14:02:30.664655+0000","last_active":"2024-05-10T14:02:41.697969+0000","last_peered":"2024-05-10T14:02:41.697969+0000","last_clean":"2024-05-10T14:02:41.697969+0000","last_became_active":"2024-05-10T14:02:30.662964+0000","last_became_peered":"2024-05-10T14:02:30.662964+0000","last_unstale":"2024-05-10T14:02:41.697969+0000","last_undegraded":"2024-05-10T14:02:41.697969+0000","last_fullsized":"2024-05-10T14:02:41.697969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736844+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:02:41.736844+0000","last_peered":"2024-05-10T14:02:41.736844+0000","last_clean":"2024-05-10T14:02:41.736844+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:02:41.736844+0000","last_undegraded":"2024-05-10T14:02:41.736844+0000","last_fullsized":"2024-05-10T14:02:41.736844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722569+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:02:41.722569+0000","last_peered":"2024-05-10T14:02:41.722569+0000","last_clean":"2024-05-10T14:02:41.722569+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:02:41.722569+0000","last_undegraded":"2024-05-10T14:02:41.722569+0000","last_fullsized":"2024-05-10T14:02:41.722569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698390+0000","last_change":"2024-05-10T14:02:32.685860+0000","last_active":"2024-05-10T14:02:41.698390+0000","last_peered":"2024-05-10T14:02:41.698390+0000","last_clean":"2024-05-10T14:02:41.698390+0000","last_became_active":"2024-05-10T14:02:32.684996+0000","last_became_peered":"2024-05-10T14:02:32.684996+0000","last_unstale":"2024-05-10T14:02:41.698390+0000","last_undegraded":"2024-05-10T14:02:41.698390+0000","last_fullsized":"2024-05-10T14:02:41.698390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698955+0000","last_change":"2024-05-10T14:02:30.659078+0000","last_active":"2024-05-10T14:02:41.698955+0000","last_peered":"2024-05-10T14:02:41.698955+0000","last_clean":"2024-05-10T14:02:41.698955+0000","last_became_active":"2024-05-10T14:02:30.658769+0000","last_became_peered":"2024-05-10T14:02:30.658769+0000","last_unstale":"2024-05-10T14:02:41.698955+0000","last_undegraded":"2024-05-10T14:02:41.698955+0000","last_fullsized":"2024-05-10T14:02:41.698955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750911+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:02:41.750911+0000","last_peered":"2024-05-10T14:02:41.750911+0000","last_clean":"2024-05-10T14:02:41.750911+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:02:41.750911+0000","last_undegraded":"2024-05-10T14:02:41.750911+0000","last_fullsized":"2024-05-10T14:02:41.750911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735435+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:02:41.735435+0000","last_peered":"2024-05-10T14:02:41.735435+0000","last_clean":"2024-05-10T14:02:41.735435+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:02:41.735435+0000","last_undegraded":"2024-05-10T14:02:41.735435+0000","last_fullsized":"2024-05-10T14:02:41.735435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723791+0000","last_change":"2024-05-10T14:02:30.670919+0000","last_active":"2024-05-10T14:02:41.723791+0000","last_peered":"2024-05-10T14:02:41.723791+0000","last_clean":"2024-05-10T14:02:41.723791+0000","last_became_active":"2024-05-10T14:02:30.670238+0000","last_became_peered":"2024-05-10T14:02:30.670238+0000","last_unstale":"2024-05-10T14:02:41.723791+0000","last_undegraded":"2024-05-10T14:02:41.723791+0000","last_fullsized":"2024-05-10T14:02:41.723791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722313+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:02:41.722313+0000","last_peered":"2024-05-10T14:02:41.722313+0000","last_clean":"2024-05-10T14:02:41.722313+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:02:41.722313+0000","last_undegraded":"2024-05-10T14:02:41.722313+0000","last_fullsized":"2024-05-10T14:02:41.722313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730693+0000","last_change":"2024-05-10T14:02:30.660232+0000","last_active":"2024-05-10T14:02:41.730693+0000","last_peered":"2024-05-10T14:02:41.730693+0000","last_clean":"2024-05-10T14:02:41.730693+0000","last_became_active":"2024-05-10T14:02:30.659541+0000","last_became_peered":"2024-05-10T14:02:30.659541+0000","last_unstale":"2024-05-10T14:02:41.730693+0000","last_undegraded":"2024-05-10T14:02:41.730693+0000","last_fullsized":"2024-05-10T14:02:41.730693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698213+0000","last_change":"2024-05-10T14:02:32.687835+0000","last_active":"2024-05-10T14:02:41.698213+0000","last_peered":"2024-05-10T14:02:41.698213+0000","last_clean":"2024-05-10T14:02:41.698213+0000","last_became_active":"2024-05-10T14:02:32.687123+0000","last_became_peered":"2024-05-10T14:02:32.687123+0000","last_unstale":"2024-05-10T14:02:41.698213+0000","last_undegraded":"2024-05-10T14:02:41.698213+0000","last_fullsized":"2024-05-10T14:02:41.698213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730216+0000","last_change":"2024-05-10T14:02:30.669888+0000","last_active":"2024-05-10T14:02:41.730216+0000","last_peered":"2024-05-10T14:02:41.730216+0000","last_clean":"2024-05-10T14:02:41.730216+0000","last_became_active":"2024-05-10T14:02:30.668900+0000","last_became_peered":"2024-05-10T14:02:30.668900+0000","last_unstale":"2024-05-10T14:02:41.730216+0000","last_undegraded":"2024-05-10T14:02:41.730216+0000","last_fullsized":"2024-05-10T14:02:41.730216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749877+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:02:41.749877+0000","last_peered":"2024-05-10T14:02:41.749877+0000","last_clean":"2024-05-10T14:02:41.749877+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:02:41.749877+0000","last_undegraded":"2024-05-10T14:02:41.749877+0000","last_fullsized":"2024-05-10T14:02:41.749877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736314+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:02:41.736314+0000","last_peered":"2024-05-10T14:02:41.736314+0000","last_clean":"2024-05-10T14:02:41.736314+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:02:41.736314+0000","last_undegraded":"2024-05-10T14:02:41.736314+0000","last_fullsized":"2024-05-10T14:02:41.736314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750188+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:02:41.750188+0000","last_peered":"2024-05-10T14:02:41.750188+0000","last_clean":"2024-05-10T14:02:41.750188+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:02:41.750188+0000","last_undegraded":"2024-05-10T14:02:41.750188+0000","last_fullsized":"2024-05-10T14:02:41.750188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703106+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:02:41.703106+0000","last_peered":"2024-05-10T14:02:41.703106+0000","last_clean":"2024-05-10T14:02:41.703106+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:02:41.703106+0000","last_undegraded":"2024-05-10T14:02:41.703106+0000","last_fullsized":"2024-05-10T14:02:41.703106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736939+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:02:41.736939+0000","last_peered":"2024-05-10T14:02:41.736939+0000","last_clean":"2024-05-10T14:02:41.736939+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:02:41.736939+0000","last_undegraded":"2024-05-10T14:02:41.736939+0000","last_fullsized":"2024-05-10T14:02:41.736939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:02:41.699945+0000","last_peered":"2024-05-10T14:02:41.699945+0000","last_clean":"2024-05-10T14:02:41.699945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:02:41.699945+0000","last_undegraded":"2024-05-10T14:02:41.699945+0000","last_fullsized":"2024-05-10T14:02:41.699945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735175+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:02:41.735175+0000","last_peered":"2024-05-10T14:02:41.735175+0000","last_clean":"2024-05-10T14:02:41.735175+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:02:41.735175+0000","last_undegraded":"2024-05-10T14:02:41.735175+0000","last_fullsized":"2024-05-10T14:02:41.735175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699404+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:02:41.699404+0000","last_peered":"2024-05-10T14:02:41.699404+0000","last_clean":"2024-05-10T14:02:41.699404+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:02:41.699404+0000","last_undegraded":"2024-05-10T14:02:41.699404+0000","last_fullsized":"2024-05-10T14:02:41.699404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723373+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:02:41.723373+0000","last_peered":"2024-05-10T14:02:41.723373+0000","last_clean":"2024-05-10T14:02:41.723373+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:02:41.723373+0000","last_undegraded":"2024-05-10T14:02:41.723373+0000","last_fullsized":"2024-05-10T14:02:41.723373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698565+0000","last_change":"2024-05-10T14:02:34.703721+0000","last_active":"2024-05-10T14:02:41.698565+0000","last_peered":"2024-05-10T14:02:41.698565+0000","last_clean":"2024-05-10T14:02:41.698565+0000","last_became_active":"2024-05-10T14:02:34.702006+0000","last_became_peered":"2024-05-10T14:02:34.702006+0000","last_unstale":"2024-05-10T14:02:41.698565+0000","last_undegraded":"2024-05-10T14:02:41.698565+0000","last_fullsized":"2024-05-10T14:02:41.698565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.095025+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:02:42.095025+0000","last_peered":"2024-05-10T14:02:42.095025+0000","last_clean":"2024-05-10T14:02:42.095025+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:02:42.095025+0000","last_undegraded":"2024-05-10T14:02:42.095025+0000","last_fullsized":"2024-05-10T14:02:42.095025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723486+0000","last_change":"2024-05-10T14:02:38.724178+0000","last_active":"2024-05-10T14:02:41.723486+0000","last_peered":"2024-05-10T14:02:41.723486+0000","last_clean":"2024-05-10T14:02:41.723486+0000","last_became_active":"2024-05-10T14:02:38.721491+0000","last_became_peered":"2024-05-10T14:02:38.721491+0000","last_unstale":"2024-05-10T14:02:41.723486+0000","last_undegraded":"2024-05-10T14:02:41.723486+0000","last_fullsized":"2024-05-10T14:02:41.723486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697119+0000","last_change":"2024-05-10T14:02:40.733937+0000","last_active":"2024-05-10T14:02:41.697119+0000","last_peered":"2024-05-10T14:02:41.697119+0000","last_clean":"2024-05-10T14:02:41.697119+0000","last_became_active":"2024-05-10T14:02:40.733205+0000","last_became_peered":"2024-05-10T14:02:40.733205+0000","last_unstale":"2024-05-10T14:02:41.697119+0000","last_undegraded":"2024-05-10T14:02:41.697119+0000","last_fullsized":"2024-05-10T14:02:41.697119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:40.961641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699407+0000","last_change":"2024-05-10T14:02:32.683159+0000","last_active":"2024-05-10T14:02:41.699407+0000","last_peered":"2024-05-10T14:02:41.699407+0000","last_clean":"2024-05-10T14:02:41.699407+0000","last_became_active":"2024-05-10T14:02:32.682442+0000","last_became_peered":"2024-05-10T14:02:32.682442+0000","last_unstale":"2024-05-10T14:02:41.699407+0000","last_undegraded":"2024-05-10T14:02:41.699407+0000","last_fullsized":"2024-05-10T14:02:41.699407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700185+0000","last_change":"2024-05-10T14:02:30.649814+0000","last_active":"2024-05-10T14:02:41.700185+0000","last_peered":"2024-05-10T14:02:41.700185+0000","last_clean":"2024-05-10T14:02:41.700185+0000","last_became_active":"2024-05-10T14:02:30.649470+0000","last_became_peered":"2024-05-10T14:02:30.649470+0000","last_unstale":"2024-05-10T14:02:41.700185+0000","last_undegraded":"2024-05-10T14:02:41.700185+0000","last_fullsized":"2024-05-10T14:02:41.700185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699003+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:02:41.699003+0000","last_peered":"2024-05-10T14:02:41.699003+0000","last_clean":"2024-05-10T14:02:41.699003+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:02:41.699003+0000","last_undegraded":"2024-05-10T14:02:41.699003+0000","last_fullsized":"2024-05-10T14:02:41.699003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.497207+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:02:42.497207+0000","last_peered":"2024-05-10T14:02:42.497207+0000","last_clean":"2024-05-10T14:02:42.497207+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:02:42.497207+0000","last_undegraded":"2024-05-10T14:02:42.497207+0000","last_fullsized":"2024-05-10T14:02:42.497207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737361+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:02:41.737361+0000","last_peered":"2024-05-10T14:02:41.737361+0000","last_clean":"2024-05-10T14:02:41.737361+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:02:41.737361+0000","last_undegraded":"2024-05-10T14:02:41.737361+0000","last_fullsized":"2024-05-10T14:02:41.737361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699324+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:02:41.699324+0000","last_peered":"2024-05-10T14:02:41.699324+0000","last_clean":"2024-05-10T14:02:41.699324+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:02:41.699324+0000","last_undegraded":"2024-05-10T14:02:41.699324+0000","last_fullsized":"2024-05-10T14:02:41.699324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703504+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:02:41.703504+0000","last_peered":"2024-05-10T14:02:41.703504+0000","last_clean":"2024-05-10T14:02:41.703504+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:02:41.703504+0000","last_undegraded":"2024-05-10T14:02:41.703504+0000","last_fullsized":"2024-05-10T14:02:41.703504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722858+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:02:41.722858+0000","last_peered":"2024-05-10T14:02:41.722858+0000","last_clean":"2024-05-10T14:02:41.722858+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:02:41.722858+0000","last_undegraded":"2024-05-10T14:02:41.722858+0000","last_fullsized":"2024-05-10T14:02:41.722858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703051+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:02:41.703051+0000","last_peered":"2024-05-10T14:02:41.703051+0000","last_clean":"2024-05-10T14:02:41.703051+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:02:41.703051+0000","last_undegraded":"2024-05-10T14:02:41.703051+0000","last_fullsized":"2024-05-10T14:02:41.703051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.552575+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:02:42.552575+0000","last_peered":"2024-05-10T14:02:42.552575+0000","last_clean":"2024-05-10T14:02:42.552575+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:02:42.552575+0000","last_undegraded":"2024-05-10T14:02:42.552575+0000","last_fullsized":"2024-05-10T14:02:42.552575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.120221+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:02:42.120221+0000","last_peered":"2024-05-10T14:02:42.120221+0000","last_clean":"2024-05-10T14:02:42.120221+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:02:42.120221+0000","last_undegraded":"2024-05-10T14:02:42.120221+0000","last_fullsized":"2024-05-10T14:02:42.120221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736065+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:02:41.736065+0000","last_peered":"2024-05-10T14:02:41.736065+0000","last_clean":"2024-05-10T14:02:41.736065+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:02:41.736065+0000","last_undegraded":"2024-05-10T14:02:41.736065+0000","last_fullsized":"2024-05-10T14:02:41.736065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699724+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:02:41.699724+0000","last_peered":"2024-05-10T14:02:41.699724+0000","last_clean":"2024-05-10T14:02:41.699724+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:02:41.699724+0000","last_undegraded":"2024-05-10T14:02:41.699724+0000","last_fullsized":"2024-05-10T14:02:41.699724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728414+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:02:41.728414+0000","last_peered":"2024-05-10T14:02:41.728414+0000","last_clean":"2024-05-10T14:02:41.728414+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:02:41.728414+0000","last_undegraded":"2024-05-10T14:02:41.728414+0000","last_fullsized":"2024-05-10T14:02:41.728414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698279+0000","last_change":"2024-05-10T14:02:34.703716+0000","last_active":"2024-05-10T14:02:41.698279+0000","last_peered":"2024-05-10T14:02:41.698279+0000","last_clean":"2024-05-10T14:02:41.698279+0000","last_became_active":"2024-05-10T14:02:34.702179+0000","last_became_peered":"2024-05-10T14:02:34.702179+0000","last_unstale":"2024-05-10T14:02:41.698279+0000","last_undegraded":"2024-05-10T14:02:41.698279+0000","last_fullsized":"2024-05-10T14:02:41.698279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.560623+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:02:42.560623+0000","last_peered":"2024-05-10T14:02:42.560623+0000","last_clean":"2024-05-10T14:02:42.560623+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:02:42.560623+0000","last_undegraded":"2024-05-10T14:02:42.560623+0000","last_fullsized":"2024-05-10T14:02:42.560623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.121638+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:02:42.121638+0000","last_peered":"2024-05-10T14:02:42.121638+0000","last_clean":"2024-05-10T14:02:42.121638+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:02:42.121638+0000","last_undegraded":"2024-05-10T14:02:42.121638+0000","last_fullsized":"2024-05-10T14:02:42.121638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697507+0000","last_change":"2024-05-10T14:02:32.683119+0000","last_active":"2024-05-10T14:02:41.697507+0000","last_peered":"2024-05-10T14:02:41.697507+0000","last_clean":"2024-05-10T14:02:41.697507+0000","last_became_active":"2024-05-10T14:02:32.682312+0000","last_became_peered":"2024-05-10T14:02:32.682312+0000","last_unstale":"2024-05-10T14:02:41.697507+0000","last_undegraded":"2024-05-10T14:02:41.697507+0000","last_fullsized":"2024-05-10T14:02:41.697507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723846+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:02:41.723846+0000","last_peered":"2024-05-10T14:02:41.723846+0000","last_clean":"2024-05-10T14:02:41.723846+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:02:41.723846+0000","last_undegraded":"2024-05-10T14:02:41.723846+0000","last_fullsized":"2024-05-10T14:02:41.723846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721723+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:02:41.721723+0000","last_peered":"2024-05-10T14:02:41.721723+0000","last_clean":"2024-05-10T14:02:41.721723+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:02:41.721723+0000","last_undegraded":"2024-05-10T14:02:41.721723+0000","last_fullsized":"2024-05-10T14:02:41.721723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.658251+0000","last_change":"2024-05-10T14:02:36.760567+0000","last_active":"2024-05-10T14:02:42.658251+0000","last_peered":"2024-05-10T14:02:42.658251+0000","last_clean":"2024-05-10T14:02:42.658251+0000","last_became_active":"2024-05-10T14:02:36.759783+0000","last_became_peered":"2024-05-10T14:02:36.759783+0000","last_unstale":"2024-05-10T14:02:42.658251+0000","last_undegraded":"2024-05-10T14:02:42.658251+0000","last_fullsized":"2024-05-10T14:02:42.658251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710454+0000","last_change":"2024-05-10T14:02:38.721490+0000","last_active":"2024-05-10T14:02:41.710454+0000","last_peered":"2024-05-10T14:02:41.710454+0000","last_clean":"2024-05-10T14:02:41.710454+0000","last_became_active":"2024-05-10T14:02:38.720706+0000","last_became_peered":"2024-05-10T14:02:38.720706+0000","last_unstale":"2024-05-10T14:02:41.710454+0000","last_undegraded":"2024-05-10T14:02:41.710454+0000","last_fullsized":"2024-05-10T14:02:41.710454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.457471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699263+0000","last_change":"2024-05-10T14:02:40.737217+0000","last_active":"2024-05-10T14:02:41.699263+0000","last_peered":"2024-05-10T14:02:41.699263+0000","last_clean":"2024-05-10T14:02:41.699263+0000","last_became_active":"2024-05-10T14:02:40.734397+0000","last_became_peered":"2024-05-10T14:02:40.734397+0000","last_unstale":"2024-05-10T14:02:41.699263+0000","last_undegraded":"2024-05-10T14:02:41.699263+0000","last_fullsized":"2024-05-10T14:02:41.699263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735805+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:02:41.735805+0000","last_peered":"2024-05-10T14:02:41.735805+0000","last_clean":"2024-05-10T14:02:41.735805+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:02:41.735805+0000","last_undegraded":"2024-05-10T14:02:41.735805+0000","last_fullsized":"2024-05-10T14:02:41.735805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723536+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:02:41.723536+0000","last_peered":"2024-05-10T14:02:41.723536+0000","last_clean":"2024-05-10T14:02:41.723536+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:02:41.723536+0000","last_undegraded":"2024-05-10T14:02:41.723536+0000","last_fullsized":"2024-05-10T14:02:41.723536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749152+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:02:41.749152+0000","last_peered":"2024-05-10T14:02:41.749152+0000","last_clean":"2024-05-10T14:02:41.749152+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:02:41.749152+0000","last_undegraded":"2024-05-10T14:02:41.749152+0000","last_fullsized":"2024-05-10T14:02:41.749152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.531159+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:02:42.531159+0000","last_peered":"2024-05-10T14:02:42.531159+0000","last_clean":"2024-05-10T14:02:42.531159+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:02:42.531159+0000","last_undegraded":"2024-05-10T14:02:42.531159+0000","last_fullsized":"2024-05-10T14:02:42.531159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701494+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:02:41.701494+0000","last_peered":"2024-05-10T14:02:41.701494+0000","last_clean":"2024-05-10T14:02:41.701494+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:02:41.701494+0000","last_undegraded":"2024-05-10T14:02:41.701494+0000","last_fullsized":"2024-05-10T14:02:41.701494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729058+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:02:41.729058+0000","last_peered":"2024-05-10T14:02:41.729058+0000","last_clean":"2024-05-10T14:02:41.729058+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:02:41.729058+0000","last_undegraded":"2024-05-10T14:02:41.729058+0000","last_fullsized":"2024-05-10T14:02:41.729058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729268+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:02:41.729268+0000","last_peered":"2024-05-10T14:02:41.729268+0000","last_clean":"2024-05-10T14:02:41.729268+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:02:41.729268+0000","last_undegraded":"2024-05-10T14:02:41.729268+0000","last_fullsized":"2024-05-10T14:02:41.729268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724485+0000","last_change":"2024-05-10T14:02:30.676357+0000","last_active":"2024-05-10T14:02:41.724485+0000","last_peered":"2024-05-10T14:02:41.724485+0000","last_clean":"2024-05-10T14:02:41.724485+0000","last_became_active":"2024-05-10T14:02:30.675551+0000","last_became_peered":"2024-05-10T14:02:30.675551+0000","last_unstale":"2024-05-10T14:02:41.724485+0000","last_undegraded":"2024-05-10T14:02:41.724485+0000","last_fullsized":"2024-05-10T14:02:41.724485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750351+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:02:41.750351+0000","last_peered":"2024-05-10T14:02:41.750351+0000","last_clean":"2024-05-10T14:02:41.750351+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:02:41.750351+0000","last_undegraded":"2024-05-10T14:02:41.750351+0000","last_fullsized":"2024-05-10T14:02:41.750351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.448177+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:02:42.448177+0000","last_peered":"2024-05-10T14:02:42.448177+0000","last_clean":"2024-05-10T14:02:42.448177+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:02:42.448177+0000","last_undegraded":"2024-05-10T14:02:42.448177+0000","last_fullsized":"2024-05-10T14:02:42.448177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.124101+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:02:42.124101+0000","last_peered":"2024-05-10T14:02:42.124101+0000","last_clean":"2024-05-10T14:02:42.124101+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:02:42.124101+0000","last_undegraded":"2024-05-10T14:02:42.124101+0000","last_fullsized":"2024-05-10T14:02:42.124101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702044+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:02:41.702044+0000","last_peered":"2024-05-10T14:02:41.702044+0000","last_clean":"2024-05-10T14:02:41.702044+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:02:41.702044+0000","last_undegraded":"2024-05-10T14:02:41.702044+0000","last_fullsized":"2024-05-10T14:02:41.702044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700475+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:02:41.700475+0000","last_peered":"2024-05-10T14:02:41.700475+0000","last_clean":"2024-05-10T14:02:41.700475+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:02:41.700475+0000","last_undegraded":"2024-05-10T14:02:41.700475+0000","last_fullsized":"2024-05-10T14:02:41.700475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699906+0000","last_change":"2024-05-10T14:02:30.668980+0000","last_active":"2024-05-10T14:02:41.699906+0000","last_peered":"2024-05-10T14:02:41.699906+0000","last_clean":"2024-05-10T14:02:41.699906+0000","last_became_active":"2024-05-10T14:02:30.666369+0000","last_became_peered":"2024-05-10T14:02:30.666369+0000","last_unstale":"2024-05-10T14:02:41.699906+0000","last_undegraded":"2024-05-10T14:02:41.699906+0000","last_fullsized":"2024-05-10T14:02:41.699906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749505+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:02:41.749505+0000","last_peered":"2024-05-10T14:02:41.749505+0000","last_clean":"2024-05-10T14:02:41.749505+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:02:41.749505+0000","last_undegraded":"2024-05-10T14:02:41.749505+0000","last_fullsized":"2024-05-10T14:02:41.749505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.057683+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:02:42.057683+0000","last_peered":"2024-05-10T14:02:42.057683+0000","last_clean":"2024-05-10T14:02:42.057683+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:02:42.057683+0000","last_undegraded":"2024-05-10T14:02:42.057683+0000","last_fullsized":"2024-05-10T14:02:42.057683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749155+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:02:41.749155+0000","last_peered":"2024-05-10T14:02:41.749155+0000","last_clean":"2024-05-10T14:02:41.749155+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:02:41.749155+0000","last_undegraded":"2024-05-10T14:02:41.749155+0000","last_fullsized":"2024-05-10T14:02:41.749155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713517+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:02:41.713517+0000","last_peered":"2024-05-10T14:02:41.713517+0000","last_clean":"2024-05-10T14:02:41.713517+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:02:41.713517+0000","last_undegraded":"2024-05-10T14:02:41.713517+0000","last_fullsized":"2024-05-10T14:02:41.713517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736946+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:02:41.736946+0000","last_peered":"2024-05-10T14:02:41.736946+0000","last_clean":"2024-05-10T14:02:41.736946+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:02:41.736946+0000","last_undegraded":"2024-05-10T14:02:41.736946+0000","last_fullsized":"2024-05-10T14:02:41.736946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702789+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:02:41.702789+0000","last_peered":"2024-05-10T14:02:41.702789+0000","last_clean":"2024-05-10T14:02:41.702789+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:02:41.702789+0000","last_undegraded":"2024-05-10T14:02:41.702789+0000","last_fullsized":"2024-05-10T14:02:41.702789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750107+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:02:41.750107+0000","last_peered":"2024-05-10T14:02:41.750107+0000","last_clean":"2024-05-10T14:02:41.750107+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:02:41.750107+0000","last_undegraded":"2024-05-10T14:02:41.750107+0000","last_fullsized":"2024-05-10T14:02:41.750107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.595124+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:02:42.595124+0000","last_peered":"2024-05-10T14:02:42.595124+0000","last_clean":"2024-05-10T14:02:42.595124+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:02:42.595124+0000","last_undegraded":"2024-05-10T14:02:42.595124+0000","last_fullsized":"2024-05-10T14:02:42.595124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701808+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:02:41.701808+0000","last_peered":"2024-05-10T14:02:41.701808+0000","last_clean":"2024-05-10T14:02:41.701808+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:02:41.701808+0000","last_undegraded":"2024-05-10T14:02:41.701808+0000","last_fullsized":"2024-05-10T14:02:41.701808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697479+0000","last_change":"2024-05-10T14:02:40.734940+0000","last_active":"2024-05-10T14:02:41.697479+0000","last_peered":"2024-05-10T14:02:41.697479+0000","last_clean":"2024-05-10T14:02:41.697479+0000","last_became_active":"2024-05-10T14:02:40.734017+0000","last_became_peered":"2024-05-10T14:02:40.734017+0000","last_unstale":"2024-05-10T14:02:41.697479+0000","last_undegraded":"2024-05-10T14:02:41.697479+0000","last_fullsized":"2024-05-10T14:02:41.697479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.803176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737690+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:02:41.737690+0000","last_peered":"2024-05-10T14:02:41.737690+0000","last_clean":"2024-05-10T14:02:41.737690+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:02:41.737690+0000","last_undegraded":"2024-05-10T14:02:41.737690+0000","last_fullsized":"2024-05-10T14:02:41.737690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729497+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:02:41.729497+0000","last_peered":"2024-05-10T14:02:41.729497+0000","last_clean":"2024-05-10T14:02:41.729497+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:02:41.729497+0000","last_undegraded":"2024-05-10T14:02:41.729497+0000","last_fullsized":"2024-05-10T14:02:41.729497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711332+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:02:41.711332+0000","last_peered":"2024-05-10T14:02:41.711332+0000","last_clean":"2024-05-10T14:02:41.711332+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:02:41.711332+0000","last_undegraded":"2024-05-10T14:02:41.711332+0000","last_fullsized":"2024-05-10T14:02:41.711332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.664676+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:02:42.664676+0000","last_peered":"2024-05-10T14:02:42.664676+0000","last_clean":"2024-05-10T14:02:42.664676+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:02:42.664676+0000","last_undegraded":"2024-05-10T14:02:42.664676+0000","last_fullsized":"2024-05-10T14:02:42.664676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.113608+0000","last_change":"2024-05-10T14:02:38.723250+0000","last_active":"2024-05-10T14:02:42.113608+0000","last_peered":"2024-05-10T14:02:42.113608+0000","last_clean":"2024-05-10T14:02:42.113608+0000","last_became_active":"2024-05-10T14:02:38.722515+0000","last_became_peered":"2024-05-10T14:02:38.722515+0000","last_unstale":"2024-05-10T14:02:42.113608+0000","last_undegraded":"2024-05-10T14:02:42.113608+0000","last_fullsized":"2024-05-10T14:02:42.113608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:43.700192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710733+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:02:41.710733+0000","last_peered":"2024-05-10T14:02:41.710733+0000","last_clean":"2024-05-10T14:02:41.710733+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:02:41.710733+0000","last_undegraded":"2024-05-10T14:02:41.710733+0000","last_fullsized":"2024-05-10T14:02:41.710733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739546+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:02:41.739546+0000","last_peered":"2024-05-10T14:02:41.739546+0000","last_clean":"2024-05-10T14:02:41.739546+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:02:41.739546+0000","last_undegraded":"2024-05-10T14:02:41.739546+0000","last_fullsized":"2024-05-10T14:02:41.739546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736410+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:02:41.736410+0000","last_peered":"2024-05-10T14:02:41.736410+0000","last_clean":"2024-05-10T14:02:41.736410+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:02:41.736410+0000","last_undegraded":"2024-05-10T14:02:41.736410+0000","last_fullsized":"2024-05-10T14:02:41.736410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698504+0000","last_change":"2024-05-10T14:02:34.704402+0000","last_active":"2024-05-10T14:02:41.698504+0000","last_peered":"2024-05-10T14:02:41.698504+0000","last_clean":"2024-05-10T14:02:41.698504+0000","last_became_active":"2024-05-10T14:02:34.703650+0000","last_became_peered":"2024-05-10T14:02:34.703650+0000","last_unstale":"2024-05-10T14:02:41.698504+0000","last_undegraded":"2024-05-10T14:02:41.698504+0000","last_fullsized":"2024-05-10T14:02:41.698504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.454896+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:02:42.454896+0000","last_peered":"2024-05-10T14:02:42.454896+0000","last_clean":"2024-05-10T14:02:42.454896+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:02:42.454896+0000","last_undegraded":"2024-05-10T14:02:42.454896+0000","last_fullsized":"2024-05-10T14:02:42.454896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.118606+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:02:42.118606+0000","last_peered":"2024-05-10T14:02:42.118606+0000","last_clean":"2024-05-10T14:02:42.118606+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:02:42.118606+0000","last_undegraded":"2024-05-10T14:02:42.118606+0000","last_fullsized":"2024-05-10T14:02:42.118606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736264+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:02:41.736264+0000","last_peered":"2024-05-10T14:02:41.736264+0000","last_clean":"2024-05-10T14:02:41.736264+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:02:41.736264+0000","last_undegraded":"2024-05-10T14:02:41.736264+0000","last_fullsized":"2024-05-10T14:02:41.736264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714000+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:02:41.714000+0000","last_peered":"2024-05-10T14:02:41.714000+0000","last_clean":"2024-05-10T14:02:41.714000+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:02:41.714000+0000","last_undegraded":"2024-05-10T14:02:41.714000+0000","last_fullsized":"2024-05-10T14:02:41.714000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699420+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:02:41.699420+0000","last_peered":"2024-05-10T14:02:41.699420+0000","last_clean":"2024-05-10T14:02:41.699420+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:02:41.699420+0000","last_undegraded":"2024-05-10T14:02:41.699420+0000","last_fullsized":"2024-05-10T14:02:41.699420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739226+0000","last_change":"2024-05-10T14:02:34.703505+0000","last_active":"2024-05-10T14:02:41.739226+0000","last_peered":"2024-05-10T14:02:41.739226+0000","last_clean":"2024-05-10T14:02:41.739226+0000","last_became_active":"2024-05-10T14:02:34.702702+0000","last_became_peered":"2024-05-10T14:02:34.702702+0000","last_unstale":"2024-05-10T14:02:41.739226+0000","last_undegraded":"2024-05-10T14:02:41.739226+0000","last_fullsized":"2024-05-10T14:02:41.739226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.587828+0000","last_change":"2024-05-10T14:02:36.699924+0000","last_active":"2024-05-10T14:02:42.587828+0000","last_peered":"2024-05-10T14:02:42.587828+0000","last_clean":"2024-05-10T14:02:42.587828+0000","last_became_active":"2024-05-10T14:02:36.699071+0000","last_became_peered":"2024-05-10T14:02:36.699071+0000","last_unstale":"2024-05-10T14:02:42.587828+0000","last_undegraded":"2024-05-10T14:02:42.587828+0000","last_fullsized":"2024-05-10T14:02:42.587828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728828+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:02:41.728828+0000","last_peered":"2024-05-10T14:02:41.728828+0000","last_clean":"2024-05-10T14:02:41.728828+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:02:41.728828+0000","last_undegraded":"2024-05-10T14:02:41.728828+0000","last_fullsized":"2024-05-10T14:02:41.728828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.712446+0000","last_change":"2024-05-10T14:02:40.734906+0000","last_active":"2024-05-10T14:02:41.712446+0000","last_peered":"2024-05-10T14:02:41.712446+0000","last_clean":"2024-05-10T14:02:41.712446+0000","last_became_active":"2024-05-10T14:02:40.734153+0000","last_became_peered":"2024-05-10T14:02:40.734153+0000","last_unstale":"2024-05-10T14:02:41.712446+0000","last_undegraded":"2024-05-10T14:02:41.712446+0000","last_fullsized":"2024-05-10T14:02:41.712446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:19.709648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729960+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:02:41.729960+0000","last_peered":"2024-05-10T14:02:41.729960+0000","last_clean":"2024-05-10T14:02:41.729960+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:02:41.729960+0000","last_undegraded":"2024-05-10T14:02:41.729960+0000","last_fullsized":"2024-05-10T14:02:41.729960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722367+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:41.722367+0000","last_peered":"2024-05-10T14:02:41.722367+0000","last_clean":"2024-05-10T14:02:41.722367+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:41.722367+0000","last_undegraded":"2024-05-10T14:02:41.722367+0000","last_fullsized":"2024-05-10T14:02:41.722367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698278+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:41.698278+0000","last_peered":"2024-05-10T14:02:41.698278+0000","last_clean":"2024-05-10T14:02:41.698278+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:41.698278+0000","last_undegraded":"2024-05-10T14:02:41.698278+0000","last_fullsized":"2024-05-10T14:02:41.698278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702298+0000","last_change":"2024-05-10T14:02:30.664055+0000","last_active":"2024-05-10T14:02:41.702298+0000","last_peered":"2024-05-10T14:02:41.702298+0000","last_clean":"2024-05-10T14:02:41.702298+0000","last_became_active":"2024-05-10T14:02:30.663754+0000","last_became_peered":"2024-05-10T14:02:30.663754+0000","last_unstale":"2024-05-10T14:02:41.702298+0000","last_undegraded":"2024-05-10T14:02:41.702298+0000","last_fullsized":"2024-05-10T14:02:41.702298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722873+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:02:41.722873+0000","last_peered":"2024-05-10T14:02:41.722873+0000","last_clean":"2024-05-10T14:02:41.722873+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:02:41.722873+0000","last_undegraded":"2024-05-10T14:02:41.722873+0000","last_fullsized":"2024-05-10T14:02:41.722873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.383888+0000","last_change":"2024-05-10T14:02:36.708452+0000","last_active":"2024-05-10T14:02:42.383888+0000","last_peered":"2024-05-10T14:02:42.383888+0000","last_clean":"2024-05-10T14:02:42.383888+0000","last_became_active":"2024-05-10T14:02:36.707872+0000","last_became_peered":"2024-05-10T14:02:36.707872+0000","last_unstale":"2024-05-10T14:02:42.383888+0000","last_undegraded":"2024-05-10T14:02:42.383888+0000","last_fullsized":"2024-05-10T14:02:42.383888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702306+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:02:41.702306+0000","last_peered":"2024-05-10T14:02:41.702306+0000","last_clean":"2024-05-10T14:02:41.702306+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:02:41.702306+0000","last_undegraded":"2024-05-10T14:02:41.702306+0000","last_fullsized":"2024-05-10T14:02:41.702306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728348+0000","last_change":"2024-05-10T14:02:40.742200+0000","last_active":"2024-05-10T14:02:41.728348+0000","last_peered":"2024-05-10T14:02:41.728348+0000","last_clean":"2024-05-10T14:02:41.728348+0000","last_became_active":"2024-05-10T14:02:40.741540+0000","last_became_peered":"2024-05-10T14:02:40.741540+0000","last_unstale":"2024-05-10T14:02:41.728348+0000","last_undegraded":"2024-05-10T14:02:41.728348+0000","last_fullsized":"2024-05-10T14:02:41.728348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:43.260808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703108+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:02:41.703108+0000","last_peered":"2024-05-10T14:02:41.703108+0000","last_clean":"2024-05-10T14:02:41.703108+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:02:41.703108+0000","last_undegraded":"2024-05-10T14:02:41.703108+0000","last_fullsized":"2024-05-10T14:02:41.703108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722060+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:41.722060+0000","last_peered":"2024-05-10T14:02:41.722060+0000","last_clean":"2024-05-10T14:02:41.722060+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:41.722060+0000","last_undegraded":"2024-05-10T14:02:41.722060+0000","last_fullsized":"2024-05-10T14:02:41.722060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702480+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:02:41.702480+0000","last_peered":"2024-05-10T14:02:41.702480+0000","last_clean":"2024-05-10T14:02:41.702480+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:02:41.702480+0000","last_undegraded":"2024-05-10T14:02:41.702480+0000","last_fullsized":"2024-05-10T14:02:41.702480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699119+0000","last_change":"2024-05-10T14:02:34.702777+0000","last_active":"2024-05-10T14:02:41.699119+0000","last_peered":"2024-05-10T14:02:41.699119+0000","last_clean":"2024-05-10T14:02:41.699119+0000","last_became_active":"2024-05-10T14:02:34.701897+0000","last_became_peered":"2024-05-10T14:02:34.701897+0000","last_unstale":"2024-05-10T14:02:41.699119+0000","last_undegraded":"2024-05-10T14:02:41.699119+0000","last_fullsized":"2024-05-10T14:02:41.699119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.576269+0000","last_change":"2024-05-10T14:02:36.699050+0000","last_active":"2024-05-10T14:02:42.576269+0000","last_peered":"2024-05-10T14:02:42.576269+0000","last_clean":"2024-05-10T14:02:42.576269+0000","last_became_active":"2024-05-10T14:02:36.698360+0000","last_became_peered":"2024-05-10T14:02:36.698360+0000","last_unstale":"2024-05-10T14:02:42.576269+0000","last_undegraded":"2024-05-10T14:02:42.576269+0000","last_fullsized":"2024-05-10T14:02:42.576269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:35:40.504956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722909+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:02:41.722909+0000","last_peered":"2024-05-10T14:02:41.722909+0000","last_clean":"2024-05-10T14:02:41.722909+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:02:41.722909+0000","last_undegraded":"2024-05-10T14:02:41.722909+0000","last_fullsized":"2024-05-10T14:02:41.722909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710600+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:02:41.710600+0000","last_peered":"2024-05-10T14:02:41.710600+0000","last_clean":"2024-05-10T14:02:41.710600+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:02:41.710600+0000","last_undegraded":"2024-05-10T14:02:41.710600+0000","last_fullsized":"2024-05-10T14:02:41.710600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714239+0000","last_change":"2024-05-10T14:02:32.685938+0000","last_active":"2024-05-10T14:02:41.714239+0000","last_peered":"2024-05-10T14:02:41.714239+0000","last_clean":"2024-05-10T14:02:41.714239+0000","last_became_active":"2024-05-10T14:02:32.685539+0000","last_became_peered":"2024-05-10T14:02:32.685539+0000","last_unstale":"2024-05-10T14:02:41.714239+0000","last_undegraded":"2024-05-10T14:02:41.714239+0000","last_fullsized":"2024-05-10T14:02:41.714239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:48.031945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749509+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:41.749509+0000","last_peered":"2024-05-10T14:02:41.749509+0000","last_clean":"2024-05-10T14:02:41.749509+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:41.749509+0000","last_undegraded":"2024-05-10T14:02:41.749509+0000","last_fullsized":"2024-05-10T14:02:41.749509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710285+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:02:41.710285+0000","last_peered":"2024-05-10T14:02:41.710285+0000","last_clean":"2024-05-10T14:02:41.710285+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:02:41.710285+0000","last_undegraded":"2024-05-10T14:02:41.710285+0000","last_fullsized":"2024-05-10T14:02:41.710285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750761+0000","last_change":"2024-05-10T14:02:34.702881+0000","last_active":"2024-05-10T14:02:41.750761+0000","last_peered":"2024-05-10T14:02:41.750761+0000","last_clean":"2024-05-10T14:02:41.750761+0000","last_became_active":"2024-05-10T14:02:34.702177+0000","last_became_peered":"2024-05-10T14:02:34.702177+0000","last_unstale":"2024-05-10T14:02:41.750761+0000","last_undegraded":"2024-05-10T14:02:41.750761+0000","last_fullsized":"2024-05-10T14:02:41.750761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:25.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.583401+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:42.583401+0000","last_peered":"2024-05-10T14:02:42.583401+0000","last_clean":"2024-05-10T14:02:42.583401+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:02:42.583401+0000","last_undegraded":"2024-05-10T14:02:42.583401+0000","last_fullsized":"2024-05-10T14:02:42.583401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700866+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:02:41.700866+0000","last_peered":"2024-05-10T14:02:41.700866+0000","last_clean":"2024-05-10T14:02:41.700866+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:02:41.700866+0000","last_undegraded":"2024-05-10T14:02:41.700866+0000","last_fullsized":"2024-05-10T14:02:41.700866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703635+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:02:41.703635+0000","last_peered":"2024-05-10T14:02:41.703635+0000","last_clean":"2024-05-10T14:02:41.703635+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:02:41.703635+0000","last_undegraded":"2024-05-10T14:02:41.703635+0000","last_fullsized":"2024-05-10T14:02:41.703635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711652+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:02:41.711652+0000","last_peered":"2024-05-10T14:02:41.711652+0000","last_clean":"2024-05-10T14:02:41.711652+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:02:41.711652+0000","last_undegraded":"2024-05-10T14:02:41.711652+0000","last_fullsized":"2024-05-10T14:02:41.711652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699043+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:41.699043+0000","last_peered":"2024-05-10T14:02:41.699043+0000","last_clean":"2024-05-10T14:02:41.699043+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:41.699043+0000","last_undegraded":"2024-05-10T14:02:41.699043+0000","last_fullsized":"2024-05-10T14:02:41.699043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736953+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:02:41.736953+0000","last_peered":"2024-05-10T14:02:41.736953+0000","last_clean":"2024-05-10T14:02:41.736953+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:02:41.736953+0000","last_undegraded":"2024-05-10T14:02:41.736953+0000","last_fullsized":"2024-05-10T14:02:41.736953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701443+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:02:41.701443+0000","last_peered":"2024-05-10T14:02:41.701443+0000","last_clean":"2024-05-10T14:02:41.701443+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:02:41.701443+0000","last_undegraded":"2024-05-10T14:02:41.701443+0000","last_fullsized":"2024-05-10T14:02:41.701443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.418290+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:02:42.418290+0000","last_peered":"2024-05-10T14:02:42.418290+0000","last_clean":"2024-05-10T14:02:42.418290+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:02:42.418290+0000","last_undegraded":"2024-05-10T14:02:42.418290+0000","last_fullsized":"2024-05-10T14:02:42.418290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729812+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:02:41.729812+0000","last_peered":"2024-05-10T14:02:41.729812+0000","last_clean":"2024-05-10T14:02:41.729812+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:02:41.729812+0000","last_undegraded":"2024-05-10T14:02:41.729812+0000","last_fullsized":"2024-05-10T14:02:41.729812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.696849+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:41.696849+0000","last_peered":"2024-05-10T14:02:41.696849+0000","last_clean":"2024-05-10T14:02:41.696849+0000","last_became_active":"2024-05-10T14:02:40.733023+0000","last_became_peered":"2024-05-10T14:02:40.733023+0000","last_unstale":"2024-05-10T14:02:41.696849+0000","last_undegraded":"2024-05-10T14:02:41.696849+0000","last_fullsized":"2024-05-10T14:02:41.696849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711637+0000","last_change":"2024-05-10T14:02:32.690026+0000","last_active":"2024-05-10T14:02:41.711637+0000","last_peered":"2024-05-10T14:02:41.711637+0000","last_clean":"2024-05-10T14:02:41.711637+0000","last_became_active":"2024-05-10T14:02:32.689610+0000","last_became_peered":"2024-05-10T14:02:32.689610+0000","last_unstale":"2024-05-10T14:02:41.711637+0000","last_undegraded":"2024-05-10T14:02:41.711637+0000","last_fullsized":"2024-05-10T14:02:41.711637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:02.876675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699731+0000","last_change":"2024-05-10T14:02:30.668078+0000","last_active":"2024-05-10T14:02:41.699731+0000","last_peered":"2024-05-10T14:02:41.699731+0000","last_clean":"2024-05-10T14:02:41.699731+0000","last_became_active":"2024-05-10T14:02:30.658626+0000","last_became_peered":"2024-05-10T14:02:30.658626+0000","last_unstale":"2024-05-10T14:02:41.699731+0000","last_undegraded":"2024-05-10T14:02:41.699731+0000","last_fullsized":"2024-05-10T14:02:41.699731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.712096+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:41.712096+0000","last_peered":"2024-05-10T14:02:41.712096+0000","last_clean":"2024-05-10T14:02:41.712096+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:41.712096+0000","last_undegraded":"2024-05-10T14:02:41.712096+0000","last_fullsized":"2024-05-10T14:02:41.712096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699306+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:02:41.699306+0000","last_peered":"2024-05-10T14:02:41.699306+0000","last_clean":"2024-05-10T14:02:41.699306+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:02:41.699306+0000","last_undegraded":"2024-05-10T14:02:41.699306+0000","last_fullsized":"2024-05-10T14:02:41.699306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.510402+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:02:42.510402+0000","last_peered":"2024-05-10T14:02:42.510402+0000","last_clean":"2024-05-10T14:02:42.510402+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:02:42.510402+0000","last_undegraded":"2024-05-10T14:02:42.510402+0000","last_fullsized":"2024-05-10T14:02:42.510402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735321+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:02:41.735321+0000","last_peered":"2024-05-10T14:02:41.735321+0000","last_clean":"2024-05-10T14:02:41.735321+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:02:41.735321+0000","last_undegraded":"2024-05-10T14:02:41.735321+0000","last_fullsized":"2024-05-10T14:02:41.735321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701269+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:02:41.701269+0000","last_peered":"2024-05-10T14:02:41.701269+0000","last_clean":"2024-05-10T14:02:41.701269+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:02:41.701269+0000","last_undegraded":"2024-05-10T14:02:41.701269+0000","last_fullsized":"2024-05-10T14:02:41.701269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.700400+0000","last_change":"2024-05-10T14:02:32.684861+0000","last_active":"2024-05-10T14:02:41.700400+0000","last_peered":"2024-05-10T14:02:41.700400+0000","last_clean":"2024-05-10T14:02:41.700400+0000","last_became_active":"2024-05-10T14:02:32.683137+0000","last_became_peered":"2024-05-10T14:02:32.683137+0000","last_unstale":"2024-05-10T14:02:41.700400+0000","last_undegraded":"2024-05-10T14:02:41.700400+0000","last_fullsized":"2024-05-10T14:02:41.700400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711788+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:02:41.711788+0000","last_peered":"2024-05-10T14:02:41.711788+0000","last_clean":"2024-05-10T14:02:41.711788+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:02:41.711788+0000","last_undegraded":"2024-05-10T14:02:41.711788+0000","last_fullsized":"2024-05-10T14:02:41.711788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724733+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:41.724733+0000","last_peered":"2024-05-10T14:02:41.724733+0000","last_clean":"2024-05-10T14:02:41.724733+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:41.724733+0000","last_undegraded":"2024-05-10T14:02:41.724733+0000","last_fullsized":"2024-05-10T14:02:41.724733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728843+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:02:41.728843+0000","last_peered":"2024-05-10T14:02:41.728843+0000","last_clean":"2024-05-10T14:02:41.728843+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:02:41.728843+0000","last_undegraded":"2024-05-10T14:02:41.728843+0000","last_fullsized":"2024-05-10T14:02:41.728843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.609084+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:02:42.609084+0000","last_peered":"2024-05-10T14:02:42.609084+0000","last_clean":"2024-05-10T14:02:42.609084+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:02:42.609084+0000","last_undegraded":"2024-05-10T14:02:42.609084+0000","last_fullsized":"2024-05-10T14:02:42.609084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.119290+0000","last_change":"2024-05-10T14:02:38.720704+0000","last_active":"2024-05-10T14:02:42.119290+0000","last_peered":"2024-05-10T14:02:42.119290+0000","last_clean":"2024-05-10T14:02:42.119290+0000","last_became_active":"2024-05-10T14:02:38.719862+0000","last_became_peered":"2024-05-10T14:02:38.719862+0000","last_unstale":"2024-05-10T14:02:42.119290+0000","last_undegraded":"2024-05-10T14:02:42.119290+0000","last_fullsized":"2024-05-10T14:02:42.119290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702862+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:02:41.702862+0000","last_peered":"2024-05-10T14:02:41.702862+0000","last_clean":"2024-05-10T14:02:41.702862+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:02:41.702862+0000","last_undegraded":"2024-05-10T14:02:41.702862+0000","last_fullsized":"2024-05-10T14:02:41.702862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698432+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:02:41.698432+0000","last_peered":"2024-05-10T14:02:41.698432+0000","last_clean":"2024-05-10T14:02:41.698432+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:02:41.698432+0000","last_undegraded":"2024-05-10T14:02:41.698432+0000","last_fullsized":"2024-05-10T14:02:41.698432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699413+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:02:41.699413+0000","last_peered":"2024-05-10T14:02:41.699413+0000","last_clean":"2024-05-10T14:02:41.699413+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:02:41.699413+0000","last_undegraded":"2024-05-10T14:02:41.699413+0000","last_fullsized":"2024-05-10T14:02:41.699413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713757+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:41.713757+0000","last_peered":"2024-05-10T14:02:41.713757+0000","last_clean":"2024-05-10T14:02:41.713757+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:41.713757+0000","last_undegraded":"2024-05-10T14:02:41.713757+0000","last_fullsized":"2024-05-10T14:02:41.713757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735508+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:02:41.735508+0000","last_peered":"2024-05-10T14:02:41.735508+0000","last_clean":"2024-05-10T14:02:41.735508+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:02:41.735508+0000","last_undegraded":"2024-05-10T14:02:41.735508+0000","last_fullsized":"2024-05-10T14:02:41.735508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.567392+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:02:42.567392+0000","last_peered":"2024-05-10T14:02:42.567392+0000","last_clean":"2024-05-10T14:02:42.567392+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:02:42.567392+0000","last_undegraded":"2024-05-10T14:02:42.567392+0000","last_fullsized":"2024-05-10T14:02:42.567392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.121613+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:02:42.121613+0000","last_peered":"2024-05-10T14:02:42.121613+0000","last_clean":"2024-05-10T14:02:42.121613+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:02:42.121613+0000","last_undegraded":"2024-05-10T14:02:42.121613+0000","last_fullsized":"2024-05-10T14:02:42.121613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701042+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:02:41.701042+0000","last_peered":"2024-05-10T14:02:41.701042+0000","last_clean":"2024-05-10T14:02:41.701042+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:02:41.701042+0000","last_undegraded":"2024-05-10T14:02:41.701042+0000","last_fullsized":"2024-05-10T14:02:41.701042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735872+0000","last_change":"2024-05-10T14:02:32.671389+0000","last_active":"2024-05-10T14:02:41.735872+0000","last_peered":"2024-05-10T14:02:41.735872+0000","last_clean":"2024-05-10T14:02:41.735872+0000","last_became_active":"2024-05-10T14:02:32.670629+0000","last_became_peered":"2024-05-10T14:02:32.670629+0000","last_unstale":"2024-05-10T14:02:41.735872+0000","last_undegraded":"2024-05-10T14:02:41.735872+0000","last_fullsized":"2024-05-10T14:02:41.735872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:54.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703748+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:02:41.703748+0000","last_peered":"2024-05-10T14:02:41.703748+0000","last_clean":"2024-05-10T14:02:41.703748+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:02:41.703748+0000","last_undegraded":"2024-05-10T14:02:41.703748+0000","last_fullsized":"2024-05-10T14:02:41.703748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730411+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:41.730411+0000","last_peered":"2024-05-10T14:02:41.730411+0000","last_clean":"2024-05-10T14:02:41.730411+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:41.730411+0000","last_undegraded":"2024-05-10T14:02:41.730411+0000","last_fullsized":"2024-05-10T14:02:41.730411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698026+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:02:41.698026+0000","last_peered":"2024-05-10T14:02:41.698026+0000","last_clean":"2024-05-10T14:02:41.698026+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:02:41.698026+0000","last_undegraded":"2024-05-10T14:02:41.698026+0000","last_fullsized":"2024-05-10T14:02:41.698026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.545821+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:42.545821+0000","last_peered":"2024-05-10T14:02:42.545821+0000","last_clean":"2024-05-10T14:02:42.545821+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:02:42.545821+0000","last_undegraded":"2024-05-10T14:02:42.545821+0000","last_fullsized":"2024-05-10T14:02:42.545821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701754+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:02:41.701754+0000","last_peered":"2024-05-10T14:02:41.701754+0000","last_clean":"2024-05-10T14:02:41.701754+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:02:41.701754+0000","last_undegraded":"2024-05-10T14:02:41.701754+0000","last_fullsized":"2024-05-10T14:02:41.701754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698156+0000","last_change":"2024-05-10T14:02:40.733773+0000","last_active":"2024-05-10T14:02:41.698156+0000","last_peered":"2024-05-10T14:02:41.698156+0000","last_clean":"2024-05-10T14:02:41.698156+0000","last_became_active":"2024-05-10T14:02:40.732976+0000","last_became_peered":"2024-05-10T14:02:40.732976+0000","last_unstale":"2024-05-10T14:02:41.698156+0000","last_undegraded":"2024-05-10T14:02:41.698156+0000","last_fullsized":"2024-05-10T14:02:41.698156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701822+0000","last_change":"2024-05-10T14:02:40.734335+0000","last_active":"2024-05-10T14:02:41.701822+0000","last_peered":"2024-05-10T14:02:41.701822+0000","last_clean":"2024-05-10T14:02:41.701822+0000","last_became_active":"2024-05-10T14:02:40.733789+0000","last_became_peered":"2024-05-10T14:02:40.733789+0000","last_unstale":"2024-05-10T14:02:41.701822+0000","last_undegraded":"2024-05-10T14:02:41.701822+0000","last_fullsized":"2024-05-10T14:02:41.701822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736146+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:02:41.736146+0000","last_peered":"2024-05-10T14:02:41.736146+0000","last_clean":"2024-05-10T14:02:41.736146+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:02:41.736146+0000","last_undegraded":"2024-05-10T14:02:41.736146+0000","last_fullsized":"2024-05-10T14:02:41.736146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736019+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:02:41.736019+0000","last_peered":"2024-05-10T14:02:41.736019+0000","last_clean":"2024-05-10T14:02:41.736019+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:02:41.736019+0000","last_undegraded":"2024-05-10T14:02:41.736019+0000","last_fullsized":"2024-05-10T14:02:41.736019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711900+0000","last_change":"2024-05-10T14:02:34.706456+0000","last_active":"2024-05-10T14:02:41.711900+0000","last_peered":"2024-05-10T14:02:41.711900+0000","last_clean":"2024-05-10T14:02:41.711900+0000","last_became_active":"2024-05-10T14:02:34.705604+0000","last_became_peered":"2024-05-10T14:02:34.705604+0000","last_unstale":"2024-05-10T14:02:41.711900+0000","last_undegraded":"2024-05-10T14:02:41.711900+0000","last_fullsized":"2024-05-10T14:02:41.711900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:54.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.615984+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:02:42.615984+0000","last_peered":"2024-05-10T14:02:42.615984+0000","last_clean":"2024-05-10T14:02:42.615984+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:02:42.615984+0000","last_undegraded":"2024-05-10T14:02:42.615984+0000","last_fullsized":"2024-05-10T14:02:42.615984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697748+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:02:41.697748+0000","last_peered":"2024-05-10T14:02:41.697748+0000","last_clean":"2024-05-10T14:02:41.697748+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:02:41.697748+0000","last_undegraded":"2024-05-10T14:02:41.697748+0000","last_fullsized":"2024-05-10T14:02:41.697748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701542+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:02:41.701542+0000","last_peered":"2024-05-10T14:02:41.701542+0000","last_clean":"2024-05-10T14:02:41.701542+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:02:41.701542+0000","last_undegraded":"2024-05-10T14:02:41.701542+0000","last_fullsized":"2024-05-10T14:02:41.701542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711364+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:02:41.711364+0000","last_peered":"2024-05-10T14:02:41.711364+0000","last_clean":"2024-05-10T14:02:41.711364+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:02:41.711364+0000","last_undegraded":"2024-05-10T14:02:41.711364+0000","last_fullsized":"2024-05-10T14:02:41.711364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724489+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:02:41.724489+0000","last_peered":"2024-05-10T14:02:41.724489+0000","last_clean":"2024-05-10T14:02:41.724489+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:02:41.724489+0000","last_undegraded":"2024-05-10T14:02:41.724489+0000","last_fullsized":"2024-05-10T14:02:41.724489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703395+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:02:41.703395+0000","last_peered":"2024-05-10T14:02:41.703395+0000","last_clean":"2024-05-10T14:02:41.703395+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:02:41.703395+0000","last_undegraded":"2024-05-10T14:02:41.703395+0000","last_fullsized":"2024-05-10T14:02:41.703395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.062529+0000","last_change":"2024-05-10T14:02:36.704252+0000","last_active":"2024-05-10T14:02:42.062529+0000","last_peered":"2024-05-10T14:02:42.062529+0000","last_clean":"2024-05-10T14:02:42.062529+0000","last_became_active":"2024-05-10T14:02:36.703671+0000","last_became_peered":"2024-05-10T14:02:36.703671+0000","last_unstale":"2024-05-10T14:02:42.062529+0000","last_undegraded":"2024-05-10T14:02:42.062529+0000","last_fullsized":"2024-05-10T14:02:42.062529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722127+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:02:41.722127+0000","last_peered":"2024-05-10T14:02:41.722127+0000","last_clean":"2024-05-10T14:02:41.722127+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:02:41.722127+0000","last_undegraded":"2024-05-10T14:02:41.722127+0000","last_fullsized":"2024-05-10T14:02:41.722127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701294+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:02:41.701294+0000","last_peered":"2024-05-10T14:02:41.701294+0000","last_clean":"2024-05-10T14:02:41.701294+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:02:41.701294+0000","last_undegraded":"2024-05-10T14:02:41.701294+0000","last_fullsized":"2024-05-10T14:02:41.701294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698376+0000","last_change":"2024-05-10T14:02:32.680541+0000","last_active":"2024-05-10T14:02:41.698376+0000","last_peered":"2024-05-10T14:02:41.698376+0000","last_clean":"2024-05-10T14:02:41.698376+0000","last_became_active":"2024-05-10T14:02:32.678843+0000","last_became_peered":"2024-05-10T14:02:32.678843+0000","last_unstale":"2024-05-10T14:02:41.698376+0000","last_undegraded":"2024-05-10T14:02:41.698376+0000","last_fullsized":"2024-05-10T14:02:41.698376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698953+0000","last_change":"2024-05-10T14:02:30.657936+0000","last_active":"2024-05-10T14:02:41.698953+0000","last_peered":"2024-05-10T14:02:41.698953+0000","last_clean":"2024-05-10T14:02:41.698953+0000","last_became_active":"2024-05-10T14:02:30.657176+0000","last_became_peered":"2024-05-10T14:02:30.657176+0000","last_unstale":"2024-05-10T14:02:41.698953+0000","last_undegraded":"2024-05-10T14:02:41.698953+0000","last_fullsized":"2024-05-10T14:02:41.698953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721331+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:02:41.721331+0000","last_peered":"2024-05-10T14:02:41.721331+0000","last_clean":"2024-05-10T14:02:41.721331+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:02:41.721331+0000","last_undegraded":"2024-05-10T14:02:41.721331+0000","last_fullsized":"2024-05-10T14:02:41.721331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.524300+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:02:42.524300+0000","last_peered":"2024-05-10T14:02:42.524300+0000","last_clean":"2024-05-10T14:02:42.524300+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:02:42.524300+0000","last_undegraded":"2024-05-10T14:02:42.524300+0000","last_fullsized":"2024-05-10T14:02:42.524300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728712+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:02:41.728712+0000","last_peered":"2024-05-10T14:02:41.728712+0000","last_clean":"2024-05-10T14:02:41.728712+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:02:41.728712+0000","last_undegraded":"2024-05-10T14:02:41.728712+0000","last_fullsized":"2024-05-10T14:02:41.728712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698161+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:41.698161+0000","last_peered":"2024-05-10T14:02:41.698161+0000","last_clean":"2024-05-10T14:02:41.698161+0000","last_became_active":"2024-05-10T14:02:40.733097+0000","last_became_peered":"2024-05-10T14:02:40.733097+0000","last_unstale":"2024-05-10T14:02:41.698161+0000","last_undegraded":"2024-05-10T14:02:41.698161+0000","last_fullsized":"2024-05-10T14:02:41.698161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698817+0000","last_change":"2024-05-10T14:02:32.676636+0000","last_active":"2024-05-10T14:02:41.698817+0000","last_peered":"2024-05-10T14:02:41.698817+0000","last_clean":"2024-05-10T14:02:41.698817+0000","last_became_active":"2024-05-10T14:02:32.673068+0000","last_became_peered":"2024-05-10T14:02:32.673068+0000","last_unstale":"2024-05-10T14:02:41.698817+0000","last_undegraded":"2024-05-10T14:02:41.698817+0000","last_fullsized":"2024-05-10T14:02:41.698817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702335+0000","last_change":"2024-05-10T14:02:30.664601+0000","last_active":"2024-05-10T14:02:41.702335+0000","last_peered":"2024-05-10T14:02:41.702335+0000","last_clean":"2024-05-10T14:02:41.702335+0000","last_became_active":"2024-05-10T14:02:30.664274+0000","last_became_peered":"2024-05-10T14:02:30.664274+0000","last_unstale":"2024-05-10T14:02:41.702335+0000","last_undegraded":"2024-05-10T14:02:41.702335+0000","last_fullsized":"2024-05-10T14:02:41.702335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728694+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:02:41.728694+0000","last_peered":"2024-05-10T14:02:41.728694+0000","last_clean":"2024-05-10T14:02:41.728694+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:02:41.728694+0000","last_undegraded":"2024-05-10T14:02:41.728694+0000","last_fullsized":"2024-05-10T14:02:41.728694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.297705+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:02:42.297705+0000","last_peered":"2024-05-10T14:02:42.297705+0000","last_clean":"2024-05-10T14:02:42.297705+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:02:42.297705+0000","last_undegraded":"2024-05-10T14:02:42.297705+0000","last_fullsized":"2024-05-10T14:02:42.297705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698631+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:02:41.698631+0000","last_peered":"2024-05-10T14:02:41.698631+0000","last_clean":"2024-05-10T14:02:41.698631+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:02:41.698631+0000","last_undegraded":"2024-05-10T14:02:41.698631+0000","last_fullsized":"2024-05-10T14:02:41.698631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730159+0000","last_change":"2024-05-10T14:02:32.684577+0000","last_active":"2024-05-10T14:02:41.730159+0000","last_peered":"2024-05-10T14:02:41.730159+0000","last_clean":"2024-05-10T14:02:41.730159+0000","last_became_active":"2024-05-10T14:02:32.683843+0000","last_became_peered":"2024-05-10T14:02:32.683843+0000","last_unstale":"2024-05-10T14:02:41.730159+0000","last_undegraded":"2024-05-10T14:02:41.730159+0000","last_fullsized":"2024-05-10T14:02:41.730159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699186+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:02:41.699186+0000","last_peered":"2024-05-10T14:02:41.699186+0000","last_clean":"2024-05-10T14:02:41.699186+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:02:41.699186+0000","last_undegraded":"2024-05-10T14:02:41.699186+0000","last_fullsized":"2024-05-10T14:02:41.699186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702459+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:02:41.702459+0000","last_peered":"2024-05-10T14:02:41.702459+0000","last_clean":"2024-05-10T14:02:41.702459+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:02:41.702459+0000","last_undegraded":"2024-05-10T14:02:41.702459+0000","last_fullsized":"2024-05-10T14:02:41.702459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.643679+0000","last_change":"2024-05-10T14:02:36.696412+0000","last_active":"2024-05-10T14:02:42.643679+0000","last_peered":"2024-05-10T14:02:42.643679+0000","last_clean":"2024-05-10T14:02:42.643679+0000","last_became_active":"2024-05-10T14:02:36.695516+0000","last_became_peered":"2024-05-10T14:02:36.695516+0000","last_unstale":"2024-05-10T14:02:42.643679+0000","last_undegraded":"2024-05-10T14:02:42.643679+0000","last_fullsized":"2024-05-10T14:02:42.643679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:24.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699411+0000","last_change":"2024-05-10T14:02:38.730974+0000","last_active":"2024-05-10T14:02:41.699411+0000","last_peered":"2024-05-10T14:02:41.699411+0000","last_clean":"2024-05-10T14:02:41.699411+0000","last_became_active":"2024-05-10T14:02:38.730309+0000","last_became_peered":"2024-05-10T14:02:38.730309+0000","last_unstale":"2024-05-10T14:02:41.699411+0000","last_undegraded":"2024-05-10T14:02:41.699411+0000","last_fullsized":"2024-05-10T14:02:41.699411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702742+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:02:41.702742+0000","last_peered":"2024-05-10T14:02:41.702742+0000","last_clean":"2024-05-10T14:02:41.702742+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:02:41.702742+0000","last_undegraded":"2024-05-10T14:02:41.702742+0000","last_fullsized":"2024-05-10T14:02:41.702742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702863+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:02:41.702863+0000","last_peered":"2024-05-10T14:02:41.702863+0000","last_clean":"2024-05-10T14:02:41.702863+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:02:41.702863+0000","last_undegraded":"2024-05-10T14:02:41.702863+0000","last_fullsized":"2024-05-10T14:02:41.702863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711216+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:02:41.711216+0000","last_peered":"2024-05-10T14:02:41.711216+0000","last_clean":"2024-05-10T14:02:41.711216+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:02:41.711216+0000","last_undegraded":"2024-05-10T14:02:41.711216+0000","last_fullsized":"2024-05-10T14:02:41.711216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729917+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:02:41.729917+0000","last_peered":"2024-05-10T14:02:41.729917+0000","last_clean":"2024-05-10T14:02:41.729917+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:02:41.729917+0000","last_undegraded":"2024-05-10T14:02:41.729917+0000","last_fullsized":"2024-05-10T14:02:41.729917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.425511+0000","last_change":"2024-05-10T14:02:36.699400+0000","last_active":"2024-05-10T14:02:42.425511+0000","last_peered":"2024-05-10T14:02:42.425511+0000","last_clean":"2024-05-10T14:02:42.425511+0000","last_became_active":"2024-05-10T14:02:36.698700+0000","last_became_peered":"2024-05-10T14:02:36.698700+0000","last_unstale":"2024-05-10T14:02:42.425511+0000","last_undegraded":"2024-05-10T14:02:42.425511+0000","last_fullsized":"2024-05-10T14:02:42.425511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713101+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:02:41.713101+0000","last_peered":"2024-05-10T14:02:41.713101+0000","last_clean":"2024-05-10T14:02:41.713101+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:02:41.713101+0000","last_undegraded":"2024-05-10T14:02:41.713101+0000","last_fullsized":"2024-05-10T14:02:41.713101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728942+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:02:41.728942+0000","last_peered":"2024-05-10T14:02:41.728942+0000","last_clean":"2024-05-10T14:02:41.728942+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:02:41.728942+0000","last_undegraded":"2024-05-10T14:02:41.728942+0000","last_fullsized":"2024-05-10T14:02:41.728942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698066+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:02:41.698066+0000","last_peered":"2024-05-10T14:02:41.698066+0000","last_clean":"2024-05-10T14:02:41.698066+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:02:41.698066+0000","last_undegraded":"2024-05-10T14:02:41.698066+0000","last_fullsized":"2024-05-10T14:02:41.698066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737405+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:02:41.737405+0000","last_peered":"2024-05-10T14:02:41.737405+0000","last_clean":"2024-05-10T14:02:41.737405+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:02:41.737405+0000","last_undegraded":"2024-05-10T14:02:41.737405+0000","last_fullsized":"2024-05-10T14:02:41.737405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737618+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:02:41.737618+0000","last_peered":"2024-05-10T14:02:41.737618+0000","last_clean":"2024-05-10T14:02:41.737618+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:02:41.737618+0000","last_undegraded":"2024-05-10T14:02:41.737618+0000","last_fullsized":"2024-05-10T14:02:41.737618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.622920+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:02:42.622920+0000","last_peered":"2024-05-10T14:02:42.622920+0000","last_clean":"2024-05-10T14:02:42.622920+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:02:42.622920+0000","last_undegraded":"2024-05-10T14:02:42.622920+0000","last_fullsized":"2024-05-10T14:02:42.622920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713066+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:02:41.713066+0000","last_peered":"2024-05-10T14:02:41.713066+0000","last_clean":"2024-05-10T14:02:41.713066+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:02:41.713066+0000","last_undegraded":"2024-05-10T14:02:41.713066+0000","last_fullsized":"2024-05-10T14:02:41.713066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697390+0000","last_change":"2024-05-10T14:02:40.733960+0000","last_active":"2024-05-10T14:02:41.697390+0000","last_peered":"2024-05-10T14:02:41.697390+0000","last_clean":"2024-05-10T14:02:41.697390+0000","last_became_active":"2024-05-10T14:02:40.733072+0000","last_became_peered":"2024-05-10T14:02:40.733072+0000","last_unstale":"2024-05-10T14:02:41.697390+0000","last_undegraded":"2024-05-10T14:02:41.697390+0000","last_fullsized":"2024-05-10T14:02:41.697390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750328+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:02:41.750328+0000","last_peered":"2024-05-10T14:02:41.750328+0000","last_clean":"2024-05-10T14:02:41.750328+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:02:41.750328+0000","last_undegraded":"2024-05-10T14:02:41.750328+0000","last_fullsized":"2024-05-10T14:02:41.750328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698531+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:02:41.698531+0000","last_peered":"2024-05-10T14:02:41.698531+0000","last_clean":"2024-05-10T14:02:41.698531+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:02:41.698531+0000","last_undegraded":"2024-05-10T14:02:41.698531+0000","last_fullsized":"2024-05-10T14:02:41.698531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713394+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:02:41.713394+0000","last_peered":"2024-05-10T14:02:41.713394+0000","last_clean":"2024-05-10T14:02:41.713394+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:02:41.713394+0000","last_undegraded":"2024-05-10T14:02:41.713394+0000","last_fullsized":"2024-05-10T14:02:41.713394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.602275+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:02:42.602275+0000","last_peered":"2024-05-10T14:02:42.602275+0000","last_clean":"2024-05-10T14:02:42.602275+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:02:42.602275+0000","last_undegraded":"2024-05-10T14:02:42.602275+0000","last_fullsized":"2024-05-10T14:02:42.602275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.118640+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:02:42.118640+0000","last_peered":"2024-05-10T14:02:42.118640+0000","last_clean":"2024-05-10T14:02:42.118640+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:02:42.118640+0000","last_undegraded":"2024-05-10T14:02:42.118640+0000","last_fullsized":"2024-05-10T14:02:42.118640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721606+0000","last_change":"2024-05-10T14:02:40.736838+0000","last_active":"2024-05-10T14:02:41.721606+0000","last_peered":"2024-05-10T14:02:41.721606+0000","last_clean":"2024-05-10T14:02:41.721606+0000","last_became_active":"2024-05-10T14:02:40.735991+0000","last_became_peered":"2024-05-10T14:02:40.735991+0000","last_unstale":"2024-05-10T14:02:41.721606+0000","last_undegraded":"2024-05-10T14:02:41.721606+0000","last_fullsized":"2024-05-10T14:02:41.721606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:22.716620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735870+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:02:41.735870+0000","last_peered":"2024-05-10T14:02:41.735870+0000","last_clean":"2024-05-10T14:02:41.735870+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:02:41.735870+0000","last_undegraded":"2024-05-10T14:02:41.735870+0000","last_fullsized":"2024-05-10T14:02:41.735870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699700+0000","last_change":"2024-05-10T14:02:30.661826+0000","last_active":"2024-05-10T14:02:41.699700+0000","last_peered":"2024-05-10T14:02:41.699700+0000","last_clean":"2024-05-10T14:02:41.699700+0000","last_became_active":"2024-05-10T14:02:30.660030+0000","last_became_peered":"2024-05-10T14:02:30.660030+0000","last_unstale":"2024-05-10T14:02:41.699700+0000","last_undegraded":"2024-05-10T14:02:41.699700+0000","last_fullsized":"2024-05-10T14:02:41.699700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721935+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:02:41.721935+0000","last_peered":"2024-05-10T14:02:41.721935+0000","last_clean":"2024-05-10T14:02:41.721935+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:02:41.721935+0000","last_undegraded":"2024-05-10T14:02:41.721935+0000","last_fullsized":"2024-05-10T14:02:41.721935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.637058+0000","last_change":"2024-05-10T14:02:36.701658+0000","last_active":"2024-05-10T14:02:42.637058+0000","last_peered":"2024-05-10T14:02:42.637058+0000","last_clean":"2024-05-10T14:02:42.637058+0000","last_became_active":"2024-05-10T14:02:36.700840+0000","last_became_peered":"2024-05-10T14:02:36.700840+0000","last_unstale":"2024-05-10T14:02:42.637058+0000","last_undegraded":"2024-05-10T14:02:42.637058+0000","last_fullsized":"2024-05-10T14:02:42.637058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697349+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:02:41.697349+0000","last_peered":"2024-05-10T14:02:41.697349+0000","last_clean":"2024-05-10T14:02:41.697349+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:02:41.697349+0000","last_undegraded":"2024-05-10T14:02:41.697349+0000","last_fullsized":"2024-05-10T14:02:41.697349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724285+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:02:41.724285+0000","last_peered":"2024-05-10T14:02:41.724285+0000","last_clean":"2024-05-10T14:02:41.724285+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:02:41.724285+0000","last_undegraded":"2024-05-10T14:02:41.724285+0000","last_fullsized":"2024-05-10T14:02:41.724285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.736624+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:02:41.736624+0000","last_peered":"2024-05-10T14:02:41.736624+0000","last_clean":"2024-05-10T14:02:41.736624+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:02:41.736624+0000","last_undegraded":"2024-05-10T14:02:41.736624+0000","last_fullsized":"2024-05-10T14:02:41.736624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699537+0000","last_change":"2024-05-10T14:02:30.660120+0000","last_active":"2024-05-10T14:02:41.699537+0000","last_peered":"2024-05-10T14:02:41.699537+0000","last_clean":"2024-05-10T14:02:41.699537+0000","last_became_active":"2024-05-10T14:02:30.658976+0000","last_became_peered":"2024-05-10T14:02:30.658976+0000","last_unstale":"2024-05-10T14:02:41.699537+0000","last_undegraded":"2024-05-10T14:02:41.699537+0000","last_fullsized":"2024-05-10T14:02:41.699537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697747+0000","last_change":"2024-05-10T14:02:34.700027+0000","last_active":"2024-05-10T14:02:41.697747+0000","last_peered":"2024-05-10T14:02:41.697747+0000","last_clean":"2024-05-10T14:02:41.697747+0000","last_became_active":"2024-05-10T14:02:34.699301+0000","last_became_peered":"2024-05-10T14:02:34.699301+0000","last_unstale":"2024-05-10T14:02:41.697747+0000","last_undegraded":"2024-05-10T14:02:41.697747+0000","last_fullsized":"2024-05-10T14:02:41.697747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:30:40.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.011841+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:02:42.011841+0000","last_peered":"2024-05-10T14:02:42.011841+0000","last_clean":"2024-05-10T14:02:42.011841+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:02:42.011841+0000","last_undegraded":"2024-05-10T14:02:42.011841+0000","last_fullsized":"2024-05-10T14:02:42.011841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728346+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:02:41.728346+0000","last_peered":"2024-05-10T14:02:41.728346+0000","last_clean":"2024-05-10T14:02:41.728346+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:02:41.728346+0000","last_undegraded":"2024-05-10T14:02:41.728346+0000","last_fullsized":"2024-05-10T14:02:41.728346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701980+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:02:41.701980+0000","last_peered":"2024-05-10T14:02:41.701980+0000","last_clean":"2024-05-10T14:02:41.701980+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:02:41.701980+0000","last_undegraded":"2024-05-10T14:02:41.701980+0000","last_fullsized":"2024-05-10T14:02:41.701980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698775+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:02:41.698775+0000","last_peered":"2024-05-10T14:02:41.698775+0000","last_clean":"2024-05-10T14:02:41.698775+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:02:41.698775+0000","last_undegraded":"2024-05-10T14:02:41.698775+0000","last_fullsized":"2024-05-10T14:02:41.698775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702270+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:02:41.702270+0000","last_peered":"2024-05-10T14:02:41.702270+0000","last_clean":"2024-05-10T14:02:41.702270+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:02:41.702270+0000","last_undegraded":"2024-05-10T14:02:41.702270+0000","last_fullsized":"2024-05-10T14:02:41.702270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.734981+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:02:41.734981+0000","last_peered":"2024-05-10T14:02:41.734981+0000","last_clean":"2024-05-10T14:02:41.734981+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:02:41.734981+0000","last_undegraded":"2024-05-10T14:02:41.734981+0000","last_fullsized":"2024-05-10T14:02:41.734981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.248998+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:02:42.248998+0000","last_peered":"2024-05-10T14:02:42.248998+0000","last_clean":"2024-05-10T14:02:42.248998+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:02:42.248998+0000","last_undegraded":"2024-05-10T14:02:42.248998+0000","last_fullsized":"2024-05-10T14:02:42.248998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735468+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:02:41.735468+0000","last_peered":"2024-05-10T14:02:41.735468+0000","last_clean":"2024-05-10T14:02:41.735468+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:02:41.735468+0000","last_undegraded":"2024-05-10T14:02:41.735468+0000","last_fullsized":"2024-05-10T14:02:41.735468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.723896+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:02:41.723896+0000","last_peered":"2024-05-10T14:02:41.723896+0000","last_clean":"2024-05-10T14:02:41.723896+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:02:41.723896+0000","last_undegraded":"2024-05-10T14:02:41.723896+0000","last_fullsized":"2024-05-10T14:02:41.723896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.735503+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:02:41.735503+0000","last_peered":"2024-05-10T14:02:41.735503+0000","last_clean":"2024-05-10T14:02:41.735503+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:02:41.735503+0000","last_undegraded":"2024-05-10T14:02:41.735503+0000","last_fullsized":"2024-05-10T14:02:41.735503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.702323+0000","last_change":"2024-05-10T14:02:30.664222+0000","last_active":"2024-05-10T14:02:41.702323+0000","last_peered":"2024-05-10T14:02:41.702323+0000","last_clean":"2024-05-10T14:02:41.702323+0000","last_became_active":"2024-05-10T14:02:30.663784+0000","last_became_peered":"2024-05-10T14:02:30.663784+0000","last_unstale":"2024-05-10T14:02:41.702323+0000","last_undegraded":"2024-05-10T14:02:41.702323+0000","last_fullsized":"2024-05-10T14:02:41.702323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.710218+0000","last_change":"2024-05-10T14:02:34.706054+0000","last_active":"2024-05-10T14:02:41.710218+0000","last_peered":"2024-05-10T14:02:41.710218+0000","last_clean":"2024-05-10T14:02:41.710218+0000","last_became_active":"2024-05-10T14:02:34.705486+0000","last_became_peered":"2024-05-10T14:02:34.705486+0000","last_unstale":"2024-05-10T14:02:41.710218+0000","last_undegraded":"2024-05-10T14:02:41.710218+0000","last_fullsized":"2024-05-10T14:02:41.710218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:05.822560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:42.319123+0000","last_change":"2024-05-10T14:02:36.695528+0000","last_active":"2024-05-10T14:02:42.319123+0000","last_peered":"2024-05-10T14:02:42.319123+0000","last_clean":"2024-05-10T14:02:42.319123+0000","last_became_active":"2024-05-10T14:02:36.694789+0000","last_became_peered":"2024-05-10T14:02:36.694789+0000","last_unstale":"2024-05-10T14:02:42.319123+0000","last_undegraded":"2024-05-10T14:02:42.319123+0000","last_fullsized":"2024-05-10T14:02:42.319123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698352+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:02:41.698352+0000","last_peered":"2024-05-10T14:02:41.698352+0000","last_clean":"2024-05-10T14:02:41.698352+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:02:41.698352+0000","last_undegraded":"2024-05-10T14:02:41.698352+0000","last_fullsized":"2024-05-10T14:02:41.698352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.738010+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:02:41.738010+0000","last_peered":"2024-05-10T14:02:41.738010+0000","last_clean":"2024-05-10T14:02:41.738010+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:02:41.738010+0000","last_undegraded":"2024-05-10T14:02:41.738010+0000","last_fullsized":"2024-05-10T14:02:41.738010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.714001+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:02:41.714001+0000","last_peered":"2024-05-10T14:02:41.714001+0000","last_clean":"2024-05-10T14:02:41.714001+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:02:41.714001+0000","last_undegraded":"2024-05-10T14:02:41.714001+0000","last_fullsized":"2024-05-10T14:02:41.714001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728201+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:02:41.728201+0000","last_peered":"2024-05-10T14:02:41.728201+0000","last_clean":"2024-05-10T14:02:41.728201+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:02:41.728201+0000","last_undegraded":"2024-05-10T14:02:41.728201+0000","last_fullsized":"2024-05-10T14:02:41.728201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713480+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:02:41.713480+0000","last_peered":"2024-05-10T14:02:41.713480+0000","last_clean":"2024-05-10T14:02:41.713480+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:02:41.713480+0000","last_undegraded":"2024-05-10T14:02:41.713480+0000","last_fullsized":"2024-05-10T14:02:41.713480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.749210+0000","last_change":"2024-05-10T14:02:30.663047+0000","last_active":"2024-05-10T14:02:41.749210+0000","last_peered":"2024-05-10T14:02:41.749210+0000","last_clean":"2024-05-10T14:02:41.749210+0000","last_became_active":"2024-05-10T14:02:30.662722+0000","last_became_peered":"2024-05-10T14:02:30.662722+0000","last_unstale":"2024-05-10T14:02:41.749210+0000","last_undegraded":"2024-05-10T14:02:41.749210+0000","last_fullsized":"2024-05-10T14:02:41.749210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698809+0000","last_change":"2024-05-10T14:02:32.685578+0000","last_active":"2024-05-10T14:02:41.698809+0000","last_peered":"2024-05-10T14:02:41.698809+0000","last_clean":"2024-05-10T14:02:41.698809+0000","last_became_active":"2024-05-10T14:02:32.682816+0000","last_became_peered":"2024-05-10T14:02:32.682816+0000","last_unstale":"2024-05-10T14:02:41.698809+0000","last_undegraded":"2024-05-10T14:02:41.698809+0000","last_fullsized":"2024-05-10T14:02:41.698809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698789+0000","last_change":"2024-05-10T14:02:30.667144+0000","last_active":"2024-05-10T14:02:41.698789+0000","last_peered":"2024-05-10T14:02:41.698789+0000","last_clean":"2024-05-10T14:02:41.698789+0000","last_became_active":"2024-05-10T14:02:30.666407+0000","last_became_peered":"2024-05-10T14:02:30.666407+0000","last_unstale":"2024-05-10T14:02:41.698789+0000","last_undegraded":"2024-05-10T14:02:41.698789+0000","last_fullsized":"2024-05-10T14:02:41.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711912+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:02:41.711912+0000","last_peered":"2024-05-10T14:02:41.711912+0000","last_clean":"2024-05-10T14:02:41.711912+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:02:41.711912+0000","last_undegraded":"2024-05-10T14:02:41.711912+0000","last_fullsized":"2024-05-10T14:02:41.711912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699037+0000","last_change":"2024-05-10T14:02:30.644592+0000","last_active":"2024-05-10T14:02:41.699037+0000","last_peered":"2024-05-10T14:02:41.699037+0000","last_clean":"2024-05-10T14:02:41.699037+0000","last_became_active":"2024-05-10T14:02:30.644241+0000","last_became_peered":"2024-05-10T14:02:30.644241+0000","last_unstale":"2024-05-10T14:02:41.699037+0000","last_undegraded":"2024-05-10T14:02:41.699037+0000","last_fullsized":"2024-05-10T14:02:41.699037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.703801+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:02:41.703801+0000","last_peered":"2024-05-10T14:02:41.703801+0000","last_clean":"2024-05-10T14:02:41.703801+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:02:41.703801+0000","last_undegraded":"2024-05-10T14:02:41.703801+0000","last_fullsized":"2024-05-10T14:02:41.703801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701248+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:02:41.701248+0000","last_peered":"2024-05-10T14:02:41.701248+0000","last_clean":"2024-05-10T14:02:41.701248+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:02:41.701248+0000","last_undegraded":"2024-05-10T14:02:41.701248+0000","last_fullsized":"2024-05-10T14:02:41.701248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737009+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:02:41.737009+0000","last_peered":"2024-05-10T14:02:41.737009+0000","last_clean":"2024-05-10T14:02:41.737009+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:02:41.737009+0000","last_undegraded":"2024-05-10T14:02:41.737009+0000","last_fullsized":"2024-05-10T14:02:41.737009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.713897+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:02:41.713897+0000","last_peered":"2024-05-10T14:02:41.713897+0000","last_clean":"2024-05-10T14:02:41.713897+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:02:41.713897+0000","last_undegraded":"2024-05-10T14:02:41.713897+0000","last_fullsized":"2024-05-10T14:02:41.713897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698106+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:02:41.698106+0000","last_peered":"2024-05-10T14:02:41.698106+0000","last_clean":"2024-05-10T14:02:41.698106+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:02:41.698106+0000","last_undegraded":"2024-05-10T14:02:41.698106+0000","last_fullsized":"2024-05-10T14:02:41.698106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.730874+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:02:41.730874+0000","last_peered":"2024-05-10T14:02:41.730874+0000","last_clean":"2024-05-10T14:02:41.730874+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:02:41.730874+0000","last_undegraded":"2024-05-10T14:02:41.730874+0000","last_fullsized":"2024-05-10T14:02:41.730874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.728100+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:02:41.728100+0000","last_peered":"2024-05-10T14:02:41.728100+0000","last_clean":"2024-05-10T14:02:41.728100+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:02:41.728100+0000","last_undegraded":"2024-05-10T14:02:41.728100+0000","last_fullsized":"2024-05-10T14:02:41.728100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699855+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:02:41.699855+0000","last_peered":"2024-05-10T14:02:41.699855+0000","last_clean":"2024-05-10T14:02:41.699855+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:02:41.699855+0000","last_undegraded":"2024-05-10T14:02:41.699855+0000","last_fullsized":"2024-05-10T14:02:41.699855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701992+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:02:41.701992+0000","last_peered":"2024-05-10T14:02:41.701992+0000","last_clean":"2024-05-10T14:02:41.701992+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:02:41.701992+0000","last_undegraded":"2024-05-10T14:02:41.701992+0000","last_fullsized":"2024-05-10T14:02:41.701992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697819+0000","last_change":"2024-05-10T14:02:30.656911+0000","last_active":"2024-05-10T14:02:41.697819+0000","last_peered":"2024-05-10T14:02:41.697819+0000","last_clean":"2024-05-10T14:02:41.697819+0000","last_became_active":"2024-05-10T14:02:30.650731+0000","last_became_peered":"2024-05-10T14:02:30.650731+0000","last_unstale":"2024-05-10T14:02:41.697819+0000","last_undegraded":"2024-05-10T14:02:41.697819+0000","last_fullsized":"2024-05-10T14:02:41.697819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.739226+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:02:41.739226+0000","last_peered":"2024-05-10T14:02:41.739226+0000","last_clean":"2024-05-10T14:02:41.739226+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:02:41.739226+0000","last_undegraded":"2024-05-10T14:02:41.739226+0000","last_fullsized":"2024-05-10T14:02:41.739226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699011+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:02:41.699011+0000","last_peered":"2024-05-10T14:02:41.699011+0000","last_clean":"2024-05-10T14:02:41.699011+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:02:41.699011+0000","last_undegraded":"2024-05-10T14:02:41.699011+0000","last_fullsized":"2024-05-10T14:02:41.699011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.750411+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:02:41.750411+0000","last_peered":"2024-05-10T14:02:41.750411+0000","last_clean":"2024-05-10T14:02:41.750411+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:02:41.750411+0000","last_undegraded":"2024-05-10T14:02:41.750411+0000","last_fullsized":"2024-05-10T14:02:41.750411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698469+0000","last_change":"2024-05-10T14:02:30.665295+0000","last_active":"2024-05-10T14:02:41.698469+0000","last_peered":"2024-05-10T14:02:41.698469+0000","last_clean":"2024-05-10T14:02:41.698469+0000","last_became_active":"2024-05-10T14:02:30.663923+0000","last_became_peered":"2024-05-10T14:02:30.663923+0000","last_unstale":"2024-05-10T14:02:41.698469+0000","last_undegraded":"2024-05-10T14:02:41.698469+0000","last_fullsized":"2024-05-10T14:02:41.698469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.737089+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:02:41.737089+0000","last_peered":"2024-05-10T14:02:41.737089+0000","last_clean":"2024-05-10T14:02:41.737089+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:02:41.737089+0000","last_undegraded":"2024-05-10T14:02:41.737089+0000","last_fullsized":"2024-05-10T14:02:41.737089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699577+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:02:41.699577+0000","last_peered":"2024-05-10T14:02:41.699577+0000","last_clean":"2024-05-10T14:02:41.699577+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:02:41.699577+0000","last_undegraded":"2024-05-10T14:02:41.699577+0000","last_fullsized":"2024-05-10T14:02:41.699577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.722734+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:02:41.722734+0000","last_peered":"2024-05-10T14:02:41.722734+0000","last_clean":"2024-05-10T14:02:41.722734+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:02:41.722734+0000","last_undegraded":"2024-05-10T14:02:41.722734+0000","last_fullsized":"2024-05-10T14:02:41.722734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.729679+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:02:41.729679+0000","last_peered":"2024-05-10T14:02:41.729679+0000","last_clean":"2024-05-10T14:02:41.729679+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:02:41.729679+0000","last_undegraded":"2024-05-10T14:02:41.729679+0000","last_fullsized":"2024-05-10T14:02:41.729679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698783+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:02:41.698783+0000","last_peered":"2024-05-10T14:02:41.698783+0000","last_clean":"2024-05-10T14:02:41.698783+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:02:41.698783+0000","last_undegraded":"2024-05-10T14:02:41.698783+0000","last_fullsized":"2024-05-10T14:02:41.698783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.724736+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:02:41.724736+0000","last_peered":"2024-05-10T14:02:41.724736+0000","last_clean":"2024-05-10T14:02:41.724736+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:02:41.724736+0000","last_undegraded":"2024-05-10T14:02:41.724736+0000","last_fullsized":"2024-05-10T14:02:41.724736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697836+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:02:41.697836+0000","last_peered":"2024-05-10T14:02:41.697836+0000","last_clean":"2024-05-10T14:02:41.697836+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:02:41.697836+0000","last_undegraded":"2024-05-10T14:02:41.697836+0000","last_fullsized":"2024-05-10T14:02:41.697836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.751331+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:02:41.751331+0000","last_peered":"2024-05-10T14:02:41.751331+0000","last_clean":"2024-05-10T14:02:41.751331+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:02:41.751331+0000","last_undegraded":"2024-05-10T14:02:41.751331+0000","last_fullsized":"2024-05-10T14:02:41.751331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.721797+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:02:41.721797+0000","last_peered":"2024-05-10T14:02:41.721797+0000","last_clean":"2024-05-10T14:02:41.721797+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:02:41.721797+0000","last_undegraded":"2024-05-10T14:02:41.721797+0000","last_fullsized":"2024-05-10T14:02:41.721797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.699414+0000","last_change":"2024-05-10T14:02:30.662908+0000","last_active":"2024-05-10T14:02:41.699414+0000","last_peered":"2024-05-10T14:02:41.699414+0000","last_clean":"2024-05-10T14:02:41.699414+0000","last_became_active":"2024-05-10T14:02:30.661976+0000","last_became_peered":"2024-05-10T14:02:30.661976+0000","last_unstale":"2024-05-10T14:02:41.699414+0000","last_undegraded":"2024-05-10T14:02:41.699414+0000","last_fullsized":"2024-05-10T14:02:41.699414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.697554+0000","last_change":"2024-05-10T14:02:30.667582+0000","last_active":"2024-05-10T14:02:41.697554+0000","last_peered":"2024-05-10T14:02:41.697554+0000","last_clean":"2024-05-10T14:02:41.697554+0000","last_became_active":"2024-05-10T14:02:30.657669+0000","last_became_peered":"2024-05-10T14:02:30.657669+0000","last_unstale":"2024-05-10T14:02:41.697554+0000","last_undegraded":"2024-05-10T14:02:41.697554+0000","last_fullsized":"2024-05-10T14:02:41.697554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.701979+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:02:41.701979+0000","last_peered":"2024-05-10T14:02:41.701979+0000","last_clean":"2024-05-10T14:02:41.701979+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:02:41.701979+0000","last_undegraded":"2024-05-10T14:02:41.701979+0000","last_fullsized":"2024-05-10T14:02:41.701979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.711040+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:02:41.711040+0000","last_peered":"2024-05-10T14:02:41.711040+0000","last_clean":"2024-05-10T14:02:41.711040+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:02:41.711040+0000","last_undegraded":"2024-05-10T14:02:41.711040+0000","last_fullsized":"2024-05-10T14:02:41.711040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T14:02:41.698744+0000","last_change":"2024-05-10T14:02:32.681773+0000","last_active":"2024-05-10T14:02:41.698744+0000","last_peered":"2024-05-10T14:02:41.698744+0000","last_clean":"2024-05-10T14:02:41.698744+0000","last_became_active":"2024-05-10T14:02:32.681013+0000","last_became_peered":"2024-05-10T14:02:32.681013+0000","last_unstale":"2024-05-10T14:02:41.698744+0000","last_undegraded":"2024-05-10T14:02:41.698744+0000","last_fullsized":"2024-05-10T14:02:41.698744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1028096,"data_stored":759905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":169313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":170698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":169368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":169273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":168439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":759747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":425984,"data_stored":169127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:49.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T14:02:49.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-10T14:02:49.401 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 35 2024-05-10T14:02:49.401 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9 2024-05-10T14:02:49.401 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-05-10T14:02:05.240552+0000 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-05-10T14:02:41.689265+0000 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:crush_version 5 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:full_ratio 0.95 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:backfillfull_ratio 0.9 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:nearfull_ratio 0.85 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:require_min_compat_client luminous 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:min_compat_client jewel 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:require_osd_release squid 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:stretch_mode_enabled false 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-10T14:02:49.402 INFO:teuthology.orchestra.run.smithi016.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 35 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:max_osd 8 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6824/3410152266,v1:172.21.15.16:6825/3410152266] [v2:172.21.15.16:6826/3410152266,v1:172.21.15.16:6827/3410152266] exists,up f64c785c-eaab-4e55-836b-580d80434ea8 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6800/54311254,v1:172.21.15.16:6801/54311254] [v2:172.21.15.16:6802/54311254,v1:172.21.15.16:6803/54311254] exists,up db35bdb1-1358-4158-9dc4-7ffac65632fa 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6816/2971206838,v1:172.21.15.16:6817/2971206838] [v2:172.21.15.16:6818/2971206838,v1:172.21.15.16:6819/2971206838] exists,up 28c46e2b-cef4-4688-956e-8da9955e626a 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6808/1375538686,v1:172.21.15.16:6809/1375538686] [v2:172.21.15.16:6810/1375538686,v1:172.21.15.16:6811/1375538686] exists,up 0032870c-d3a1-43dd-9fc9-b4091efab1eb 2024-05-10T14:02:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/2365858723,v1:172.21.15.130:6801/2365858723] [v2:172.21.15.130:6802/2365858723,v1:172.21.15.130:6804/2365858723] exists,up 2d515a59-3855-4fbe-a1e4-8c6296681688 2024-05-10T14:02:49.404 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/378234669,v1:172.21.15.130:6817/378234669] [v2:172.21.15.130:6818/378234669,v1:172.21.15.130:6819/378234669] exists,up 13696b08-e381-4169-8842-acf9b90c0025 2024-05-10T14:02:49.404 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/111783121,v1:172.21.15.130:6825/111783121] [v2:172.21.15.130:6826/111783121,v1:172.21.15.130:6827/111783121] exists,up 85508497-b5a2-42b4-88fb-10a4884bc5f4 2024-05-10T14:02:49.404 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6803/2943413119,v1:172.21.15.130:6805/2943413119] [v2:172.21.15.130:6807/2943413119,v1:172.21.15.130:6809/2943413119] exists,up c2edb963-9e6f-45d7-a4a8-27287ec42c40 2024-05-10T14:02:49.419 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6824/3410152266,v1:172.21.15.16:6825/3410152266] [v2:172.21.15.16:6826/3410152266,v1:172.21.15.16:6827/3410152266] exists,up f64c785c-eaab-4e55-836b-580d80434ea8', 'osd.1 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6800/54311254,v1:172.21.15.16:6801/54311254] [v2:172.21.15.16:6802/54311254,v1:172.21.15.16:6803/54311254] exists,up db35bdb1-1358-4158-9dc4-7ffac65632fa', 'osd.2 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6816/2971206838,v1:172.21.15.16:6817/2971206838] [v2:172.21.15.16:6818/2971206838,v1:172.21.15.16:6819/2971206838] exists,up 28c46e2b-cef4-4688-956e-8da9955e626a', 'osd.3 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6808/1375538686,v1:172.21.15.16:6809/1375538686] [v2:172.21.15.16:6810/1375538686,v1:172.21.15.16:6811/1375538686] exists,up 0032870c-d3a1-43dd-9fc9-b4091efab1eb', 'osd.4 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/2365858723,v1:172.21.15.130:6801/2365858723] [v2:172.21.15.130:6802/2365858723,v1:172.21.15.130:6804/2365858723] exists,up 2d515a59-3855-4fbe-a1e4-8c6296681688', 'osd.5 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/378234669,v1:172.21.15.130:6817/378234669] [v2:172.21.15.130:6818/378234669,v1:172.21.15.130:6819/378234669] exists,up 13696b08-e381-4169-8842-acf9b90c0025', 'osd.6 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/111783121,v1:172.21.15.130:6825/111783121] [v2:172.21.15.130:6826/111783121,v1:172.21.15.130:6827/111783121] exists,up 85508497-b5a2-42b4-88fb-10a4884bc5f4', 'osd.7 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6803/2943413119,v1:172.21.15.130:6805/2943413119] [v2:172.21.15.130:6807/2943413119,v1:172.21.15.130:6809/2943413119] exists,up c2edb963-9e6f-45d7-a4a8-27287ec42c40'] 2024-05-10T14:02:49.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mon.a", 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster": "ceph", 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "admin_socket_mode": "", 2024-05-10T14:02:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_client_required": "cephx, none", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_cluster_required": "cephx", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_debug": "true", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_service_required": "cephx", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_supported": "cephx", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio": "true", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_poll_ms": "250", 2024-05-10T14:02:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_reap_max": "16", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_async_discard_threads": "0", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_block_size": "4096", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio": "false", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_inflight_ios": "false", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_enable_discard": "false", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_flock_retry": "3", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_inject_crash": "0", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-10T14:02:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring_hipri": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_type": "", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_alloc_size": "1048576", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_allocator": "hybrid", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_buffered_io": "true", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_for_zeros": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-10T14:02:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_compact_log_sync": "false", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_max_log_runway": "4194304", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_max_prefetch": "1048576", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_min_flush_size": "524288", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_min_log_runway": "1048576", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_replay_recovery": "false", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-10T14:02:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_sync_write": "false", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_allocation_from_file": "true", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_allocator": "hybrid", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-10T14:02:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_create": "true", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_create": "false", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_path": "", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_size": "0", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_path": "", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_preallocate_file": "false", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_size": "107374182400", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_create": "false", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_path": "", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_size": "100663296", 2024-05-10T14:02:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs": "true", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_autotune": "true", 2024-05-10T14:02:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size": "0", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_type": "2q", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_clone_cow": "true", 2024-05-10T14:02:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_mode": "none", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_csum_type": "crc32c", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_freelist": "false", 2024-05-10T14:02:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-10T14:02:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_small_allocations": "0", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_default_buffered_read": "true", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_default_buffered_write": "false", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-10T14:02:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fail_eio": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mount": "false", 2024-05-10T14:02:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_umount": "false", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_ignore_data_csum": "false", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-10T14:02:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_op_age": "5.000000", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_alloc_size": "0", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size": "0", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_deferred_txc": "32", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size": "0", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-10T14:02:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_nid_prealloc": "1024", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_retry_disk_reads": "3", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_cf": "true", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-10T14:02:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_mem": "512", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_tracing": "false", 2024-05-10T14:02:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_zero_block_detection": "false", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-10T14:02:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_cluster_require_signatures": "false", 2024-05-10T14:02:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_cluster_require_version": "2", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_require_signatures": "false", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_require_version": "2", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_service_require_signatures": "false", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_service_require_version": "2", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_sign_messages": "true", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "chdir": "", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_acl_type": "", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_asio_thread_count": "2", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_cache_mid": "0.750000", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_cache_size": "16384", 2024-05-10T14:02:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_caps_release_delay": "5", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_check_pool_perm": "true", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_force_sync_read": "false", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_getattr_caps": "false", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_inject_features": "", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_inject_tick_delay": "0", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_die_on_failed_remount": "false", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_dirsize_rbytes": "true", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_force_lazyio": "false", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_fs": "", 2024-05-10T14:02:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_inject_release_failure": "false", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_max_inline_size": "4096", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mds_namespace": "", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_metadata": "", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_gid": "-1", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_timeout": "300", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_uid": "-1", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mountpoint": "/", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_notify_timeout": "10", 2024-05-10T14:02:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc": "true", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_dirty": "104857600", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_objects": "1000", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_size": "209715200", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_target_dirty": "8388608", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_permissions": "true", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_quota": "true", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_quota_df": "true", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_max_bytes": "0", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_max_periods": "4", 2024-05-10T14:02:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_min": "131072", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_reconnect_stale": "false", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_shutdown_timeout": "30", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_snapdir": ".snap", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_tick_interval": "1", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_trace": "", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_try_dentry_invalidate": "false", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_use_faked_inos": "false", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_use_random_mds": "false", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog": "false", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-10T14:02:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog_port": "12201", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_monitors": "default=true", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog": "false", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog_level": "info", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_addr": "-", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_network": "", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_network_interface": "", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_isal": "false", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_level": "5", 2024-05-10T14:02:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_winsize": "-15", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zstd_level": "1", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_alien_op_num_threads": "6", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_osd_stat_interval": "0", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_seastar_cpu_cores": "", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location": "", 2024-05-10T14:02:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location_hook": "", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location_hook_timeout": "10", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "daemonize": "false", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "daos_pool": "tank", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_alienstore": "0/5", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_allow_any_pool_priority": "false", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asok": "1/5", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asok_assert_abort": "false", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asserts_on_shutdown": "true", 2024-05-10T14:02:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_auth": "20/20", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bdev": "1/3", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bluefs": "1/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bluestore": "1/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_buffer": "0/1", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_ceph_dedup": "0/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_ceph_exporter": "1/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cephfs_mirror": "0/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cephsqlite": "0/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_client": "0/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_compressor": "1/5", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_context": "0/1", 2024-05-10T14:02:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crimson_interrupt": "0/5", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crush": "1/1", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crypto": "1/5", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cyanstore": "0/5", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_deliberately_leak_memory": "false", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_disable_randomized_ping": "false", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_dpdk": "1/5", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_eventtrace": "1/5", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_filer": "0/1", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_filestore": "1/3", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_finisher": "1/1", 2024-05-10T14:02:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_fuse": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_heartbeat_testing_span": "0", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_heartbeatmap": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_javaclient": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_journal": "1/3", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_journaler": "0/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_kstore": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_lockdep": "0/1", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mclock": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_balancer": "1/5", 2024-05-10T14:02:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_locker": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_log": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_log_expire": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_migrator": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_quiesce": "3/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_memstore": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mgr": "2/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mgrc": "1/5", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mon": "20/20", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_monc": "0/10", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_ms": "1/1", 2024-05-10T14:02:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_none": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objclass": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objectcacher": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objecter": "0/1", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_optracker": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_osd": "1/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_paxos": "20/20", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_perfcounter": "1/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_prioritycache": "1/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rados": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_mirror": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_pwl": "0/5", 2024-05-10T14:02:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_replay": "0/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_refs": "0/0", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_reserver": "1/1", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_access": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_datacache": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_dbstore": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_flight": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_notification": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_sync": "1/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rocksdb": "4/5", 2024-05-10T14:02:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_backref": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_cache": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_cleaner": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_device": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_epm": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_journal": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_lba": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_odata": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_omap": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_onode": "0/5", 2024-05-10T14:02:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_t": "0/5", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_tm": "0/5", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_striper": "0/1", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_test": "0/5", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_throttle": "1/1", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_timer": "0/1", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_tp": "0/5", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_trace": "1/5", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "device_failure_prediction_mode": "none", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-10T14:02:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_graylog": "false", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_journald": "false", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_stderr": "true", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_syslog": "false", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event_tracing": "false", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_addr": "0.0.0.0", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_http_port": "9926", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_prio_limit": "5", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_sort_metrics": "true", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_stats_period": "5", 2024-05-10T14:02:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "fake_statfs_for_testing": "0", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "fatal_signal_handlers": "true", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filer_max_purge_ops": "10", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filer_max_truncate_ops": "128", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_apply_finisher_threads": "1", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_blackhole": "false", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_btrfs_clone_range": "true", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_btrfs_snap": "true", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_caller_concurrency": "10", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_collect_device_partition_information": "true", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_commit_timeout": "600.000000", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_inject_read_err": "false", 2024-05-10T14:02:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_omap_check": "false", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_verify_split": "false", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_dump_file": "", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fadvise": "true", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fail_eio": "true", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fd_cache_shards": "16", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fd_cache_size": "128", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fiemap": "false", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fiemap_threshold": "4096", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-10T14:02:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_inject_stall": "0", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_parallel": "false", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_trailing": "false", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_writeahead": "false", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_kill_at": "0", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs": "0", 2024-05-10T14:02:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size": "0", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_merge_threshold": "-10", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_odsync_write": "false", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_backend": "rocksdb", 2024-05-10T14:02:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_backend_path": "", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_thread_timeout": "60", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_threads": "2", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_punch_hole": "false", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-10T14:02:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_ops": "50", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_seek_data_hole": "false", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_sloppy_crc": "false", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_splice": "false", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_split_multiple": "2", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_split_rand_factor": "20", 2024-05-10T14:02:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_update_to": "1000", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_enable": "true", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-10T14:02:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_xfs_extsize": "false", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_zfs_snap": "false", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fio_dir": "/tmp/fio", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fsid": "1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_allow_other": "true", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_atomic_o_trunc": "true", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_big_writes": "true", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_debug": "false", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_default_permissions": "false", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_disable_pagecache": "false", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_max_write": "0", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_multithreaded": "true", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_require_active_mds": "true", 2024-05-10T14:02:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_set_user_groups": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_move": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_read": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_write": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_use_invalidate_cb": "true", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "gss_target_name": "ceph", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_file": "", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_inject_failure": "0", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_interval": "5", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "host": "smithi016", 2024-05-10T14:02:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "inject_early_sigterm": "false", 2024-05-10T14:02:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "jaeger_agent_port": "6799", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "jaeger_tracing_enable": "false", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_aio": "true", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_align_min_size": "65536", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_block_align": "true", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_block_size": "4096", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_dio": "true", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_discard": "false", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_force_aio": "false", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_ignore_corruption": "false", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_max_write_bytes": "10485760", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_max_write_entries": "100", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_replay_from": "0", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-10T14:02:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_write_header_frequency": "0", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_zero_on_create": "false", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_prefetch_periods": "10", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_prezero_periods": "5", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_write_head_interval": "15", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "keyfile": "", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_backend": "rocksdb", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_default_stripe_size": "65536", 2024-05-10T14:02:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_fsck_on_mount": "false", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_max_bytes": "67108864", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_max_ops": "512", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_nid_prealloc": "1024", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_onode_map_size": "1024", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_sync_submit_transaction": "false", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_sync_transaction": "false", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "librados_thread_count": "2", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "lockdep": "false", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "lockdep_force_backtrace": "false", 2024-05-10T14:02:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "log_coarse_timestamps": "true", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_flush_on_exit": "false", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_graylog_host": "127.0.0.1", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_graylog_port": "12201", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_max_new": "1000", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_max_recent": "10000", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_stderr_prefix": "", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_stop_at_utilization": "0.970000", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": "true", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_graylog": "false", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_journald": "false", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_stderr": "false", 2024-05-10T14:02:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_syslog": "false", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "max_rotating_auth_attempts": "10", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_action_on_write_error": "1", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_alternate_name_max": "8192", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_asio_thread_count": "2", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_export_pin": "true", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_dirs": "true", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_interval": "5", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_interval": "10", 2024-05-10T14:02:49.588 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_max": "-1", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_max_until": "-1", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_merge_size": "50", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_midchunk": "0.300000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_min_start": "0.200000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_minchunk": "0.001000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_mode": "0", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_need_max": "1.200000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_need_min": "0.800000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_overload_epochs": "2", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-10T14:02:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_bits": "3", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_size": "10000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_target_decay": "10.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_grace": "15.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_interval": "4.000000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_mid": "0.700000", 2024-05-10T14:02:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_delay": "0", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_release_free_interval": "10", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_reservation": "0.050000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_interval": "1", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_threshold": "262144", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_prealloc_inos": "1000", 2024-05-10T14:02:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_connect_bootstrapping": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_damage_table_max_entries": "10000", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_auth_pins": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_frag": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_scatterstat": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_subtrees": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_decay_halflife": "5.000000", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_default_dir_hash": "2", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_defer_session_stale": "true", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_deny_all_reconnect": "false", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_keys_per_op": "16384", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_max_commit_size": "10", 2024-05-10T14:02:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_max_entries": "0", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_prefetch": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_on_map": "false", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_early_reply": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_enable_op_tracker": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_enforce_unique_name": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_random": "true", 2024-05-10T14:02:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_health_summarize_threshold": "10", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_health_dummy": "false", 2024-05-10T14:02:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_migrator_session_race": "false", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_join_fs": "", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_journal_format": "1", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_create_at": "0", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_export_at": "0", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_import_at": "0", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_at": "0", 2024-05-10T14:02:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_expire_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_replay_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_link_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_mdstable_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_openc_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_rename_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_shutdown_at": "0", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_event_large_threshold": "524288", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_events_per_segment": "1024", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_max_events": "-1", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_max_segments": "128", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_pause": "false", 2024-05-10T14:02:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_segment_size": "0", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_threshold": "128", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_warn_factor": "2.000000", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_caps_per_client": "1048576", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_completed_flushes": "100000", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_completed_requests": "100000", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_export_size": "20971520", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_file_recover": "32", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_files": "64", 2024-05-10T14:02:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_ops": "8192", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_snaps_per_dir": "100", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_metrics_update_interval": "2", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_min_caps_per_client": "100", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_min_caps_working_set": "10000", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_numa_node": "-1", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_complaint_time": "30.000000", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_duration": "600", 2024-05-10T14:02:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_size": "20", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_slow_op_size": "20", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_log_threshold": "5", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_ping_grace": "15", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_ping_interval": "5", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_caps": "30000", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-10T14:02:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_warning_threshold": "262144", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_replay_interval": "1.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_root_ino_gid": "0", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_root_ino_uid": "0", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-10T14:02:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_shutdown_check": "0", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_skip_ino": "0", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_max_uid": "4294967294", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_min_uid": "0", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_rstat": "false", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_standby_replay_damaged": "false", 2024-05-10T14:02:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_symlink_recovery": "true", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_thrash_exports": "0", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_thrash_fragments": "0", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_tick_interval": "5.000000", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_valgrind_exit": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_verify_backtrace": "1", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_verify_scatter": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_wipe_sessions": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool_debug": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_device_bytes": "1073741824", 2024-05-10T14:02:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_page_set": "false", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_page_size": "65536", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_bytes": "134217728", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_messages": "512", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_disabled_modules": "", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_enable_op_tracker": "true", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_max_pg_creating": "1024", 2024-05-10T14:02:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_max_pg_num_change": "128", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mds_bytes": "134217728", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mds_messages": "128", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mon_bytes": "134217728", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mon_messages": "128", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_num_op_tracker_shard": "32", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_complaint_time": "30.000000", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_history_duration": "600", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_history_size": "20", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_history_slow_op_size": "20", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-05-10T14:02:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_op_log_threshold": "5", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_osd_bytes": "536870912", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_osd_messages": "8192", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_pool": "true", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_standby_modules": "true", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_stats_period": "5", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_stats_threshold": "5", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_tick_period": "2", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_allow_pool_delete": "true", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_allow_pool_size_one": "true", 2024-05-10T14:02:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_auth_validate_all_caps": "true", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_bytes": "104857600", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_directed_command_retry": "2", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_parallel": "3", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_log_interval": "1.000000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-10T14:02:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_ping_interval": "10.000000", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_target_rank": "-1", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_level": "debug", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_file": "true", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_journald": "false", 2024-05-10T14:02:49.607 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_bootstrap": "false", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_start": "false", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_trim": "true", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cpu_threads": "4", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_crush_min_required_version": "hammer", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_daemon_bytes": "419430400", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-10T14:02:49.608 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_avail_crit": "5", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_avail_warn": "5", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_size_warn": "16106127360", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_json": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_transactions": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_extra_checks": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_reef": "false", 2024-05-10T14:02:49.609 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_squid": "false", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_down_mkfs_grace": "120", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_down_uptime_grace": "60", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_election_default_strategy": "1", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_election_timeout": "5.000000", 2024-05-10T14:02:49.610 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ping_divisor": "2", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_enable_op_tracker": "true", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_fake_pool_delete": "false", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_force_quorum_join": "false", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_globalid_prealloc": "10000", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_detail_to_clog": "false", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_log_update_period": "5", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_max_detail": "50", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog": "true", 2024-05-10T14:02:49.611 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog_interval": "600", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_host": "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.130", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_host_override": "", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_initial_members": "", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease": "5.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-10T14:02:49.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_full_interval": "50", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_max": "10000", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_max_summary": "50", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_log_epochs": "500", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_osd": "10000", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_pg_per_osd": "10000", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_pool_pg_num": "65536", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-10T14:02:49.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_force_trim_to": "0", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_skip_sanity": "false", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_memory_autotune": "true", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_memory_target": "2147483648", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_beacon_grace": "30", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_digest_period": "5", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_inactive_grace": "60", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_min_osdmap_epochs": "500", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_complaint_time": "30", 2024-05-10T14:02:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_duration": "600", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_size": "20", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_slow_op_size": "20", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_log_threshold": "5", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_in": "false", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_cache_size": "500", 2024-05-10T14:02:49.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_down_out_interval": "600", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_force_trim_to": "0", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-10T14:02:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_down_reporters": "2", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_report_timeout": "900", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-10T14:02:49.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_stuck_threshold": "60", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-10T14:02:49.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_probe_timeout": "2.000000", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_max_change": "0.050000", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_max_osds": "4", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_interval": "86400", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_max_keys": "100", 2024-05-10T14:02:49.619 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_timeout": "300", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_session_timeout": "300", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_smart_report_timeout": "5", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stat_smooth_intervals": "6", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_pool_min_size": "2", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_pool_size": "4", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_debug": "false", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-10T14:02:49.620 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_provider_kill_at": "0", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_requester_kill_at": "0", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_timeout": "60.000000", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_target_pg_per_osd": "100", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_tick_interval": "5", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_timecheck_interval": "300.000000", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_use_min_delay_socket": "false", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_older_version_delay": "604800", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-10T14:02:49.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_misplaced": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_older_version": "true", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-10T14:02:49.622 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "monmap": "", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_tracing_enabled": "false", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_op_threads": "3", 2024-05-10T14:02:49.623 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_cm": "false", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_device_name": "", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_dscp": "96", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_local_gid": "", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_port_num": "1", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-10T14:02:49.624 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_sl": "3", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_support_srq": "true", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_type": "ib", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_reap_threshold": "5", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_before_connect": "false", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_ipv4": "true", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_ipv6": "false", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_msgr1": "true", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_msgr2": "true", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_port_max": "7568", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_port_min": "6800", 2024-05-10T14:02:49.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_retry_count": "3", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_retry_delay": "5", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_client": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mds": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mgr": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mon": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_osd": "false", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_client_mode": "crc secure", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_cluster_mode": "crc secure", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_cluster_type": "", 2024-05-10T14:02:49.626 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_compress_secure": "false", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_connection_idle_timeout": "900", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_connection_ready_timeout": "10", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_crc_data": "true", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_crc_header": "true", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_bad_msg": "false", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_bug": "true", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_old_message": "true", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_skipped_message": "false", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_coremask": "0xF", 2024-05-10T14:02:49.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_enable_tso": "true", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hugepages": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_lro": "true", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_memory_channel": "4", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_pmd": "", 2024-05-10T14:02:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_port_id": "0", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dump_on_send": "false", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_initial_backoff": "0.200000", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_max": "1.000000", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_type": "", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_network_congestion": "0", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_socket_failures": "0", 2024-05-10T14:02:49.629 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_learn_addr_from_peer": "true", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_max_accept_failures": "4", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_max_backoff": "15.000000", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_client_mode": "secure crc", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_service_mode": "secure crc", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compress_min_size": "1024", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compress_mode": "none", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_pq_min_cost": "65536", 2024-05-10T14:02:49.630 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_public_type": "", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_service_mode": "crc secure", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_listen_backlog": "512", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_nodelay": "true", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_rcvbuf": "0", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_type": "async+posix", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "no_config_file": "false", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_completion_locks_per_session": "32", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inflight_ops": "1024", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-10T14:02:49.631 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_tick_interval": "5.000000", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_timeout": "10.000000", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "objectstore_blackhole": "false", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "openssl_engine_opts": "", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_delay_time": "5.000000", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_hist_halflife": "1000", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_max_low_ops": "2", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_max_ops": "4", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-10T14:02:49.632 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_slop": "0.020000", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_asio_thread_count": "2", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_async_recovery_min_cost": "100", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_scan_max": "512", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_scan_min": "64", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_degraded": "false", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_peering": "false", 2024-05-10T14:02:49.633 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_unfound": "true", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_beacon_report_interval": "300", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_duration": "30", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_max_block_size": "67108864", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_blkin_trace_all": "false", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-10T14:02:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_check_for_log_corruption": "false", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_update_on_start": "true", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_message_cap": "256", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_message_size_cap": "524288000", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_op_priority": "63", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_watch_timeout": "30", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_command_max_records": "256", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_compact_on_start": "false", 2024-05-10T14:02:49.635 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_update_on_start": "true", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_update_weight_set": "true", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_feed_pullee": "-1", 2024-05-10T14:02:49.636 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_misdirected_ops": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_no_acting_change": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_no_purge_strays": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_op_order": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-10T14:02:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_shutdown": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_trim_objects": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_snaps": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_keys": "1024", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-10T14:02:49.638 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_stride": "524288", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_default_notify_timeout": "30", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep": "0.000000", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_discard_disconnected_ops": "true", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_enable_op_tracker": "true", 2024-05-10T14:02:49.639 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_info": "true", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown": "true", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_function_tracing": "false", 2024-05-10T14:02:49.640 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_grace": "20", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_interval": "6", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_peers": "10", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_size": "2000", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_stale": "600", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_max_size": "100000", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_min_size": "1000", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-10T14:02:49.641 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal_size": "5120", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_kill_backfill_at": "0", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_cache_size": "50", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_dedup": "true", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_message_max": "40", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-10T14:02:49.642 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_share_max_epochs": "40", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_attr_name_len": "100", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_attr_size": "0", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_backfills": "1", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_markdown_count": "5", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_markdown_period": "600", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_name_len": "2048", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_namespace_len": "256", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_size": "134217728", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_blocked_by": "16", 2024-05-10T14:02:49.643 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_log_entries": "10000", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pgls": "1024", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_push_cost": "8388608", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_push_objects": "10", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_scrubs": "3", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_trimming_pgs": "2", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_write_op_reply_len": "64", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_write_size": "90", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-10T14:02:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_profile": "balanced", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-10T14:02:49.645 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_base": "805306368", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_cache_min": "134217728", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-10T14:02:49.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target": "4294967296", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target_autotune": "false", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_min_pg_log_entries": "250", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_min_recovery_priority": "0", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_report_interval": "5", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-10T14:02:49.647 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_num_cache_shards": "32", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_num_op_tracker_shard": "32", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_auto_affinity": "true", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_node": "-1", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_prefer_iface": "true", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objecter_finishers": "1", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore": "bluestore", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore_fuse": "false", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore_tracing": "false", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_complaint_time": "30.000000", 2024-05-10T14:02:49.648 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_duration": "600", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_size": "20", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_slow_op_size": "20", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_log_threshold": "5", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards": "0", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards_hdd": "5", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards_ssd": "8", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-10T14:02:49.649 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_pq_min_cost": "65536", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_queue_cut_off": "high", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_thread_timeout": "15", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_open_classes_on_start": "true", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_os_flags": "0", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_peering_op_priority": "255", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_delete_cost": "1048576", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_delete_priority": "5", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-10T14:02:49.650 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_trim_max": "10000", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_trim_min": "100", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-10T14:02:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_crimson": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-10T14:02:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flags": "0", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_min_size": "0", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pg_num": "32", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pgp_num": "0", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_read_ratio": "70", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_size": "2", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_type": "replicated", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_push_per_object_cost": "1000", 2024-05-10T14:02:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recover_clone_overlap": "true", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_cost": "20971520", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active": "0", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_single_start": "1", 2024-05-10T14:02:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_op_priority": "3", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_priority": "5", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep": "0.000000", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_repair_during_recovery": "false", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_requested_scrub_priority": "120", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_auto_repair": "false", 2024-05-10T14:02:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_begin_hour": "0", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_begin_week_day": "0", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_chunk_max": "25", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_chunk_min": "5", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_cost": "52428800", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_during_recovery": "false", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_end_hour": "0", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_end_week_day": "0", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_event_cost": "4096", 2024-05-10T14:02:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_invalid_stats": "true", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_max_preemptions": "5", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_priority": "5", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_reservation_timeout": "300000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_sleep": "0.000000", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-10T14:02:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_skip_data_digest": "false", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_smart_report_timeout": "5", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_cost": "1048576", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_priority": "5", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-10T14:02:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_target_transaction_size": "30", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-10T14:02:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tracing": "false", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_use_stale_snap": "false", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "osdc_blkin_trace_all": "false", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_kill_at": "0", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_max_join_drift": "10", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_min": "500", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_min_wait": "0.050000", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_propose_interval": "1.000000", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_max": "500", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_min": "250", 2024-05-10T14:02:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_stash_full_interval": "25", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_trim_max": "500", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_trim_min": "250", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "perf": "true", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "public_addr": "-", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "public_addrv": "", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "public_bind_addr": "-", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "public_network": "", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "public_network_interface": "", 2024-05-10T14:02:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: "qat_compressor_enabled": "false", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "qat_compressor_session_max_number": "256", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_mon_op_timeout": "0", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_osd_op_timeout": "0", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_tracing": "false", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_atime_update_interval": "60", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_balance_parent_reads": "false", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_balance_snap_reads": "false", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blkin_trace_all": "false", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-10T14:02:49.662 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache": "true", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_policy": "writearound", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_size": "33554432", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_clone_copy_on_read": "false", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_compression_hint": "none", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_concurrent_management_ops": "10", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-10T14:02:49.663 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_clone_format": "auto", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_data_pool": "", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_features": "61", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_format": "2", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_map_options": "", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_order": "22", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_pool": "rbd", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_stripe_count": "0", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_stripe_unit": "0", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-10T14:02:49.664 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_enable_alloc_hint": "true", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_io_scheduler": "simple", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-10T14:02:49.665 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_order": "24", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_pool": "", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_splay_width": "4", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_localize_parent_reads": "false", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_localize_snap_reads": "false", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-10T14:02:49.666 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-10T14:02:49.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mtime_update_interval": "60", 2024-05-10T14:02:49.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_non_blocking_aio": "true", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_op_thread_timeout": "60", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_op_threads": "1", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_parent_cache_enabled": "false", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_plugins": "", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_burst": "0", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_limit": "0", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_exclude_ops": "0", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_burst": "0", 2024-05-10T14:02:49.669 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_limit": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-10T14:02:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_read_from_replica_policy": "default", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_skip_partial_discard": "true", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_tracing": "false", 2024-05-10T14:02:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_validate_names": "true", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_validate_pool": "true", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "restapi_base_url": "", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "restapi_log_level": "", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_acl_grants_max_num": "100", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_admin_entry": "admin", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_backend_store": "rados", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_barbican_url": "", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_beast_enable_async": "true", 2024-05-10T14:02:49.672 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_counters_cache": "false", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_enabled": "true", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_expiry_interval": "900", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_lru_size": "25000", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_config_store": "rados", 2024-05-10T14:02:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_content_length_compat": "false", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_copy_obj_progress": "true", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cors_rules_max_num": "100", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cross_domain_policy": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_addr": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_password": "", 2024-05-10T14:02:49.674 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_username": "", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_require_ssl": "true", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-10T14:02:49.675 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_addr": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_auth": "token", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_namespace": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_prefix": "", 2024-05-10T14:02:49.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_token_file": "", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_buffersize": "524288", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_low_speed_time": "300", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-10T14:02:49.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_l1_fadvise": "4", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-05-10T14:02:49.678 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_port": "6379", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_changes_size": "1000", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_num_shards": "128", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_window": "30", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-10T14:02:49.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-10T14:02:49.680 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dns_name": "", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dns_s3website_name": "", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dynamic_resharding": "true", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_gc_threads": "true", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_lc_threads": "true", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_ops_log": "false", 2024-05-10T14:02:49.681 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_quota_threads": "true", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_static_website": "false", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_usage_log": "false", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enforce_swift_acls": "true", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_exit_timeout_secs": "120", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_expose_bucket": "false", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_extended_http_attrs": "", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_filter": "none", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_frontends": "beast port=7480", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_deferred": "50", 2024-05-10T14:02:49.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_objs": "32", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_processor_period": "3600", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_init_timeout": "300", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-10T14:02:49.683 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_connection_idle": "300", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_domain": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_password": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_password_path": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_project": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_tenant": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_token": "", 2024-05-10T14:02:49.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_token_path": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_user": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_api_version": "2", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_domain": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_password": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_project": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_user": "", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-10T14:02:49.685 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_url": "", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_debug_interval": "-1", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_lock_max_time": "90", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_objs": "32", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_rules": "1000", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_worker": "3", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_thread_delay": "0", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_dnattr": "uid", 2024-05-10T14:02:49.686 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_searchfilter": "", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_uri": "", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lfuda_sync_frequency": "60", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_http_headers": "", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_object_name_utc": "false", 2024-05-10T14:02:49.687 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attr_name_len": "0", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attr_size": "0", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_chunk_size": "4194304", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_listing_results": "1000", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_notify_retries": "10", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_put_param_size": "1048576", 2024-05-10T14:02:49.688 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_put_size": "5368709120", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_slo_entries": "1000", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_md_log_max_shards": "64", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_mp_lock_max_time": "600", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-10T14:02:49.689 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_max_gc": "300", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-10T14:02:49.690 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_num_async_rados_threads": "32", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_num_control_oids": "8", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_numa_node": "-1", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_chunk_size": "100", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_gc_interval": "600", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_thread_timeout": "600", 2024-05-10T14:02:49.691 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_tracing": "false", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_token": "", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_url": "", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_verify_ssl": "true", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_rados": "false", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_socket_path": "", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_push_interval": "2.000000", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-10T14:02:49.692 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_lanes": "3", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_partitions": "3", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_print_continue": "true", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-10T14:02:49.693 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_tracing": "false", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm": "", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm_id": "", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_region": "", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_request_uri": "", 2024-05-10T14:02:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_batch_size": "64", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_max_aio": "128", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_num_logs": "16", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_thread_interval": "600", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_resolve_cname": "false", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_run_sync_thread": "true", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-10T14:02:49.695 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_scheduler_type": "throttler", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_script_uri": "", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_service_provider_name": "", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_client_id": "", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_client_secret": "", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_entry": "sts", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_key": "sts", 2024-05-10T14:02:49.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_min_session_duration": "900", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_token_introspection_url": "", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_account_in_url": "false", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_auth_entry": "auth", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_auth_url": "", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_custom_header": "", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_need_stats": "true", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_tenant_name": "", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_token_expiration": "86400", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_url": "", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_url_prefix": "swift", 2024-05-10T14:02:49.697 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_lease_period": "120", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-10T14:02:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_thread_pool_size": "512", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_comment": "", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_createby": "", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_encoding": "", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_flag": "false", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_origin": "", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-10T14:02:49.699 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_tracker": "", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_trust_forwarded_https": "false", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_max_shards": "32", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_max_user_shards": "1", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_use_opa_authz": "false", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_counters_cache": "false", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_max_buckets": "1000", 2024-05-10T14:02:49.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_policies_max_num": "100", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_unique_email": "true", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_verify_ssl": "true", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone": "", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone_id": "", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup": "", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup_id": "", 2024-05-10T14:02:49.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rgwlc_auto_session_clear": "true", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_block_size": "4096", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_size": "536870912", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-10T14:02:49.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_index_type": "binary_search", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_partition_filters": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_perf": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-10T14:02:49.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "run_dir": "/var/run/ceph", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_block_create": "true", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_cache_lru_size": "67108864", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_default_max_object_size": "16777216", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_device_size": "53687091200", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_full_integrity_check": "false", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_capacity": "16", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-10T14:02:49.704 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_main_device_type": "SSD", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_max_data_allocation_size": "32768", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_segment_size": "67108864", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "set_keepcaps": "false", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "setgroup": "", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "setuser": "", 2024-05-10T14:02:49.705 INFO:teuthology.orchestra.run.smithi016.stdout: "setuser_match_path": "", 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout: "thp": "false", 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout: "threadpool_default_timeout": "60", 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout: "throttler_perf_counter": "true" 2024-05-10T14:02:49.706 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:49.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-10T14:02:49.856 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a: {} 2024-05-10T14:02:49.856 INFO:teuthology.orchestra.run.smithi016.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:02:49.869 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b: {} 2024-05-10T14:02:49.869 INFO:teuthology.orchestra.run.smithi016.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:02:49.878 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c: {} 2024-05-10T14:02:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:02:49.895 DEBUG:teuthology.orchestra.run.smithi130:> type ceph-objectstore-tool 2024-05-10T14:02:49.902 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-10T14:02:49.902 DEBUG:teuthology.orchestra.run.smithi016:> type ceph-objectstore-tool 2024-05-10T14:02:49.907 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-10T14:02:49.908 INFO:teuthology.run_tasks:Running task workunit... 2024-05-10T14:02:50.002 INFO:tasks.workunit:Pulling workunits from ref 7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T14:02:50.002 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T14:02:50.003 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-10T14:02:50.003 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-10T14:02:50.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T14:02:50.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T14:02:50.004 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-10T14:02:50.004 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-10T14:02:50.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:02:50.005 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-10T14:02:50.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:02:50.005 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-10T14:02:50.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:02:50.007 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:50.003+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:50.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:02:50.014 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T14:02:50.014 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-10T14:02:50.060 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-10T14:02:50.061 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-10T14:02:50.108 INFO:tasks.workunit:timeout=3h 2024-05-10T14:02:50.108 INFO:tasks.workunit:cleanup=True 2024-05-10T14:02:50.108 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:50.108+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:50.109 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7ef97a7233c4db41f8dc134b8d64f95427147ce5 2024-05-10T14:02:50.155 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-10T14:02:50.170 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:02:50.170 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:02:50.198 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.198 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.201 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:02:50.202 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:02:50.206 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:50.203+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:50.216 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:02:50.237 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:02:50.238 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:02:50.271 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:02:50.272 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:02:50.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:02:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:02:50.307 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:50.303+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:50.342 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:02:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:02:50.363 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:02:50.364 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:02:50.378 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.378 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:02:50.398 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:02:50.398 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:02:50.408 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:50.403+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:50.508 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.508 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.508 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:50.507+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:50.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:02:50.610 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:50.607+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:50.641 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.641 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:02:50.710 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:50.707+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:50.780 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.780 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:02:50.811 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:50.811+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:50.913 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:50.911+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:50.917 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:50.917 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:50.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:02:51.013 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:51.011+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:51.043 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.044 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:02:51.114 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:51.112+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:02:51.216 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:51.211+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:51.294 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T14:02:51.301 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:02:51.316 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:51.315+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:51.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T14:02:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:02:51.418 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:51.415+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:51.518 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:51.516+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:51.550 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.550 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:02:51.619 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:51.615+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:51.720 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.720 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.721 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:51.723+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:51.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:02:51.822 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:51.820+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:51.862 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:51.863 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:51.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:02:51.923 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:51.924+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:52.008 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:52.008 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:52.022 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:02:52.024 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:52.024+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:52.125 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:52.124+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:52.139 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:52.139 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:52.154 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:02:52.226 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:52.223+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:52.270 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:52.271 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:52.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:02:52.298 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T14:02:52.327 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T14:02:52.328 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:52.327+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:52.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:02:52.428 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:52.423+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:52.449 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:52.449 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:52.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:02:52.548 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:52.547+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:52.571 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:02:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:02:52.587 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:02:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:02:52.604 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:02:52.605 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:02:52.622 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:02:52.622 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:02:52.627 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:52.627 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:52.628 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:52.628+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:52.640 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:02:52.641 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:02:52.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:02:52.660 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:02:52.660 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:02:52.678 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:02:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:02:52.698 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:02:52.698 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:02:52.729 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:52.727+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.808 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:36 5.f 5:f6e9d2a7:::zone_info.56a333c7-a2aa-41a4-b131-d865107faf91:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 18.073256812, 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046943899999999997, 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 36 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.809 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733166+0000", 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.542e-06 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733181+0000", 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4759999999999999e-05 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733208+0000", 2024-05-10T14:02:52.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6936000000000001e-05 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733220+0000", 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2473999999999999e-05 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733324+0000", 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000103991 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733555+0000", 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023090799999999999 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733859+0000", 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030390799999999998 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.736067+0000", 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002207592 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737685+0000", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00161849 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737783+0000", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7511999999999997e-05 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737858+0000", 2024-05-10T14:02:52.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5277000000000004e-05 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 18.068323894999999, 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031607850000000002, 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 37 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738098+0000", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8819999999999999e-06 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738109+0000", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1106e-05 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738143+0000", 2024-05-10T14:02:52.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3871000000000001e-05 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738158+0000", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4843e-05 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738264+0000", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010608 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738492+0000", 2024-05-10T14:02:52.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022791900000000001 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738769+0000", 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027644699999999998 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.740068+0000", 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001299555 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741105+0000", 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001036936 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741194+0000", 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9293e-05 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741257+0000", 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2853000000000003e-05 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 18.058721059, 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0047966040000000003, 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 41 2024-05-10T14:02:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747701+0000", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9829999999999999e-06 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747728+0000", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6508000000000001e-05 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747755+0000", 2024-05-10T14:02:52.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7063000000000002e-05 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747769+0000", 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747902+0000", 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013363700000000001 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.748126+0000", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022359100000000001 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.748401+0000", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027477099999999999 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.750668+0000", 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002267425 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752344+0000", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016753930000000001 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752431+0000", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7462999999999999e-05 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752496+0000", 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4899000000000003e-05 2024-05-10T14:02:52.826 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.080625447999999, 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0049797349999999999, 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725799+0000", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6370000000000001e-06 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725810+0000", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1508000000000001e-05 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725840+0000", 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0162999999999999e-05 2024-05-10T14:02:52.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725861+0000", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0996999999999999e-05 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726037+0000", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017551900000000001 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726318+0000", 2024-05-10T14:02:52.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028131199999999998 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726525+0000", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020658100000000001 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729328+0000", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0028037800000000001 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730487+0000", 2024-05-10T14:02:52.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001158353 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730628+0000", 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140739 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730775+0000", 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014714599999999999 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206011500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.07531228, 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037362839999999999, 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731111+0000", 2024-05-10T14:02:52.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4310000000000001e-06 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731124+0000", 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3016999999999999e-05 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731161+0000", 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7085999999999997e-05 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731249+0000", 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8412000000000007e-05 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731371+0000", 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012229999999999999 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731617+0000", 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024537199999999999 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.732021+0000", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040421400000000002 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.733406+0000", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013851009999999999 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734638+0000", 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001232213 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734727+0000", 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9012999999999996e-05 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734844+0000", 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117125 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.101240449000001, 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041925790000000001, 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 205 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705183+0000", 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8760000000000001e-06 2024-05-10T14:02:52.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705196+0000", 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.346e-05 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705229+0000", 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2750000000000003e-05 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705247+0000", 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7578999999999999e-05 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705483+0000", 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000236219 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705766+0000", 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028311699999999999 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.706180+0000", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041408100000000001 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.707856+0000", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016755819999999999 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709170+0000", 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001314003 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709258+0000", 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8399999999999994e-05 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709373+0000", 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114512 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.844 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.035351792, 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031391710000000001, 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 220 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771072+0000", 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.207e-06 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771084+0000", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1806e-05 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771116+0000", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2036999999999998e-05 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771136+0000", 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0285999999999999e-05 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771240+0000", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010362899999999999 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771444+0000", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204639 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771864+0000", 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00042004299999999999 2024-05-10T14:02:52.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.773196+0000", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001332092 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774045+0000", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00084898700000000005 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774140+0000", 2024-05-10T14:02:52.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4869000000000003e-05 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774208+0000", 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7576000000000005e-05 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.024652511999999, 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032168169999999999, 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 223 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781770+0000", 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781782+0000", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1426e-05 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781814+0000", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2073000000000003e-05 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781838+0000", 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4680000000000001e-05 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782023+0000", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018493200000000001 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782243+0000", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000219805 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782651+0000", 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000408427 2024-05-10T14:02:52.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784279+0000", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00162776 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784833+0000", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00055346799999999999 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784921+0000", 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8395999999999999e-05 2024-05-10T14:02:52.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784985+0000", 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3609999999999996e-05 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.017738179, 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003295863, 2024-05-10T14:02:52.856 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 225 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788684+0000", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7600000000000001e-06 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788692+0000", 2024-05-10T14:02:52.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.49e-06 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788718+0000", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5720000000000001e-05 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788738+0000", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9803e-05 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788925+0000", 2024-05-10T14:02:52.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018694499999999999 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.789145+0000", 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000220449 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.789566+0000", 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00042079900000000002 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791026+0000", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014601010000000001 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791781+0000", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075485400000000001 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791915+0000", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133929 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791978+0000", 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3013000000000001e-05 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.014137342, 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00339595, 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.862 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 226 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:52.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792285+0000", 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.547e-06 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792293+0000", 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4700000000000002e-06 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792317+0000", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4043e-05 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792336+0000", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.929e-05 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792530+0000", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000193368 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792754+0000", 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000223859 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793159+0000", 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040560299999999999 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.794647+0000", 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014879310000000001 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795531+0000", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00088364699999999999 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795612+0000", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1565999999999998e-05 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795679+0000", 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6625999999999995e-05 2024-05-10T14:02:52.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:270 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.967499254, 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030852919999999999, 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 270 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838923+0000", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7829999999999999e-06 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838931+0000", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3839999999999997e-06 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838953+0000", 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1223e-05 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838972+0000", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9363000000000001e-05 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839097+0000", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125456 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839307+0000", 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00021002799999999999 2024-05-10T14:02:52.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839804+0000", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049709299999999999 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841093+0000", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001288509 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841742+0000", 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00064871099999999995 2024-05-10T14:02:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841893+0000", 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015100899999999999 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842006+0000", 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113733 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:313 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.960512624, 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0048012569999999997, 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 313 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845910+0000", 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2230000000000001e-06 2024-05-10T14:02:52.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845921+0000", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1177e-05 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845944+0000", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3065999999999999e-05 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845983+0000", 2024-05-10T14:02:52.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9032999999999997e-05 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846134+0000", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000151092 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846367+0000", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023249800000000001 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846833+0000", 2024-05-10T14:02:52.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000466403 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848191+0000", 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013579449999999999 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850503+0000", 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023121259999999999 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850637+0000", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013394899999999999 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850709+0000", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1744999999999998e-05 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:369 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:52.879 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.951045531, 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035929410000000001, 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 369 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855377+0000", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.843e-06 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855387+0000", 2024-05-10T14:02:52.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.08e-05 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855410+0000", 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2313000000000001e-05 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855423+0000", 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2996999999999999e-05 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855587+0000", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016423800000000001 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855949+0000", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036218399999999999 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.856520+0000", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00057113900000000002 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858807+0000", 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002286724 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858826+0000", 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.855e-05 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858905+0000", 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9759000000000007e-05 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858968+0000", 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2393999999999999e-05 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:394 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.940239799, 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042038659999999997, 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 394 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:52.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866182+0000", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9e-06 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866192+0000", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8560000000000002e-06 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866216+0000", 2024-05-10T14:02:52.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3516999999999999e-05 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866248+0000", 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1757000000000001e-05 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866372+0000", 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012468900000000001 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866510+0000", 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013817199999999999 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866950+0000", 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043956600000000001 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867932+0000", 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00098150499999999992 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870174+0000", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022429020000000002 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870279+0000", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010468599999999999 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870384+0000", 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010531600000000001 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.890 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:438 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.918478476000001, 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0038505150000000001, 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 438 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887944+0000", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887960+0000", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5293000000000001e-05 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887988+0000", 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8323e-05 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888010+0000", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.175e-05 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888175+0000", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016526900000000001 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888532+0000", 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00035715299999999997 2024-05-10T14:02:52.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888915+0000", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038294400000000003 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890233+0000", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001317787 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891430+0000", 2024-05-10T14:02:52.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001196913 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891675+0000", 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000245231 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891792+0000", 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117389 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:445 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.913723023999999, 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040461159999999998, 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.897 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 445 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892699+0000", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0660000000000002e-06 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892711+0000", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1453e-05 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892743+0000", 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2326000000000002e-05 2024-05-10T14:02:52.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892769+0000", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5360000000000001e-05 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892902+0000", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013364599999999999 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.893271+0000", 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036918699999999999 2024-05-10T14:02:52.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.893850+0000", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00057866199999999997 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.895878+0000", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020278340000000001 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896565+0000", 2024-05-10T14:02:52.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00068693699999999999 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896681+0000", 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115952 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896743+0000", 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2693000000000004e-05 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:446 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.913606589, 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0050256620000000002, 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 446 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892815+0000", 2024-05-10T14:02:52.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.234e-06 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892822+0000", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5200000000000003e-06 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892837+0000", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5826000000000001e-05 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892847+0000", 2024-05-10T14:02:52.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2199999999999998e-06 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894548+0000", 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017016830000000001 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894765+0000", 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000216808 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.895306+0000", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00054107500000000002 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896438+0000", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001131911 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897648+0000", 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00120976 2024-05-10T14:02:52.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897771+0000", 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012348599999999999 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897839+0000", 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8139000000000006e-05 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.908 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:628 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.798804176000001, 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0050048460000000003, 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 628 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007618+0000", 2024-05-10T14:02:52.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8160000000000001e-06 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007628+0000", 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7729999999999994e-06 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007651+0000", 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3257000000000001e-05 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007664+0000", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3200000000000001e-05 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007774+0000", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010990200000000001 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007936+0000", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016163899999999999 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008370+0000", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043375 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.009514+0000", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001144707 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012455+0000", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029409060000000001 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012546+0000", 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1019000000000004e-05 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012621+0000", 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4876999999999995e-05 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:639 6.1a e35/29 6:5ae4284b:::obj_delete_at_hint.0000000032:head v 35'5, mlcod=35'3)", 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.787610054, 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036300740000000001, 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018812+0000", 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.81e-06 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018828+0000", 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5985999999999999e-05 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018861+0000", 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3250000000000002e-05 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018881+0000", 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9919999999999999e-05 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019011+0000", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013011899999999999 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019052+0000", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0413000000000001e-05 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022354+0000", 2024-05-10T14:02:52.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033018330000000001 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022440+0000", 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6743000000000006e-05 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.152303933000001, 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033812030000000002, 2024-05-10T14:02:52.919 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 952 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654118+0000", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9369999999999998e-06 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654129+0000", 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0457e-05 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654156+0000", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7339999999999999e-05 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654171+0000", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5276000000000001e-05 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654322+0000", 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000150786 2024-05-10T14:02:52.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:52.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654677+0000", 2024-05-10T14:02:52.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00035445000000000002 2024-05-10T14:02:52.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.655226+0000", 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00054979200000000001 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:52.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.656534+0000", 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001307103 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657336+0000", 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080267700000000001 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657425+0000", 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9065000000000002e-05 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:52.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657498+0000", 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2319999999999999e-05 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:52.927 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:52.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:02:52.930 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:52.931+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:53.030 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:53.028+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:53.099 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:53.099 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:53.099 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:02:53.099 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:53.114 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:02:53.131 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:53.128+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:53.232 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:53.227+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:53.236 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:53.236 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:53.236 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:02:53.236 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:02:53.236 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:53.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T14:02:53.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:02:53.336 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:53.335+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:53.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T14:02:53.418 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:53.419 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 18.672415054999998, 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:53.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:02:53.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:02:53.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.719809314000001, 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.424 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:02:53.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:02:53.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.69236534, 2024-05-10T14:02:53.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:02:53.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.679107886000001, 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:02:53.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.67653597, 2024-05-10T14:02:53.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:02:53.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.579923379, 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.449 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:02:53.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.454 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.663808554999999, 2024-05-10T14:02:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:02:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:53.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:02:53.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:02:53.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:02:53.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:02:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.624466948, 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:02:53.465 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:02:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.475 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:53.475 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:53.475 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.565496983999999, 2024-05-10T14:02:53.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:02:53.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:02:53.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:02:53.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:02:53.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:02:53.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:02:53.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:02:53.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:02:53.485 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.486 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:02:53.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:53.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.549955350999999, 2024-05-10T14:02:53.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:02:53.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:53.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:02:53.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:02:53.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:02:53.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.549449318000001, 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:02:53.496 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.501 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.5452298, 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:02:53.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:02:53.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:02:53.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:02:53.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:53.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.530164802, 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.512 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:53.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:02:53.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:02:53.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:53.518 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.52877878, 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:02:53.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:02:53.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.523837316, 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:02:53.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.523381468, 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:02:53.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.508362202000001, 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:02:53.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:02:53.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:02:53.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.503296181, 2024-05-10T14:02:53.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:02:53.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:02:53.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 11.409326081, 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:02:53.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:02:53.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:02:53.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:859 6.3 e35/29 6:c0550c60:::obj_delete_at_hint.0000000094:head v 35'16, mlcod=35'14)", 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 10.981190301, 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001715879, 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:53.546 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:53.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436708+0000", 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1169999999999998e-06 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436724+0000", 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6616000000000002e-05 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436764+0000", 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9956000000000002e-05 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436785+0000", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0727e-05 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436945+0000", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015964199999999999 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.437010+0000", 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5696000000000003e-05 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.438336+0000", 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013255059999999999 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.438422+0000", 2024-05-10T14:02:53.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5618999999999995e-05 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:53.551 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:53.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:02:53.553 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:53.551+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:53.653 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:53.651+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:53.722 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:53.722 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:53.722 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:02:53.722 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:53.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:02:53.754 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:53.752+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:53.856 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:53.851+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:53.894 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:53.894 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:53.894 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:02:53.895 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:02:53.895 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:53.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:02:53.956 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:53.956+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:54.057 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:54.056+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.086 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 34.537915155, 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.087 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:02:54.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:02:54.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:02:54.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.915011397999997, 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:02:54.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819477751999997, 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:02:54.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:02:54.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:54.107 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819423546000003, 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:54.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:02:54.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:02:54.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819386676000001, 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.113 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:02:54.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:02:54.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:02:54.119 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:54.120 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819225131000003, 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.121 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:02:54.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:02:54.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:02:54.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:02:54.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.130 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819171791000002, 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:02:54.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:54.136 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.819113872000003, 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:02:54.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:02:54.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.818984123, 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.143 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:02:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.148 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.818945665999998, 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:02:54.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:02:54.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591822542999999, 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:02:54.155 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:02:54.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:02:54.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591615097999998, 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.162 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:02:54.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:02:54.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:02:54.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:54.170 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591501211999997, 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:02:54.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:02:54.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:02:54.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:02:54.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591332807000001, 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.178 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:54.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:02:54.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:02:54.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591295246999998, 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.185 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:54.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:02:54.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591241830999998, 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.193 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:02:54.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:02:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.199 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591116542000002, 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.200 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:02:54.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:02:54.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:02:54.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591076399000002, 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:02:54.206 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:02:54.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.591024015999999, 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.213 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:02:54.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:02:54.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.220 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 33.590839617999997, 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:54.221 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:54.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:02:54.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:54.227 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:54.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:02:54.230 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:54.228+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:54.312 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T14:02:54.318 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:02:54.330 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:54.328+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:54.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T14:02:54.383 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:54.383 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:02:54.383 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:02:54.384 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:54.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:02:54.431 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:54.431+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:54.532 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:54.532+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:54.562 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:54.562 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:02:54.562 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:02:54.563 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:02:54.563 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:54.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:02:54.663 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:54.664+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:54.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:02:54.733 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:54.735+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.570544441999999, 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:02:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:02:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.569010757000001, 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:02:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:02:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.234960444999999, 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:02:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:02:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:02:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:40 5.3 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.995390108999999, 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002628563, 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744479+0000", 2024-05-10T14:02:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2469999999999998e-06 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744509+0000", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0043e-05 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744542+0000", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2329000000000002e-05 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744567+0000", 2024-05-10T14:02:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.48e-05 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744643+0000", 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.64e-05 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744742+0000", 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9531000000000006e-05 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744874+0000", 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013199500000000001 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.745910+0000", 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001035567 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.746998+0000", 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001087502 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747058+0000", 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0822000000000001e-05 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747106+0000", 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7327000000000003e-05 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.992837339999999, 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:02:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:02:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.989582581000001, 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:02:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:02:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.030634897000001, 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:02:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.012795711000001, 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:02:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.976337509, 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:02:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:02:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:02:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.962492878999999, 2024-05-10T14:02:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:02:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:02:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.933266868, 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:02:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.915839726, 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:02:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:02:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.861681258000001, 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:02:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:02:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.648790324, 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:02:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.644402341999999, 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:02:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.470897470000001, 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:02:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:02:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:02:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.418122684, 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.413363101, 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:02:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.233010796, 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:02:54.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:02:54.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:02:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:02:54.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.229206999000001, 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:54.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:02:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:54.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.852 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:54.853 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:54.853 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:54.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:02:54.855 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:54.855+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:54.863 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:02:54.863 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:02:54.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:02:54.881 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:02:54.897 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:02:55.255 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:02:55.256 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:02:55.256 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:02:55.256 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:02:55.256 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:02:55.257 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:02:55.257 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:02:55.257 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:02:55.258 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:02:55.259 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:55.259 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:55.262 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:02:55.263 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:02:55.264 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:02:55.303 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:55.304+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:55.329 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T14:02:55.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T14:02:55.365 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:55.367+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:55.439 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:55.439 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:55.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:02:55.495 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:55.496+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:55.568 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:55.567+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:55.613 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:55.613 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:55.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:02:55.671 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:55.672+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:55.747 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:55.748 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:55.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:02:55.769 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:55.771+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:55.870 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:55.871+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:55.956 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:55.956 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:55.971 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:55.972+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:55.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:02:56.072 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:56.072+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:56.153 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:56.154 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:56.169 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:02:56.172 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:56.175+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:56.273 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:56.272+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:56.339 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T14:02:56.349 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:56.349 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:56.354 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:02:56.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:02:56.376 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:56.375+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:56.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T14:02:56.476 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:56.476+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:56.555 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:56.555 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:56.572 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:02:56.577 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:56.579+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:56.678 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:56.676+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:56.753 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:56.753 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:56.767 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:02:56.813 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:56.815+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:56.880 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:56.880+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:56.902 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:56.902 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:56.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:02:57.000 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:57.003+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:57.077 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:57.078 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:57.082 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:57.083+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:57.092 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:02:57.182 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:57.183+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:57.263 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:57.263 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:57.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:02:57.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:02:57.321 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:57.323+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:57.344 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T14:02:57.344 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:02:57.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-10T14:02:57.424 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:02:57.424+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:02:57.429 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:02:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:02:57.444 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:57.444 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:57.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:02:57.459 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:02:57.477 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:02:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:02:57.495 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:02:57.496 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:02:57.504 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:57.507+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:57.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:02:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:02:57.534 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:02:57.534 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:02:57.560 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:02:57.561 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:02:57.581 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:02:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:02:57.585 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:57.587+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:57.587 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:57.587 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:57.587 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:02:57.587 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:02:57.587 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:57.601 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:02:57.689 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:57.691+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:57.766 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:57.766 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:57.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:36 5.f 5:f6e9d2a7:::zone_info.56a333c7-a2aa-41a4-b131-d865107faf91:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.033783583000002, 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046943899999999997, 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 36 2024-05-10T14:02:57.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733164+0000", 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733166+0000", 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.542e-06 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733181+0000", 2024-05-10T14:02:57.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4759999999999999e-05 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733208+0000", 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6936000000000001e-05 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733220+0000", 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2473999999999999e-05 2024-05-10T14:02:57.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733324+0000", 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000103991 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733555+0000", 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023090799999999999 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.733859+0000", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030390799999999998 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.736067+0000", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002207592 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737685+0000", 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00161849 2024-05-10T14:02:57.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737783+0000", 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7511999999999997e-05 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.737858+0000", 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5277000000000004e-05 2024-05-10T14:02:57.773 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.028850666, 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031607850000000002, 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.774 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 37 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738096+0000", 2024-05-10T14:02:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738098+0000", 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8819999999999999e-06 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738109+0000", 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1106e-05 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738143+0000", 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3871000000000001e-05 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738158+0000", 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4843e-05 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738264+0000", 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010608 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738492+0000", 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022791900000000001 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.738769+0000", 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027644699999999998 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.740068+0000", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001299555 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741105+0000", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001036936 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741194+0000", 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9293e-05 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.741257+0000", 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2853000000000003e-05 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4461.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:57.780 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.019247830000001, 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0047966040000000003, 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4461", 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 41 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747699+0000", 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747701+0000", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9829999999999999e-06 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747728+0000", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6508000000000001e-05 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747755+0000", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7063000000000002e-05 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747769+0000", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747902+0000", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013363700000000001 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.748126+0000", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022359100000000001 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:57.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.748401+0000", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027477099999999999 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.750668+0000", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002267425 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752344+0000", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016753930000000001 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752431+0000", 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7462999999999999e-05 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.752496+0000", 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4899000000000003e-05 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:57.786 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.041152219000001, 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0049797349999999999, 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:02:57.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725795+0000", 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725799+0000", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6370000000000001e-06 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725810+0000", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1508000000000001e-05 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725840+0000", 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0162999999999999e-05 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725861+0000", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0996999999999999e-05 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726037+0000", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017551900000000001 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726318+0000", 2024-05-10T14:02:57.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028131199999999998 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726525+0000", 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020658100000000001 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729328+0000", 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0028037800000000001 2024-05-10T14:02:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730487+0000", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001158353 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730628+0000", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140739 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.730775+0000", 2024-05-10T14:02:57.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014714599999999999 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206011500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.035839051, 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037362839999999999, 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.793 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731108+0000", 2024-05-10T14:02:57.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731111+0000", 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4310000000000001e-06 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731124+0000", 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3016999999999999e-05 2024-05-10T14:02:57.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731161+0000", 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7085999999999997e-05 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731249+0000", 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8412000000000007e-05 2024-05-10T14:02:57.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731371+0000", 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012229999999999999 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.731617+0000", 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024537199999999999 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.732021+0000", 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040421400000000002 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.733406+0000", 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013851009999999999 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734638+0000", 2024-05-10T14:02:57.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001232213 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734727+0000", 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9012999999999996e-05 2024-05-10T14:02:57.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.734844+0000", 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117125 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.804 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T14:02:57.804 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:57.804 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.06176722, 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041925790000000001, 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 205 2024-05-10T14:02:57.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705180+0000", 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705183+0000", 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8760000000000001e-06 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705196+0000", 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.346e-05 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705229+0000", 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2750000000000003e-05 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705247+0000", 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7578999999999999e-05 2024-05-10T14:02:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705483+0000", 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000236219 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.705766+0000", 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028311699999999999 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.706180+0000", 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041408100000000001 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.707856+0000", 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016755819999999999 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709170+0000", 2024-05-10T14:02:57.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001314003 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709258+0000", 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8399999999999994e-05 2024-05-10T14:02:57.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.709373+0000", 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114512 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.816 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.995878563, 2024-05-10T14:02:57.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031391710000000001, 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.818 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 220 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771069+0000", 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771072+0000", 2024-05-10T14:02:57.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.207e-06 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771084+0000", 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1806e-05 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771116+0000", 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2036999999999998e-05 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771136+0000", 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0285999999999999e-05 2024-05-10T14:02:57.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771240+0000", 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010362899999999999 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771444+0000", 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204639 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.771864+0000", 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00042004299999999999 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.773196+0000", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001332092 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774045+0000", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00084898700000000005 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774140+0000", 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4869000000000003e-05 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.774208+0000", 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7576000000000005e-05 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.985179283000001, 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032168169999999999, 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.826 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 223 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781768+0000", 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781770+0000", 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781782+0000", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1426e-05 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781814+0000", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2073000000000003e-05 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.781838+0000", 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4680000000000001e-05 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782023+0000", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018493200000000001 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782243+0000", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000219805 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.782651+0000", 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000408427 2024-05-10T14:02:57.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784279+0000", 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00162776 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784833+0000", 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00055346799999999999 2024-05-10T14:02:57.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784921+0000", 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8395999999999999e-05 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.784985+0000", 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3609999999999996e-05 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.832 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.97826495, 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003295863, 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 225 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788682+0000", 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788684+0000", 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7600000000000001e-06 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788692+0000", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.49e-06 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788718+0000", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5720000000000001e-05 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788738+0000", 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9803e-05 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.788925+0000", 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018694499999999999 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.789145+0000", 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000220449 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.789566+0000", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00042079900000000002 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791026+0000", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014601010000000001 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791781+0000", 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075485400000000001 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791915+0000", 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133929 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.791978+0000", 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3013000000000001e-05 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.838 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.974664112999999, 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00339595, 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 226 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:57.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792283+0000", 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792285+0000", 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.547e-06 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792293+0000", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4700000000000002e-06 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792317+0000", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4043e-05 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792336+0000", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.929e-05 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792530+0000", 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000193368 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.792754+0000", 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000223859 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793159+0000", 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040560299999999999 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.794647+0000", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014879310000000001 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795531+0000", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00088364699999999999 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795612+0000", 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1565999999999998e-05 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795679+0000", 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6625999999999995e-05 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:270 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.928026024999999, 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030852919999999999, 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 270 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838921+0000", 2024-05-10T14:02:57.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838923+0000", 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7829999999999999e-06 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838931+0000", 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3839999999999997e-06 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838953+0000", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1223e-05 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.838972+0000", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9363000000000001e-05 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839097+0000", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125456 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839307+0000", 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00021002799999999999 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.839804+0000", 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049709299999999999 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841093+0000", 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001288509 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841742+0000", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00064871099999999995 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841893+0000", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015100899999999999 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842006+0000", 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113733 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:313 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.921039394999999, 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0048012569999999997, 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.850 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 313 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845908+0000", 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845910+0000", 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2230000000000001e-06 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845921+0000", 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1177e-05 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845944+0000", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3065999999999999e-05 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845983+0000", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9032999999999997e-05 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846134+0000", 2024-05-10T14:02:57.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000151092 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846367+0000", 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023249800000000001 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846833+0000", 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000466403 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848191+0000", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013579449999999999 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850503+0000", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023121259999999999 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850637+0000", 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013394899999999999 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850709+0000", 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1744999999999998e-05 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:369 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.911572302, 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035929410000000001, 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.856 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 369 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855375+0000", 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855377+0000", 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.843e-06 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855387+0000", 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.08e-05 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855410+0000", 2024-05-10T14:02:57.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2313000000000001e-05 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855423+0000", 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2996999999999999e-05 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855587+0000", 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016423800000000001 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.855949+0000", 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036218399999999999 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.856520+0000", 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00057113900000000002 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858807+0000", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002286724 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858826+0000", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.855e-05 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858905+0000", 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9759000000000007e-05 2024-05-10T14:02:57.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.858968+0000", 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2393999999999999e-05 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:394 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.863 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.90076657, 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042038659999999997, 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 394 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:57.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866181+0000", 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866182+0000", 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9e-06 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866192+0000", 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8560000000000002e-06 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866216+0000", 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3516999999999999e-05 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866248+0000", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1757000000000001e-05 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866372+0000", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012468900000000001 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866510+0000", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013817199999999999 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:57.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.866950+0000", 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043956600000000001 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867932+0000", 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00098150499999999992 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870174+0000", 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022429020000000002 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870279+0000", 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010468599999999999 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870384+0000", 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010531600000000001 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:438 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.869 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.879005247, 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0038505150000000001, 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 438 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887942+0000", 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887944+0000", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887960+0000", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5293000000000001e-05 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887988+0000", 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8323e-05 2024-05-10T14:02:57.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888010+0000", 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.175e-05 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888175+0000", 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016526900000000001 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888532+0000", 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00035715299999999997 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.888915+0000", 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038294400000000003 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890233+0000", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001317787 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891430+0000", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001196913 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891675+0000", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000245231 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891792+0000", 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117389 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:445 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.874249795000001, 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040461159999999998, 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 445 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892697+0000", 2024-05-10T14:02:57.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892699+0000", 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0660000000000002e-06 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892711+0000", 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1453e-05 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892743+0000", 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2326000000000002e-05 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892769+0000", 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5360000000000001e-05 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892902+0000", 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013364599999999999 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.893271+0000", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036918699999999999 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.893850+0000", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00057866199999999997 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.895878+0000", 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020278340000000001 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896565+0000", 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00068693699999999999 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896681+0000", 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115952 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896743+0000", 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2693000000000004e-05 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:446 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:57.882 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.87413336, 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0050256620000000002, 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 446 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892814+0000", 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892815+0000", 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.234e-06 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892822+0000", 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5200000000000003e-06 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892837+0000", 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5826000000000001e-05 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.892847+0000", 2024-05-10T14:02:57.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2199999999999998e-06 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894548+0000", 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017016830000000001 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894765+0000", 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000216808 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.895306+0000", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00054107500000000002 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896438+0000", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001131911 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897648+0000", 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00120976 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897771+0000", 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012348599999999999 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.897839+0000", 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8139000000000006e-05 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:628 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.888 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.759330947, 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0050048460000000003, 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 628 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007616+0000", 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007618+0000", 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8160000000000001e-06 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007628+0000", 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7729999999999994e-06 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007651+0000", 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3257000000000001e-05 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007664+0000", 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3200000000000001e-05 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007774+0000", 2024-05-10T14:02:57.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010990200000000001 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.007936+0000", 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016163899999999999 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008370+0000", 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043375 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.009514+0000", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001144707 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012455+0000", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029409060000000001 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012546+0000", 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1019000000000004e-05 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012621+0000", 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4876999999999995e-05 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:639 6.1a e35/29 6:5ae4284b:::obj_delete_at_hint.0000000032:head v 35'5, mlcod=35'3)", 2024-05-10T14:02:57.895 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.748136825, 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036300740000000001, 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018810+0000", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018812+0000", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.81e-06 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018828+0000", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5985999999999999e-05 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018861+0000", 2024-05-10T14:02:57.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3250000000000002e-05 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018881+0000", 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9919999999999999e-05 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019011+0000", 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013011899999999999 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019052+0000", 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0413000000000001e-05 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022354+0000", 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033018330000000001 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022440+0000", 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6743000000000006e-05 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.899 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.112830704, 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033812030000000002, 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 952 2024-05-10T14:02:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654116+0000", 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:57.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654118+0000", 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9369999999999998e-06 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654129+0000", 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0457e-05 2024-05-10T14:02:57.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654156+0000", 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7339999999999999e-05 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654171+0000", 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5276000000000001e-05 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654322+0000", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000150786 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.654677+0000", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00035445000000000002 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.655226+0000", 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00054979200000000001 2024-05-10T14:02:57.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.656534+0000", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001307103 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657336+0000", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080267700000000001 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657425+0000", 2024-05-10T14:02:57.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.9065000000000002e-05 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.657498+0000", 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2319999999999999e-05 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:57.906 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:57.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:02:57.908 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:57.908+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:58.008 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:58.008+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:58.081 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:58.081 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:58.081 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:02:58.081 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:58.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:02:58.140 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:58.143+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:58.210 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:58.208+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:58.217 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:58.217 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:58.217 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:02:58.217 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:02:58.217 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:58.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:02:58.321 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:58.323+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-05-10T14:02:58.388 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T14:02:58.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:58.405 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.659729761000001, 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.406 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:02:58.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:02:58.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:02:58.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:02:58.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:58.414 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:58.415 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.707124019999998, 2024-05-10T14:02:58.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:02:58.415 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:58.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:02:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:02:58.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:02:58.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:02:58.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:02:58.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:02:58.429 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.429 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.429 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.679680046000001, 2024-05-10T14:02:58.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:58.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:58.432 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:02:58.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.432 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:02:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:02:58.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:02:58.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:02:58.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:02:58.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:02:58.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:02:58.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:02:58.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:02:58.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.442 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.666422592, 2024-05-10T14:02:58.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:02:58.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:58.449 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.663850675999999, 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:02:58.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.567238085, 2024-05-10T14:02:58.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:02:58.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.651123260999999, 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:02:58.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:02:58.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:02:58.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.611781654000001, 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:02:58.464 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.552811689999999, 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:02:58.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.537270057000001, 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:02:58.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:02:58.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.536764024, 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:02:58.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:02:58.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:02:58.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.532544506000001, 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:02:58.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.517479508000001, 2024-05-10T14:02:58.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.516093485999999, 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.494 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.511152022000001, 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:58.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.510696174, 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:02:58.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:02:58.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.495676908, 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.490610886999999, 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.508 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:58.512 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 16.396640786999999, 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:02:58.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:02:58.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:02:58.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:859 6.3 e35/29 6:c0550c60:::obj_delete_at_hint.0000000094:head v 35'16, mlcod=35'14)", 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.968505006999999, 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001715879, 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:58.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436706+0000", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436708+0000", 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1169999999999998e-06 2024-05-10T14:02:58.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436724+0000", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6616000000000002e-05 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436764+0000", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9956000000000002e-05 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436785+0000", 2024-05-10T14:02:58.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0727e-05 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.436945+0000", 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015964199999999999 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.437010+0000", 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5696000000000003e-05 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.438336+0000", 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013255059999999999 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.438422+0000", 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5618999999999995e-05 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:58.521 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:58.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:02:58.524 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:58.523+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:58.624 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:58.624+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:58.692 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:58.692 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:58.692 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:02:58.692 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:58.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:02:58.753 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:58.755+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:58.823 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:58.824 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:02:58.824 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:02:58.824 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:02:58.824 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:58.826 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:02:58.827+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:02:58.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:02:58.874 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:58.880 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:58.892 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-05-10T14:02:58.361364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254372,"kb_used_data":4912,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720348,"statfs":{"total":773094113280,"available":772833636352,"internally_reserved":0,"allocated":5029888,"data_stored":2826266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046351"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351630+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:02:56.351630+0000","last_peered":"2024-05-10T14:02:56.351630+0000","last_clean":"2024-05-10T14:02:56.351630+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:02:56.351630+0000","last_undegraded":"2024-05-10T14:02:56.351630+0000","last_fullsized":"2024-05-10T14:02:56.351630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999689+0000","last_change":"2024-05-10T14:02:32.701008+0000","last_active":"2024-05-10T14:02:56.999689+0000","last_peered":"2024-05-10T14:02:56.999689+0000","last_clean":"2024-05-10T14:02:56.999689+0000","last_became_active":"2024-05-10T14:02:32.700023+0000","last_became_peered":"2024-05-10T14:02:32.700023+0000","last_unstale":"2024-05-10T14:02:56.999689+0000","last_undegraded":"2024-05-10T14:02:56.999689+0000","last_fullsized":"2024-05-10T14:02:56.999689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326993+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:02:54.326993+0000","last_peered":"2024-05-10T14:02:54.326993+0000","last_clean":"2024-05-10T14:02:54.326993+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:02:54.326993+0000","last_undegraded":"2024-05-10T14:02:54.326993+0000","last_fullsized":"2024-05-10T14:02:54.326993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350382+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:02:56.350382+0000","last_peered":"2024-05-10T14:02:56.350382+0000","last_clean":"2024-05-10T14:02:56.350382+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:02:56.350382+0000","last_undegraded":"2024-05-10T14:02:56.350382+0000","last_fullsized":"2024-05-10T14:02:56.350382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006810+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:02:57.006810+0000","last_peered":"2024-05-10T14:02:57.006810+0000","last_clean":"2024-05-10T14:02:57.006810+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:02:57.006810+0000","last_undegraded":"2024-05-10T14:02:57.006810+0000","last_fullsized":"2024-05-10T14:02:57.006810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330054+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:02:55.330054+0000","last_peered":"2024-05-10T14:02:55.330054+0000","last_clean":"2024-05-10T14:02:55.330054+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:02:55.330054+0000","last_undegraded":"2024-05-10T14:02:55.330054+0000","last_fullsized":"2024-05-10T14:02:55.330054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000407+0000","last_change":"2024-05-10T14:02:30.662364+0000","last_active":"2024-05-10T14:02:57.000407+0000","last_peered":"2024-05-10T14:02:57.000407+0000","last_clean":"2024-05-10T14:02:57.000407+0000","last_became_active":"2024-05-10T14:02:30.661072+0000","last_became_peered":"2024-05-10T14:02:30.661072+0000","last_unstale":"2024-05-10T14:02:57.000407+0000","last_undegraded":"2024-05-10T14:02:57.000407+0000","last_fullsized":"2024-05-10T14:02:57.000407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004491+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:02:57.004491+0000","last_peered":"2024-05-10T14:02:57.004491+0000","last_clean":"2024-05-10T14:02:57.004491+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:02:57.004491+0000","last_undegraded":"2024-05-10T14:02:57.004491+0000","last_fullsized":"2024-05-10T14:02:57.004491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351135+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:02:56.351135+0000","last_peered":"2024-05-10T14:02:56.351135+0000","last_clean":"2024-05-10T14:02:56.351135+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:02:56.351135+0000","last_undegraded":"2024-05-10T14:02:56.351135+0000","last_fullsized":"2024-05-10T14:02:56.351135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010563+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:02:57.010563+0000","last_peered":"2024-05-10T14:02:57.010563+0000","last_clean":"2024-05-10T14:02:57.010563+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:02:57.010563+0000","last_undegraded":"2024-05-10T14:02:57.010563+0000","last_fullsized":"2024-05-10T14:02:57.010563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999860+0000","last_change":"2024-05-10T14:02:30.664655+0000","last_active":"2024-05-10T14:02:56.999860+0000","last_peered":"2024-05-10T14:02:56.999860+0000","last_clean":"2024-05-10T14:02:56.999860+0000","last_became_active":"2024-05-10T14:02:30.662964+0000","last_became_peered":"2024-05-10T14:02:30.662964+0000","last_unstale":"2024-05-10T14:02:56.999860+0000","last_undegraded":"2024-05-10T14:02:56.999860+0000","last_fullsized":"2024-05-10T14:02:56.999860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331265+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:02:55.331265+0000","last_peered":"2024-05-10T14:02:55.331265+0000","last_clean":"2024-05-10T14:02:55.331265+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:02:55.331265+0000","last_undegraded":"2024-05-10T14:02:55.331265+0000","last_fullsized":"2024-05-10T14:02:55.331265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350946+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:02:56.350946+0000","last_peered":"2024-05-10T14:02:56.350946+0000","last_clean":"2024-05-10T14:02:56.350946+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:02:56.350946+0000","last_undegraded":"2024-05-10T14:02:56.350946+0000","last_fullsized":"2024-05-10T14:02:56.350946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999278+0000","last_change":"2024-05-10T14:02:32.685860+0000","last_active":"2024-05-10T14:02:56.999278+0000","last_peered":"2024-05-10T14:02:56.999278+0000","last_clean":"2024-05-10T14:02:56.999278+0000","last_became_active":"2024-05-10T14:02:32.684996+0000","last_became_peered":"2024-05-10T14:02:32.684996+0000","last_unstale":"2024-05-10T14:02:56.999278+0000","last_undegraded":"2024-05-10T14:02:56.999278+0000","last_fullsized":"2024-05-10T14:02:56.999278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349622+0000","last_change":"2024-05-10T14:02:30.659078+0000","last_active":"2024-05-10T14:02:56.349622+0000","last_peered":"2024-05-10T14:02:56.349622+0000","last_clean":"2024-05-10T14:02:56.349622+0000","last_became_active":"2024-05-10T14:02:30.658769+0000","last_became_peered":"2024-05-10T14:02:30.658769+0000","last_unstale":"2024-05-10T14:02:56.349622+0000","last_undegraded":"2024-05-10T14:02:56.349622+0000","last_fullsized":"2024-05-10T14:02:56.349622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847796+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:02:55.847796+0000","last_peered":"2024-05-10T14:02:55.847796+0000","last_clean":"2024-05-10T14:02:55.847796+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:02:55.847796+0000","last_undegraded":"2024-05-10T14:02:55.847796+0000","last_fullsized":"2024-05-10T14:02:55.847796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329447+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:02:55.329447+0000","last_peered":"2024-05-10T14:02:55.329447+0000","last_clean":"2024-05-10T14:02:55.329447+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:02:55.329447+0000","last_undegraded":"2024-05-10T14:02:55.329447+0000","last_fullsized":"2024-05-10T14:02:55.329447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351781+0000","last_change":"2024-05-10T14:02:30.670919+0000","last_active":"2024-05-10T14:02:56.351781+0000","last_peered":"2024-05-10T14:02:56.351781+0000","last_clean":"2024-05-10T14:02:56.351781+0000","last_became_active":"2024-05-10T14:02:30.670238+0000","last_became_peered":"2024-05-10T14:02:30.670238+0000","last_unstale":"2024-05-10T14:02:56.351781+0000","last_undegraded":"2024-05-10T14:02:56.351781+0000","last_fullsized":"2024-05-10T14:02:56.351781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350694+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:02:56.350694+0000","last_peered":"2024-05-10T14:02:56.350694+0000","last_clean":"2024-05-10T14:02:56.350694+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:02:56.350694+0000","last_undegraded":"2024-05-10T14:02:56.350694+0000","last_fullsized":"2024-05-10T14:02:56.350694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010836+0000","last_change":"2024-05-10T14:02:30.660232+0000","last_active":"2024-05-10T14:02:57.010836+0000","last_peered":"2024-05-10T14:02:57.010836+0000","last_clean":"2024-05-10T14:02:57.010836+0000","last_became_active":"2024-05-10T14:02:30.659541+0000","last_became_peered":"2024-05-10T14:02:30.659541+0000","last_unstale":"2024-05-10T14:02:57.010836+0000","last_undegraded":"2024-05-10T14:02:57.010836+0000","last_fullsized":"2024-05-10T14:02:57.010836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000052+0000","last_change":"2024-05-10T14:02:32.687835+0000","last_active":"2024-05-10T14:02:57.000052+0000","last_peered":"2024-05-10T14:02:57.000052+0000","last_clean":"2024-05-10T14:02:57.000052+0000","last_became_active":"2024-05-10T14:02:32.687123+0000","last_became_peered":"2024-05-10T14:02:32.687123+0000","last_unstale":"2024-05-10T14:02:57.000052+0000","last_undegraded":"2024-05-10T14:02:57.000052+0000","last_fullsized":"2024-05-10T14:02:57.000052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010837+0000","last_change":"2024-05-10T14:02:30.669888+0000","last_active":"2024-05-10T14:02:57.010837+0000","last_peered":"2024-05-10T14:02:57.010837+0000","last_clean":"2024-05-10T14:02:57.010837+0000","last_became_active":"2024-05-10T14:02:30.668900+0000","last_became_peered":"2024-05-10T14:02:30.668900+0000","last_unstale":"2024-05-10T14:02:57.010837+0000","last_undegraded":"2024-05-10T14:02:57.010837+0000","last_fullsized":"2024-05-10T14:02:57.010837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847425+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:02:55.847425+0000","last_peered":"2024-05-10T14:02:55.847425+0000","last_clean":"2024-05-10T14:02:55.847425+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:02:55.847425+0000","last_undegraded":"2024-05-10T14:02:55.847425+0000","last_fullsized":"2024-05-10T14:02:55.847425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330250+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:02:55.330250+0000","last_peered":"2024-05-10T14:02:55.330250+0000","last_clean":"2024-05-10T14:02:55.330250+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:02:55.330250+0000","last_undegraded":"2024-05-10T14:02:55.330250+0000","last_fullsized":"2024-05-10T14:02:55.330250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847376+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:02:55.847376+0000","last_peered":"2024-05-10T14:02:55.847376+0000","last_clean":"2024-05-10T14:02:55.847376+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:02:55.847376+0000","last_undegraded":"2024-05-10T14:02:55.847376+0000","last_fullsized":"2024-05-10T14:02:55.847376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350978+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:02:56.350978+0000","last_peered":"2024-05-10T14:02:56.350978+0000","last_clean":"2024-05-10T14:02:56.350978+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:02:56.350978+0000","last_undegraded":"2024-05-10T14:02:56.350978+0000","last_fullsized":"2024-05-10T14:02:56.350978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331334+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:02:55.331334+0000","last_peered":"2024-05-10T14:02:55.331334+0000","last_clean":"2024-05-10T14:02:55.331334+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:02:55.331334+0000","last_undegraded":"2024-05-10T14:02:55.331334+0000","last_fullsized":"2024-05-10T14:02:55.331334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006299+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:02:57.006299+0000","last_peered":"2024-05-10T14:02:57.006299+0000","last_clean":"2024-05-10T14:02:57.006299+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:02:57.006299+0000","last_undegraded":"2024-05-10T14:02:57.006299+0000","last_fullsized":"2024-05-10T14:02:57.006299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328834+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:02:55.328834+0000","last_peered":"2024-05-10T14:02:55.328834+0000","last_clean":"2024-05-10T14:02:55.328834+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:02:55.328834+0000","last_undegraded":"2024-05-10T14:02:55.328834+0000","last_fullsized":"2024-05-10T14:02:55.328834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352513+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:02:56.352513+0000","last_peered":"2024-05-10T14:02:56.352513+0000","last_clean":"2024-05-10T14:02:56.352513+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:02:56.352513+0000","last_undegraded":"2024-05-10T14:02:56.352513+0000","last_fullsized":"2024-05-10T14:02:56.352513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351638+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:02:56.351638+0000","last_peered":"2024-05-10T14:02:56.351638+0000","last_clean":"2024-05-10T14:02:56.351638+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:02:56.351638+0000","last_undegraded":"2024-05-10T14:02:56.351638+0000","last_fullsized":"2024-05-10T14:02:56.351638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000428+0000","last_change":"2024-05-10T14:02:34.703721+0000","last_active":"2024-05-10T14:02:57.000428+0000","last_peered":"2024-05-10T14:02:57.000428+0000","last_clean":"2024-05-10T14:02:57.000428+0000","last_became_active":"2024-05-10T14:02:34.702006+0000","last_became_peered":"2024-05-10T14:02:34.702006+0000","last_unstale":"2024-05-10T14:02:57.000428+0000","last_undegraded":"2024-05-10T14:02:57.000428+0000","last_fullsized":"2024-05-10T14:02:57.000428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006899+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:02:57.006899+0000","last_peered":"2024-05-10T14:02:57.006899+0000","last_clean":"2024-05-10T14:02:57.006899+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:02:57.006899+0000","last_undegraded":"2024-05-10T14:02:57.006899+0000","last_fullsized":"2024-05-10T14:02:57.006899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351387+0000","last_change":"2024-05-10T14:02:38.724178+0000","last_active":"2024-05-10T14:02:56.351387+0000","last_peered":"2024-05-10T14:02:56.351387+0000","last_clean":"2024-05-10T14:02:56.351387+0000","last_became_active":"2024-05-10T14:02:38.721491+0000","last_became_peered":"2024-05-10T14:02:38.721491+0000","last_unstale":"2024-05-10T14:02:56.351387+0000","last_undegraded":"2024-05-10T14:02:56.351387+0000","last_fullsized":"2024-05-10T14:02:56.351387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999645+0000","last_change":"2024-05-10T14:02:40.733937+0000","last_active":"2024-05-10T14:02:56.999645+0000","last_peered":"2024-05-10T14:02:56.999645+0000","last_clean":"2024-05-10T14:02:56.999645+0000","last_became_active":"2024-05-10T14:02:40.733205+0000","last_became_peered":"2024-05-10T14:02:40.733205+0000","last_unstale":"2024-05-10T14:02:56.999645+0000","last_undegraded":"2024-05-10T14:02:56.999645+0000","last_fullsized":"2024-05-10T14:02:56.999645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:40.961641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999231+0000","last_change":"2024-05-10T14:02:32.683159+0000","last_active":"2024-05-10T14:02:56.999231+0000","last_peered":"2024-05-10T14:02:56.999231+0000","last_clean":"2024-05-10T14:02:56.999231+0000","last_became_active":"2024-05-10T14:02:32.682442+0000","last_became_peered":"2024-05-10T14:02:32.682442+0000","last_unstale":"2024-05-10T14:02:56.999231+0000","last_undegraded":"2024-05-10T14:02:56.999231+0000","last_fullsized":"2024-05-10T14:02:56.999231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006345+0000","last_change":"2024-05-10T14:02:30.649814+0000","last_active":"2024-05-10T14:02:57.006345+0000","last_peered":"2024-05-10T14:02:57.006345+0000","last_clean":"2024-05-10T14:02:57.006345+0000","last_became_active":"2024-05-10T14:02:30.649470+0000","last_became_peered":"2024-05-10T14:02:30.649470+0000","last_unstale":"2024-05-10T14:02:57.006345+0000","last_undegraded":"2024-05-10T14:02:57.006345+0000","last_fullsized":"2024-05-10T14:02:57.006345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352137+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:02:56.352137+0000","last_peered":"2024-05-10T14:02:56.352137+0000","last_clean":"2024-05-10T14:02:56.352137+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:02:56.352137+0000","last_undegraded":"2024-05-10T14:02:56.352137+0000","last_fullsized":"2024-05-10T14:02:56.352137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331751+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:02:55.331751+0000","last_peered":"2024-05-10T14:02:55.331751+0000","last_clean":"2024-05-10T14:02:55.331751+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:02:55.331751+0000","last_undegraded":"2024-05-10T14:02:55.331751+0000","last_fullsized":"2024-05-10T14:02:55.331751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331280+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:02:55.331280+0000","last_peered":"2024-05-10T14:02:55.331280+0000","last_clean":"2024-05-10T14:02:55.331280+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:02:55.331280+0000","last_undegraded":"2024-05-10T14:02:55.331280+0000","last_fullsized":"2024-05-10T14:02:55.331280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005904+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:02:57.005904+0000","last_peered":"2024-05-10T14:02:57.005904+0000","last_clean":"2024-05-10T14:02:57.005904+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:02:57.005904+0000","last_undegraded":"2024-05-10T14:02:57.005904+0000","last_fullsized":"2024-05-10T14:02:57.005904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004489+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:02:57.004489+0000","last_peered":"2024-05-10T14:02:57.004489+0000","last_clean":"2024-05-10T14:02:57.004489+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:02:57.004489+0000","last_undegraded":"2024-05-10T14:02:57.004489+0000","last_fullsized":"2024-05-10T14:02:57.004489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351203+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:02:56.351203+0000","last_peered":"2024-05-10T14:02:56.351203+0000","last_clean":"2024-05-10T14:02:56.351203+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:02:56.351203+0000","last_undegraded":"2024-05-10T14:02:56.351203+0000","last_fullsized":"2024-05-10T14:02:56.351203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354931+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:02:56.354931+0000","last_peered":"2024-05-10T14:02:56.354931+0000","last_clean":"2024-05-10T14:02:56.354931+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:02:56.354931+0000","last_undegraded":"2024-05-10T14:02:56.354931+0000","last_fullsized":"2024-05-10T14:02:56.354931+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847211+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:02:55.847211+0000","last_peered":"2024-05-10T14:02:55.847211+0000","last_clean":"2024-05-10T14:02:55.847211+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:02:55.847211+0000","last_undegraded":"2024-05-10T14:02:55.847211+0000","last_fullsized":"2024-05-10T14:02:55.847211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351089+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:02:56.351089+0000","last_peered":"2024-05-10T14:02:56.351089+0000","last_clean":"2024-05-10T14:02:56.351089+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:02:56.351089+0000","last_undegraded":"2024-05-10T14:02:56.351089+0000","last_fullsized":"2024-05-10T14:02:56.351089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329682+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:02:55.329682+0000","last_peered":"2024-05-10T14:02:55.329682+0000","last_clean":"2024-05-10T14:02:55.329682+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:02:55.329682+0000","last_undegraded":"2024-05-10T14:02:55.329682+0000","last_fullsized":"2024-05-10T14:02:55.329682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354317+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:02:56.354317+0000","last_peered":"2024-05-10T14:02:56.354317+0000","last_clean":"2024-05-10T14:02:56.354317+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:02:56.354317+0000","last_undegraded":"2024-05-10T14:02:56.354317+0000","last_fullsized":"2024-05-10T14:02:56.354317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010147+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:02:57.010147+0000","last_peered":"2024-05-10T14:02:57.010147+0000","last_clean":"2024-05-10T14:02:57.010147+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:02:57.010147+0000","last_undegraded":"2024-05-10T14:02:57.010147+0000","last_fullsized":"2024-05-10T14:02:57.010147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000642+0000","last_change":"2024-05-10T14:02:34.703716+0000","last_active":"2024-05-10T14:02:57.000642+0000","last_peered":"2024-05-10T14:02:57.000642+0000","last_clean":"2024-05-10T14:02:57.000642+0000","last_became_active":"2024-05-10T14:02:34.702179+0000","last_became_peered":"2024-05-10T14:02:34.702179+0000","last_unstale":"2024-05-10T14:02:57.000642+0000","last_undegraded":"2024-05-10T14:02:57.000642+0000","last_fullsized":"2024-05-10T14:02:57.000642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351366+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:02:56.351366+0000","last_peered":"2024-05-10T14:02:56.351366+0000","last_clean":"2024-05-10T14:02:56.351366+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:02:56.351366+0000","last_undegraded":"2024-05-10T14:02:56.351366+0000","last_fullsized":"2024-05-10T14:02:56.351366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351345+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:02:56.351345+0000","last_peered":"2024-05-10T14:02:56.351345+0000","last_clean":"2024-05-10T14:02:56.351345+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:02:56.351345+0000","last_undegraded":"2024-05-10T14:02:56.351345+0000","last_fullsized":"2024-05-10T14:02:56.351345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999097+0000","last_change":"2024-05-10T14:02:32.683119+0000","last_active":"2024-05-10T14:02:56.999097+0000","last_peered":"2024-05-10T14:02:56.999097+0000","last_clean":"2024-05-10T14:02:56.999097+0000","last_became_active":"2024-05-10T14:02:32.682312+0000","last_became_peered":"2024-05-10T14:02:32.682312+0000","last_unstale":"2024-05-10T14:02:56.999097+0000","last_undegraded":"2024-05-10T14:02:56.999097+0000","last_fullsized":"2024-05-10T14:02:56.999097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351903+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:02:56.351903+0000","last_peered":"2024-05-10T14:02:56.351903+0000","last_clean":"2024-05-10T14:02:56.351903+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:02:56.351903+0000","last_undegraded":"2024-05-10T14:02:56.351903+0000","last_fullsized":"2024-05-10T14:02:56.351903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350016+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:02:56.350016+0000","last_peered":"2024-05-10T14:02:56.350016+0000","last_clean":"2024-05-10T14:02:56.350016+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:02:56.350016+0000","last_undegraded":"2024-05-10T14:02:56.350016+0000","last_fullsized":"2024-05-10T14:02:56.350016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999714+0000","last_change":"2024-05-10T14:02:36.760567+0000","last_active":"2024-05-10T14:02:56.999714+0000","last_peered":"2024-05-10T14:02:56.999714+0000","last_clean":"2024-05-10T14:02:56.999714+0000","last_became_active":"2024-05-10T14:02:36.759783+0000","last_became_peered":"2024-05-10T14:02:36.759783+0000","last_unstale":"2024-05-10T14:02:56.999714+0000","last_undegraded":"2024-05-10T14:02:56.999714+0000","last_fullsized":"2024-05-10T14:02:56.999714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324474+0000","last_change":"2024-05-10T14:02:38.721490+0000","last_active":"2024-05-10T14:02:54.324474+0000","last_peered":"2024-05-10T14:02:54.324474+0000","last_clean":"2024-05-10T14:02:54.324474+0000","last_became_active":"2024-05-10T14:02:38.720706+0000","last_became_peered":"2024-05-10T14:02:38.720706+0000","last_unstale":"2024-05-10T14:02:54.324474+0000","last_undegraded":"2024-05-10T14:02:54.324474+0000","last_fullsized":"2024-05-10T14:02:54.324474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.457471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000290+0000","last_change":"2024-05-10T14:02:40.737217+0000","last_active":"2024-05-10T14:02:57.000290+0000","last_peered":"2024-05-10T14:02:57.000290+0000","last_clean":"2024-05-10T14:02:57.000290+0000","last_became_active":"2024-05-10T14:02:40.734397+0000","last_became_peered":"2024-05-10T14:02:40.734397+0000","last_unstale":"2024-05-10T14:02:57.000290+0000","last_undegraded":"2024-05-10T14:02:57.000290+0000","last_fullsized":"2024-05-10T14:02:57.000290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329207+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:02:55.329207+0000","last_peered":"2024-05-10T14:02:55.329207+0000","last_clean":"2024-05-10T14:02:55.329207+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:02:55.329207+0000","last_undegraded":"2024-05-10T14:02:55.329207+0000","last_fullsized":"2024-05-10T14:02:55.329207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352190+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:02:56.352190+0000","last_peered":"2024-05-10T14:02:56.352190+0000","last_clean":"2024-05-10T14:02:56.352190+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:02:56.352190+0000","last_undegraded":"2024-05-10T14:02:56.352190+0000","last_fullsized":"2024-05-10T14:02:56.352190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847160+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:02:55.847160+0000","last_peered":"2024-05-10T14:02:55.847160+0000","last_clean":"2024-05-10T14:02:55.847160+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:02:55.847160+0000","last_undegraded":"2024-05-10T14:02:55.847160+0000","last_fullsized":"2024-05-10T14:02:55.847160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351410+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:02:56.351410+0000","last_peered":"2024-05-10T14:02:56.351410+0000","last_clean":"2024-05-10T14:02:56.351410+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:02:56.351410+0000","last_undegraded":"2024-05-10T14:02:56.351410+0000","last_fullsized":"2024-05-10T14:02:56.351410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.347901+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:02:56.347901+0000","last_peered":"2024-05-10T14:02:56.347901+0000","last_clean":"2024-05-10T14:02:56.347901+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:02:56.347901+0000","last_undegraded":"2024-05-10T14:02:56.347901+0000","last_fullsized":"2024-05-10T14:02:56.347901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010458+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:02:57.010458+0000","last_peered":"2024-05-10T14:02:57.010458+0000","last_clean":"2024-05-10T14:02:57.010458+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:02:57.010458+0000","last_undegraded":"2024-05-10T14:02:57.010458+0000","last_fullsized":"2024-05-10T14:02:57.010458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009717+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:02:57.009717+0000","last_peered":"2024-05-10T14:02:57.009717+0000","last_clean":"2024-05-10T14:02:57.009717+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:02:57.009717+0000","last_undegraded":"2024-05-10T14:02:57.009717+0000","last_fullsized":"2024-05-10T14:02:57.009717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352283+0000","last_change":"2024-05-10T14:02:30.676357+0000","last_active":"2024-05-10T14:02:56.352283+0000","last_peered":"2024-05-10T14:02:56.352283+0000","last_clean":"2024-05-10T14:02:56.352283+0000","last_became_active":"2024-05-10T14:02:30.675551+0000","last_became_peered":"2024-05-10T14:02:30.675551+0000","last_unstale":"2024-05-10T14:02:56.352283+0000","last_undegraded":"2024-05-10T14:02:56.352283+0000","last_fullsized":"2024-05-10T14:02:56.352283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847722+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:02:55.847722+0000","last_peered":"2024-05-10T14:02:55.847722+0000","last_clean":"2024-05-10T14:02:55.847722+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:02:55.847722+0000","last_undegraded":"2024-05-10T14:02:55.847722+0000","last_fullsized":"2024-05-10T14:02:55.847722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350396+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:02:56.350396+0000","last_peered":"2024-05-10T14:02:56.350396+0000","last_clean":"2024-05-10T14:02:56.350396+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:02:56.350396+0000","last_undegraded":"2024-05-10T14:02:56.350396+0000","last_fullsized":"2024-05-10T14:02:56.350396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005474+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:02:57.005474+0000","last_peered":"2024-05-10T14:02:57.005474+0000","last_clean":"2024-05-10T14:02:57.005474+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:02:57.005474+0000","last_undegraded":"2024-05-10T14:02:57.005474+0000","last_fullsized":"2024-05-10T14:02:57.005474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007022+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:02:57.007022+0000","last_peered":"2024-05-10T14:02:57.007022+0000","last_clean":"2024-05-10T14:02:57.007022+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:02:57.007022+0000","last_undegraded":"2024-05-10T14:02:57.007022+0000","last_fullsized":"2024-05-10T14:02:57.007022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004379+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:02:57.004379+0000","last_peered":"2024-05-10T14:02:57.004379+0000","last_clean":"2024-05-10T14:02:57.004379+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:02:57.004379+0000","last_undegraded":"2024-05-10T14:02:57.004379+0000","last_fullsized":"2024-05-10T14:02:57.004379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000596+0000","last_change":"2024-05-10T14:02:30.668980+0000","last_active":"2024-05-10T14:02:57.000596+0000","last_peered":"2024-05-10T14:02:57.000596+0000","last_clean":"2024-05-10T14:02:57.000596+0000","last_became_active":"2024-05-10T14:02:30.666369+0000","last_became_peered":"2024-05-10T14:02:30.666369+0000","last_unstale":"2024-05-10T14:02:57.000596+0000","last_undegraded":"2024-05-10T14:02:57.000596+0000","last_fullsized":"2024-05-10T14:02:57.000596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847269+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:02:55.847269+0000","last_peered":"2024-05-10T14:02:55.847269+0000","last_clean":"2024-05-10T14:02:55.847269+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:02:55.847269+0000","last_undegraded":"2024-05-10T14:02:55.847269+0000","last_fullsized":"2024-05-10T14:02:55.847269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005755+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:02:57.005755+0000","last_peered":"2024-05-10T14:02:57.005755+0000","last_clean":"2024-05-10T14:02:57.005755+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:02:57.005755+0000","last_undegraded":"2024-05-10T14:02:57.005755+0000","last_fullsized":"2024-05-10T14:02:57.005755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.846934+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:02:55.846934+0000","last_peered":"2024-05-10T14:02:55.846934+0000","last_clean":"2024-05-10T14:02:55.846934+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:02:55.846934+0000","last_undegraded":"2024-05-10T14:02:55.846934+0000","last_fullsized":"2024-05-10T14:02:55.846934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326728+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:02:54.326728+0000","last_peered":"2024-05-10T14:02:54.326728+0000","last_clean":"2024-05-10T14:02:54.326728+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:02:54.326728+0000","last_undegraded":"2024-05-10T14:02:54.326728+0000","last_fullsized":"2024-05-10T14:02:54.326728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330936+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:02:55.330936+0000","last_peered":"2024-05-10T14:02:55.330936+0000","last_clean":"2024-05-10T14:02:55.330936+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:02:55.330936+0000","last_undegraded":"2024-05-10T14:02:55.330936+0000","last_fullsized":"2024-05-10T14:02:55.330936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350684+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:02:56.350684+0000","last_peered":"2024-05-10T14:02:56.350684+0000","last_clean":"2024-05-10T14:02:56.350684+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:02:56.350684+0000","last_undegraded":"2024-05-10T14:02:56.350684+0000","last_fullsized":"2024-05-10T14:02:56.350684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847420+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:02:55.847420+0000","last_peered":"2024-05-10T14:02:55.847420+0000","last_clean":"2024-05-10T14:02:55.847420+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:02:55.847420+0000","last_undegraded":"2024-05-10T14:02:55.847420+0000","last_fullsized":"2024-05-10T14:02:55.847420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331359+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:02:55.331359+0000","last_peered":"2024-05-10T14:02:55.331359+0000","last_clean":"2024-05-10T14:02:55.331359+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:02:55.331359+0000","last_undegraded":"2024-05-10T14:02:55.331359+0000","last_fullsized":"2024-05-10T14:02:55.331359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007936+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:02:57.007936+0000","last_peered":"2024-05-10T14:02:57.007936+0000","last_clean":"2024-05-10T14:02:57.007936+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:02:57.007936+0000","last_undegraded":"2024-05-10T14:02:57.007936+0000","last_fullsized":"2024-05-10T14:02:57.007936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348092+0000","last_change":"2024-05-10T14:02:40.734940+0000","last_active":"2024-05-10T14:02:56.348092+0000","last_peered":"2024-05-10T14:02:56.348092+0000","last_clean":"2024-05-10T14:02:56.348092+0000","last_became_active":"2024-05-10T14:02:40.734017+0000","last_became_peered":"2024-05-10T14:02:40.734017+0000","last_unstale":"2024-05-10T14:02:56.348092+0000","last_undegraded":"2024-05-10T14:02:56.348092+0000","last_fullsized":"2024-05-10T14:02:56.348092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.803176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331590+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:02:55.331590+0000","last_peered":"2024-05-10T14:02:55.331590+0000","last_clean":"2024-05-10T14:02:55.331590+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:02:55.331590+0000","last_undegraded":"2024-05-10T14:02:55.331590+0000","last_fullsized":"2024-05-10T14:02:55.331590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010515+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:02:57.010515+0000","last_peered":"2024-05-10T14:02:57.010515+0000","last_clean":"2024-05-10T14:02:57.010515+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:02:57.010515+0000","last_undegraded":"2024-05-10T14:02:57.010515+0000","last_fullsized":"2024-05-10T14:02:57.010515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325165+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:02:54.325165+0000","last_peered":"2024-05-10T14:02:54.325165+0000","last_clean":"2024-05-10T14:02:54.325165+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:02:54.325165+0000","last_undegraded":"2024-05-10T14:02:54.325165+0000","last_fullsized":"2024-05-10T14:02:54.325165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847693+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:02:55.847693+0000","last_peered":"2024-05-10T14:02:55.847693+0000","last_clean":"2024-05-10T14:02:55.847693+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:02:55.847693+0000","last_undegraded":"2024-05-10T14:02:55.847693+0000","last_fullsized":"2024-05-10T14:02:55.847693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":32,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847329+0000","last_change":"2024-05-10T14:02:38.723250+0000","last_active":"2024-05-10T14:02:55.847329+0000","last_peered":"2024-05-10T14:02:55.847329+0000","last_clean":"2024-05-10T14:02:55.847329+0000","last_became_active":"2024-05-10T14:02:38.722515+0000","last_became_peered":"2024-05-10T14:02:38.722515+0000","last_unstale":"2024-05-10T14:02:55.847329+0000","last_undegraded":"2024-05-10T14:02:55.847329+0000","last_fullsized":"2024-05-10T14:02:55.847329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:43.700192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324526+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:02:54.324526+0000","last_peered":"2024-05-10T14:02:54.324526+0000","last_clean":"2024-05-10T14:02:54.324526+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:02:54.324526+0000","last_undegraded":"2024-05-10T14:02:54.324526+0000","last_fullsized":"2024-05-10T14:02:54.324526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331857+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:02:55.331857+0000","last_peered":"2024-05-10T14:02:55.331857+0000","last_clean":"2024-05-10T14:02:55.331857+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:02:55.331857+0000","last_undegraded":"2024-05-10T14:02:55.331857+0000","last_fullsized":"2024-05-10T14:02:55.331857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330188+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:02:55.330188+0000","last_peered":"2024-05-10T14:02:55.330188+0000","last_clean":"2024-05-10T14:02:55.330188+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:02:55.330188+0000","last_undegraded":"2024-05-10T14:02:55.330188+0000","last_fullsized":"2024-05-10T14:02:55.330188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000763+0000","last_change":"2024-05-10T14:02:34.704402+0000","last_active":"2024-05-10T14:02:57.000763+0000","last_peered":"2024-05-10T14:02:57.000763+0000","last_clean":"2024-05-10T14:02:57.000763+0000","last_became_active":"2024-05-10T14:02:34.703650+0000","last_became_peered":"2024-05-10T14:02:34.703650+0000","last_unstale":"2024-05-10T14:02:57.000763+0000","last_undegraded":"2024-05-10T14:02:57.000763+0000","last_fullsized":"2024-05-10T14:02:57.000763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351622+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:02:56.351622+0000","last_peered":"2024-05-10T14:02:56.351622+0000","last_clean":"2024-05-10T14:02:56.351622+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:02:56.351622+0000","last_undegraded":"2024-05-10T14:02:56.351622+0000","last_fullsized":"2024-05-10T14:02:56.351622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010555+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:02:57.010555+0000","last_peered":"2024-05-10T14:02:57.010555+0000","last_clean":"2024-05-10T14:02:57.010555+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:02:57.010555+0000","last_undegraded":"2024-05-10T14:02:57.010555+0000","last_fullsized":"2024-05-10T14:02:57.010555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329762+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:02:55.329762+0000","last_peered":"2024-05-10T14:02:55.329762+0000","last_clean":"2024-05-10T14:02:55.329762+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:02:55.329762+0000","last_undegraded":"2024-05-10T14:02:55.329762+0000","last_fullsized":"2024-05-10T14:02:55.329762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327104+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:02:54.327104+0000","last_peered":"2024-05-10T14:02:54.327104+0000","last_clean":"2024-05-10T14:02:54.327104+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:02:54.327104+0000","last_undegraded":"2024-05-10T14:02:54.327104+0000","last_fullsized":"2024-05-10T14:02:54.327104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350120+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:02:56.350120+0000","last_peered":"2024-05-10T14:02:56.350120+0000","last_clean":"2024-05-10T14:02:56.350120+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:02:56.350120+0000","last_undegraded":"2024-05-10T14:02:56.350120+0000","last_fullsized":"2024-05-10T14:02:56.350120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331657+0000","last_change":"2024-05-10T14:02:34.703505+0000","last_active":"2024-05-10T14:02:55.331657+0000","last_peered":"2024-05-10T14:02:55.331657+0000","last_clean":"2024-05-10T14:02:55.331657+0000","last_became_active":"2024-05-10T14:02:34.702702+0000","last_became_peered":"2024-05-10T14:02:34.702702+0000","last_unstale":"2024-05-10T14:02:55.331657+0000","last_undegraded":"2024-05-10T14:02:55.331657+0000","last_fullsized":"2024-05-10T14:02:55.331657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000428+0000","last_change":"2024-05-10T14:02:36.699924+0000","last_active":"2024-05-10T14:02:57.000428+0000","last_peered":"2024-05-10T14:02:57.000428+0000","last_clean":"2024-05-10T14:02:57.000428+0000","last_became_active":"2024-05-10T14:02:36.699071+0000","last_became_peered":"2024-05-10T14:02:36.699071+0000","last_unstale":"2024-05-10T14:02:57.000428+0000","last_undegraded":"2024-05-10T14:02:57.000428+0000","last_fullsized":"2024-05-10T14:02:57.000428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010350+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:02:57.010350+0000","last_peered":"2024-05-10T14:02:57.010350+0000","last_clean":"2024-05-10T14:02:57.010350+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:02:57.010350+0000","last_undegraded":"2024-05-10T14:02:57.010350+0000","last_fullsized":"2024-05-10T14:02:57.010350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324304+0000","last_change":"2024-05-10T14:02:40.734906+0000","last_active":"2024-05-10T14:02:54.324304+0000","last_peered":"2024-05-10T14:02:54.324304+0000","last_clean":"2024-05-10T14:02:54.324304+0000","last_became_active":"2024-05-10T14:02:40.734153+0000","last_became_peered":"2024-05-10T14:02:40.734153+0000","last_unstale":"2024-05-10T14:02:54.324304+0000","last_undegraded":"2024-05-10T14:02:54.324304+0000","last_fullsized":"2024-05-10T14:02:54.324304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:19.709648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010715+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:02:57.010715+0000","last_peered":"2024-05-10T14:02:57.010715+0000","last_clean":"2024-05-10T14:02:57.010715+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:02:57.010715+0000","last_undegraded":"2024-05-10T14:02:57.010715+0000","last_fullsized":"2024-05-10T14:02:57.010715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350716+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:56.350716+0000","last_peered":"2024-05-10T14:02:56.350716+0000","last_clean":"2024-05-10T14:02:56.350716+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:56.350716+0000","last_undegraded":"2024-05-10T14:02:56.350716+0000","last_fullsized":"2024-05-10T14:02:56.350716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000283+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:57.000283+0000","last_peered":"2024-05-10T14:02:57.000283+0000","last_clean":"2024-05-10T14:02:57.000283+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:57.000283+0000","last_undegraded":"2024-05-10T14:02:57.000283+0000","last_fullsized":"2024-05-10T14:02:57.000283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350783+0000","last_change":"2024-05-10T14:02:30.664055+0000","last_active":"2024-05-10T14:02:56.350783+0000","last_peered":"2024-05-10T14:02:56.350783+0000","last_clean":"2024-05-10T14:02:56.350783+0000","last_became_active":"2024-05-10T14:02:30.663754+0000","last_became_peered":"2024-05-10T14:02:30.663754+0000","last_unstale":"2024-05-10T14:02:56.350783+0000","last_undegraded":"2024-05-10T14:02:56.350783+0000","last_fullsized":"2024-05-10T14:02:56.350783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350584+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:02:56.350584+0000","last_peered":"2024-05-10T14:02:56.350584+0000","last_clean":"2024-05-10T14:02:56.350584+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:02:56.350584+0000","last_undegraded":"2024-05-10T14:02:56.350584+0000","last_fullsized":"2024-05-10T14:02:56.350584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000852+0000","last_change":"2024-05-10T14:02:36.708452+0000","last_active":"2024-05-10T14:02:57.000852+0000","last_peered":"2024-05-10T14:02:57.000852+0000","last_clean":"2024-05-10T14:02:57.000852+0000","last_became_active":"2024-05-10T14:02:36.707872+0000","last_became_peered":"2024-05-10T14:02:36.707872+0000","last_unstale":"2024-05-10T14:02:57.000852+0000","last_undegraded":"2024-05-10T14:02:57.000852+0000","last_fullsized":"2024-05-10T14:02:57.000852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007030+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:02:57.007030+0000","last_peered":"2024-05-10T14:02:57.007030+0000","last_clean":"2024-05-10T14:02:57.007030+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:02:57.007030+0000","last_undegraded":"2024-05-10T14:02:57.007030+0000","last_fullsized":"2024-05-10T14:02:57.007030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009921+0000","last_change":"2024-05-10T14:02:40.742200+0000","last_active":"2024-05-10T14:02:57.009921+0000","last_peered":"2024-05-10T14:02:57.009921+0000","last_clean":"2024-05-10T14:02:57.009921+0000","last_became_active":"2024-05-10T14:02:40.741540+0000","last_became_peered":"2024-05-10T14:02:40.741540+0000","last_unstale":"2024-05-10T14:02:57.009921+0000","last_undegraded":"2024-05-10T14:02:57.009921+0000","last_fullsized":"2024-05-10T14:02:57.009921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:43.260808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004705+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:02:57.004705+0000","last_peered":"2024-05-10T14:02:57.004705+0000","last_clean":"2024-05-10T14:02:57.004705+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:02:57.004705+0000","last_undegraded":"2024-05-10T14:02:57.004705+0000","last_fullsized":"2024-05-10T14:02:57.004705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351008+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:56.351008+0000","last_peered":"2024-05-10T14:02:56.351008+0000","last_clean":"2024-05-10T14:02:56.351008+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:56.351008+0000","last_undegraded":"2024-05-10T14:02:56.351008+0000","last_fullsized":"2024-05-10T14:02:56.351008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005871+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:02:57.005871+0000","last_peered":"2024-05-10T14:02:57.005871+0000","last_clean":"2024-05-10T14:02:57.005871+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:02:57.005871+0000","last_undegraded":"2024-05-10T14:02:57.005871+0000","last_fullsized":"2024-05-10T14:02:57.005871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.001019+0000","last_change":"2024-05-10T14:02:34.702777+0000","last_active":"2024-05-10T14:02:57.001019+0000","last_peered":"2024-05-10T14:02:57.001019+0000","last_clean":"2024-05-10T14:02:57.001019+0000","last_became_active":"2024-05-10T14:02:34.701897+0000","last_became_peered":"2024-05-10T14:02:34.701897+0000","last_unstale":"2024-05-10T14:02:57.001019+0000","last_undegraded":"2024-05-10T14:02:57.001019+0000","last_fullsized":"2024-05-10T14:02:57.001019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325120+0000","last_change":"2024-05-10T14:02:36.699050+0000","last_active":"2024-05-10T14:02:54.325120+0000","last_peered":"2024-05-10T14:02:54.325120+0000","last_clean":"2024-05-10T14:02:54.325120+0000","last_became_active":"2024-05-10T14:02:36.698360+0000","last_became_peered":"2024-05-10T14:02:36.698360+0000","last_unstale":"2024-05-10T14:02:54.325120+0000","last_undegraded":"2024-05-10T14:02:54.325120+0000","last_fullsized":"2024-05-10T14:02:54.325120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:35:40.504956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351562+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:02:56.351562+0000","last_peered":"2024-05-10T14:02:56.351562+0000","last_clean":"2024-05-10T14:02:56.351562+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:02:56.351562+0000","last_undegraded":"2024-05-10T14:02:56.351562+0000","last_fullsized":"2024-05-10T14:02:56.351562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324425+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:02:54.324425+0000","last_peered":"2024-05-10T14:02:54.324425+0000","last_clean":"2024-05-10T14:02:54.324425+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:02:54.324425+0000","last_undegraded":"2024-05-10T14:02:54.324425+0000","last_fullsized":"2024-05-10T14:02:54.324425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327233+0000","last_change":"2024-05-10T14:02:32.685938+0000","last_active":"2024-05-10T14:02:54.327233+0000","last_peered":"2024-05-10T14:02:54.327233+0000","last_clean":"2024-05-10T14:02:54.327233+0000","last_became_active":"2024-05-10T14:02:32.685539+0000","last_became_peered":"2024-05-10T14:02:32.685539+0000","last_unstale":"2024-05-10T14:02:54.327233+0000","last_undegraded":"2024-05-10T14:02:54.327233+0000","last_fullsized":"2024-05-10T14:02:54.327233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:48.031945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847110+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:55.847110+0000","last_peered":"2024-05-10T14:02:55.847110+0000","last_clean":"2024-05-10T14:02:55.847110+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:55.847110+0000","last_undegraded":"2024-05-10T14:02:55.847110+0000","last_fullsized":"2024-05-10T14:02:55.847110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324337+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:02:54.324337+0000","last_peered":"2024-05-10T14:02:54.324337+0000","last_clean":"2024-05-10T14:02:54.324337+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:02:54.324337+0000","last_undegraded":"2024-05-10T14:02:54.324337+0000","last_fullsized":"2024-05-10T14:02:54.324337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847563+0000","last_change":"2024-05-10T14:02:34.702881+0000","last_active":"2024-05-10T14:02:55.847563+0000","last_peered":"2024-05-10T14:02:55.847563+0000","last_clean":"2024-05-10T14:02:55.847563+0000","last_became_active":"2024-05-10T14:02:34.702177+0000","last_became_peered":"2024-05-10T14:02:34.702177+0000","last_unstale":"2024-05-10T14:02:55.847563+0000","last_undegraded":"2024-05-10T14:02:55.847563+0000","last_fullsized":"2024-05-10T14:02:55.847563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:25.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351868+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:56.351868+0000","last_peered":"2024-05-10T14:02:56.351868+0000","last_clean":"2024-05-10T14:02:56.351868+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:02:56.351868+0000","last_undegraded":"2024-05-10T14:02:56.351868+0000","last_fullsized":"2024-05-10T14:02:56.351868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006204+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:02:57.006204+0000","last_peered":"2024-05-10T14:02:57.006204+0000","last_clean":"2024-05-10T14:02:57.006204+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:02:57.006204+0000","last_undegraded":"2024-05-10T14:02:57.006204+0000","last_fullsized":"2024-05-10T14:02:57.006204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351190+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:02:56.351190+0000","last_peered":"2024-05-10T14:02:56.351190+0000","last_clean":"2024-05-10T14:02:56.351190+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:02:56.351190+0000","last_undegraded":"2024-05-10T14:02:56.351190+0000","last_fullsized":"2024-05-10T14:02:56.351190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325466+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:02:54.325466+0000","last_peered":"2024-05-10T14:02:54.325466+0000","last_clean":"2024-05-10T14:02:54.325466+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:02:54.325466+0000","last_undegraded":"2024-05-10T14:02:54.325466+0000","last_fullsized":"2024-05-10T14:02:54.325466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999140+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:56.999140+0000","last_peered":"2024-05-10T14:02:56.999140+0000","last_clean":"2024-05-10T14:02:56.999140+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:56.999140+0000","last_undegraded":"2024-05-10T14:02:56.999140+0000","last_fullsized":"2024-05-10T14:02:56.999140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330734+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:02:55.330734+0000","last_peered":"2024-05-10T14:02:55.330734+0000","last_clean":"2024-05-10T14:02:55.330734+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:02:55.330734+0000","last_undegraded":"2024-05-10T14:02:55.330734+0000","last_fullsized":"2024-05-10T14:02:55.330734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006699+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:02:57.006699+0000","last_peered":"2024-05-10T14:02:57.006699+0000","last_clean":"2024-05-10T14:02:57.006699+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:02:57.006699+0000","last_undegraded":"2024-05-10T14:02:57.006699+0000","last_fullsized":"2024-05-10T14:02:57.006699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354066+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:02:56.354066+0000","last_peered":"2024-05-10T14:02:56.354066+0000","last_clean":"2024-05-10T14:02:56.354066+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:02:56.354066+0000","last_undegraded":"2024-05-10T14:02:56.354066+0000","last_fullsized":"2024-05-10T14:02:56.354066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010790+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:02:57.010790+0000","last_peered":"2024-05-10T14:02:57.010790+0000","last_clean":"2024-05-10T14:02:57.010790+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:02:57.010790+0000","last_undegraded":"2024-05-10T14:02:57.010790+0000","last_fullsized":"2024-05-10T14:02:57.010790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999280+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:56.999280+0000","last_peered":"2024-05-10T14:02:56.999280+0000","last_clean":"2024-05-10T14:02:56.999280+0000","last_became_active":"2024-05-10T14:02:40.733023+0000","last_became_peered":"2024-05-10T14:02:40.733023+0000","last_unstale":"2024-05-10T14:02:56.999280+0000","last_undegraded":"2024-05-10T14:02:56.999280+0000","last_fullsized":"2024-05-10T14:02:56.999280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324974+0000","last_change":"2024-05-10T14:02:32.690026+0000","last_active":"2024-05-10T14:02:54.324974+0000","last_peered":"2024-05-10T14:02:54.324974+0000","last_clean":"2024-05-10T14:02:54.324974+0000","last_became_active":"2024-05-10T14:02:32.689610+0000","last_became_peered":"2024-05-10T14:02:32.689610+0000","last_unstale":"2024-05-10T14:02:54.324974+0000","last_undegraded":"2024-05-10T14:02:54.324974+0000","last_fullsized":"2024-05-10T14:02:54.324974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:02.876675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000750+0000","last_change":"2024-05-10T14:02:30.668078+0000","last_active":"2024-05-10T14:02:57.000750+0000","last_peered":"2024-05-10T14:02:57.000750+0000","last_clean":"2024-05-10T14:02:57.000750+0000","last_became_active":"2024-05-10T14:02:30.658626+0000","last_became_peered":"2024-05-10T14:02:30.658626+0000","last_unstale":"2024-05-10T14:02:57.000750+0000","last_undegraded":"2024-05-10T14:02:57.000750+0000","last_fullsized":"2024-05-10T14:02:57.000750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325652+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:54.325652+0000","last_peered":"2024-05-10T14:02:54.325652+0000","last_clean":"2024-05-10T14:02:54.325652+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:54.325652+0000","last_undegraded":"2024-05-10T14:02:54.325652+0000","last_fullsized":"2024-05-10T14:02:54.325652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006347+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:02:57.006347+0000","last_peered":"2024-05-10T14:02:57.006347+0000","last_clean":"2024-05-10T14:02:57.006347+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:02:57.006347+0000","last_undegraded":"2024-05-10T14:02:57.006347+0000","last_fullsized":"2024-05-10T14:02:57.006347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":64,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005591+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:02:57.005591+0000","last_peered":"2024-05-10T14:02:57.005591+0000","last_clean":"2024-05-10T14:02:57.005591+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:02:57.005591+0000","last_undegraded":"2024-05-10T14:02:57.005591+0000","last_fullsized":"2024-05-10T14:02:57.005591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328844+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:02:55.328844+0000","last_peered":"2024-05-10T14:02:55.328844+0000","last_clean":"2024-05-10T14:02:55.328844+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:02:55.328844+0000","last_undegraded":"2024-05-10T14:02:55.328844+0000","last_fullsized":"2024-05-10T14:02:55.328844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006776+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:02:57.006776+0000","last_peered":"2024-05-10T14:02:57.006776+0000","last_clean":"2024-05-10T14:02:57.006776+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:02:57.006776+0000","last_undegraded":"2024-05-10T14:02:57.006776+0000","last_fullsized":"2024-05-10T14:02:57.006776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006649+0000","last_change":"2024-05-10T14:02:32.684861+0000","last_active":"2024-05-10T14:02:57.006649+0000","last_peered":"2024-05-10T14:02:57.006649+0000","last_clean":"2024-05-10T14:02:57.006649+0000","last_became_active":"2024-05-10T14:02:32.683137+0000","last_became_peered":"2024-05-10T14:02:32.683137+0000","last_unstale":"2024-05-10T14:02:57.006649+0000","last_undegraded":"2024-05-10T14:02:57.006649+0000","last_fullsized":"2024-05-10T14:02:57.006649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325513+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:02:54.325513+0000","last_peered":"2024-05-10T14:02:54.325513+0000","last_clean":"2024-05-10T14:02:54.325513+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:02:54.325513+0000","last_undegraded":"2024-05-10T14:02:54.325513+0000","last_fullsized":"2024-05-10T14:02:54.325513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352515+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:56.352515+0000","last_peered":"2024-05-10T14:02:56.352515+0000","last_clean":"2024-05-10T14:02:56.352515+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:56.352515+0000","last_undegraded":"2024-05-10T14:02:56.352515+0000","last_fullsized":"2024-05-10T14:02:56.352515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010297+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:02:57.010297+0000","last_peered":"2024-05-10T14:02:57.010297+0000","last_clean":"2024-05-10T14:02:57.010297+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:02:57.010297+0000","last_undegraded":"2024-05-10T14:02:57.010297+0000","last_fullsized":"2024-05-10T14:02:57.010297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324033+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:02:54.324033+0000","last_peered":"2024-05-10T14:02:54.324033+0000","last_clean":"2024-05-10T14:02:54.324033+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:02:54.324033+0000","last_undegraded":"2024-05-10T14:02:54.324033+0000","last_fullsized":"2024-05-10T14:02:54.324033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999742+0000","last_change":"2024-05-10T14:02:38.720704+0000","last_active":"2024-05-10T14:02:56.999742+0000","last_peered":"2024-05-10T14:02:56.999742+0000","last_clean":"2024-05-10T14:02:56.999742+0000","last_became_active":"2024-05-10T14:02:38.719862+0000","last_became_peered":"2024-05-10T14:02:38.719862+0000","last_unstale":"2024-05-10T14:02:56.999742+0000","last_undegraded":"2024-05-10T14:02:56.999742+0000","last_fullsized":"2024-05-10T14:02:56.999742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354426+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:02:56.354426+0000","last_peered":"2024-05-10T14:02:56.354426+0000","last_clean":"2024-05-10T14:02:56.354426+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:02:56.354426+0000","last_undegraded":"2024-05-10T14:02:56.354426+0000","last_fullsized":"2024-05-10T14:02:56.354426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349070+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:02:56.349070+0000","last_peered":"2024-05-10T14:02:56.349070+0000","last_clean":"2024-05-10T14:02:56.349070+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:02:56.349070+0000","last_undegraded":"2024-05-10T14:02:56.349070+0000","last_fullsized":"2024-05-10T14:02:56.349070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354140+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:02:56.354140+0000","last_peered":"2024-05-10T14:02:56.354140+0000","last_clean":"2024-05-10T14:02:56.354140+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:02:56.354140+0000","last_undegraded":"2024-05-10T14:02:56.354140+0000","last_fullsized":"2024-05-10T14:02:56.354140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327073+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:54.327073+0000","last_peered":"2024-05-10T14:02:54.327073+0000","last_clean":"2024-05-10T14:02:54.327073+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:54.327073+0000","last_undegraded":"2024-05-10T14:02:54.327073+0000","last_fullsized":"2024-05-10T14:02:54.327073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329147+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:02:55.329147+0000","last_peered":"2024-05-10T14:02:55.329147+0000","last_clean":"2024-05-10T14:02:55.329147+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:02:55.329147+0000","last_undegraded":"2024-05-10T14:02:55.329147+0000","last_fullsized":"2024-05-10T14:02:55.329147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330211+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:02:55.330211+0000","last_peered":"2024-05-10T14:02:55.330211+0000","last_clean":"2024-05-10T14:02:55.330211+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:02:55.330211+0000","last_undegraded":"2024-05-10T14:02:55.330211+0000","last_fullsized":"2024-05-10T14:02:55.330211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351747+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:02:56.351747+0000","last_peered":"2024-05-10T14:02:56.351747+0000","last_clean":"2024-05-10T14:02:56.351747+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:02:56.351747+0000","last_undegraded":"2024-05-10T14:02:56.351747+0000","last_fullsized":"2024-05-10T14:02:56.351747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004431+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:02:57.004431+0000","last_peered":"2024-05-10T14:02:57.004431+0000","last_clean":"2024-05-10T14:02:57.004431+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:02:57.004431+0000","last_undegraded":"2024-05-10T14:02:57.004431+0000","last_fullsized":"2024-05-10T14:02:57.004431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329430+0000","last_change":"2024-05-10T14:02:32.671389+0000","last_active":"2024-05-10T14:02:55.329430+0000","last_peered":"2024-05-10T14:02:55.329430+0000","last_clean":"2024-05-10T14:02:55.329430+0000","last_became_active":"2024-05-10T14:02:32.670629+0000","last_became_peered":"2024-05-10T14:02:32.670629+0000","last_unstale":"2024-05-10T14:02:55.329430+0000","last_undegraded":"2024-05-10T14:02:55.329430+0000","last_fullsized":"2024-05-10T14:02:55.329430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:54.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008083+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:02:57.008083+0000","last_peered":"2024-05-10T14:02:57.008083+0000","last_clean":"2024-05-10T14:02:57.008083+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:02:57.008083+0000","last_undegraded":"2024-05-10T14:02:57.008083+0000","last_fullsized":"2024-05-10T14:02:57.008083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009760+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:57.009760+0000","last_peered":"2024-05-10T14:02:57.009760+0000","last_clean":"2024-05-10T14:02:57.009760+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:57.009760+0000","last_undegraded":"2024-05-10T14:02:57.009760+0000","last_fullsized":"2024-05-10T14:02:57.009760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348730+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:02:56.348730+0000","last_peered":"2024-05-10T14:02:56.348730+0000","last_clean":"2024-05-10T14:02:56.348730+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:02:56.348730+0000","last_undegraded":"2024-05-10T14:02:56.348730+0000","last_fullsized":"2024-05-10T14:02:56.348730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":68,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350271+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:56.350271+0000","last_peered":"2024-05-10T14:02:56.350271+0000","last_clean":"2024-05-10T14:02:56.350271+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:02:56.350271+0000","last_undegraded":"2024-05-10T14:02:56.350271+0000","last_fullsized":"2024-05-10T14:02:56.350271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350470+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:02:56.350470+0000","last_peered":"2024-05-10T14:02:56.350470+0000","last_clean":"2024-05-10T14:02:56.350470+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:02:56.350470+0000","last_undegraded":"2024-05-10T14:02:56.350470+0000","last_fullsized":"2024-05-10T14:02:56.350470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999378+0000","last_change":"2024-05-10T14:02:40.733773+0000","last_active":"2024-05-10T14:02:56.999378+0000","last_peered":"2024-05-10T14:02:56.999378+0000","last_clean":"2024-05-10T14:02:56.999378+0000","last_became_active":"2024-05-10T14:02:40.732976+0000","last_became_peered":"2024-05-10T14:02:40.732976+0000","last_unstale":"2024-05-10T14:02:56.999378+0000","last_undegraded":"2024-05-10T14:02:56.999378+0000","last_fullsized":"2024-05-10T14:02:56.999378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006960+0000","last_change":"2024-05-10T14:02:40.734335+0000","last_active":"2024-05-10T14:02:57.006960+0000","last_peered":"2024-05-10T14:02:57.006960+0000","last_clean":"2024-05-10T14:02:57.006960+0000","last_became_active":"2024-05-10T14:02:40.733789+0000","last_became_peered":"2024-05-10T14:02:40.733789+0000","last_unstale":"2024-05-10T14:02:57.006960+0000","last_undegraded":"2024-05-10T14:02:57.006960+0000","last_fullsized":"2024-05-10T14:02:57.006960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330231+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:02:55.330231+0000","last_peered":"2024-05-10T14:02:55.330231+0000","last_clean":"2024-05-10T14:02:55.330231+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:02:55.330231+0000","last_undegraded":"2024-05-10T14:02:55.330231+0000","last_fullsized":"2024-05-10T14:02:55.330231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330012+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:02:55.330012+0000","last_peered":"2024-05-10T14:02:55.330012+0000","last_clean":"2024-05-10T14:02:55.330012+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:02:55.330012+0000","last_undegraded":"2024-05-10T14:02:55.330012+0000","last_fullsized":"2024-05-10T14:02:55.330012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325102+0000","last_change":"2024-05-10T14:02:34.706456+0000","last_active":"2024-05-10T14:02:54.325102+0000","last_peered":"2024-05-10T14:02:54.325102+0000","last_clean":"2024-05-10T14:02:54.325102+0000","last_became_active":"2024-05-10T14:02:34.705604+0000","last_became_peered":"2024-05-10T14:02:34.705604+0000","last_unstale":"2024-05-10T14:02:54.325102+0000","last_undegraded":"2024-05-10T14:02:54.325102+0000","last_fullsized":"2024-05-10T14:02:54.325102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:54.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349729+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:02:56.349729+0000","last_peered":"2024-05-10T14:02:56.349729+0000","last_clean":"2024-05-10T14:02:56.349729+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:02:56.349729+0000","last_undegraded":"2024-05-10T14:02:56.349729+0000","last_fullsized":"2024-05-10T14:02:56.349729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348346+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:02:56.348346+0000","last_peered":"2024-05-10T14:02:56.348346+0000","last_clean":"2024-05-10T14:02:56.348346+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:02:56.348346+0000","last_undegraded":"2024-05-10T14:02:56.348346+0000","last_fullsized":"2024-05-10T14:02:56.348346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353542+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:02:56.353542+0000","last_peered":"2024-05-10T14:02:56.353542+0000","last_clean":"2024-05-10T14:02:56.353542+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:02:56.353542+0000","last_undegraded":"2024-05-10T14:02:56.353542+0000","last_fullsized":"2024-05-10T14:02:56.353542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324836+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:02:54.324836+0000","last_peered":"2024-05-10T14:02:54.324836+0000","last_clean":"2024-05-10T14:02:54.324836+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:02:54.324836+0000","last_undegraded":"2024-05-10T14:02:54.324836+0000","last_fullsized":"2024-05-10T14:02:54.324836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352187+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:02:56.352187+0000","last_peered":"2024-05-10T14:02:56.352187+0000","last_clean":"2024-05-10T14:02:56.352187+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:02:56.352187+0000","last_undegraded":"2024-05-10T14:02:56.352187+0000","last_fullsized":"2024-05-10T14:02:56.352187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351084+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:02:56.351084+0000","last_peered":"2024-05-10T14:02:56.351084+0000","last_clean":"2024-05-10T14:02:56.351084+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:02:56.351084+0000","last_undegraded":"2024-05-10T14:02:56.351084+0000","last_fullsized":"2024-05-10T14:02:56.351084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005369+0000","last_change":"2024-05-10T14:02:36.704252+0000","last_active":"2024-05-10T14:02:57.005369+0000","last_peered":"2024-05-10T14:02:57.005369+0000","last_clean":"2024-05-10T14:02:57.005369+0000","last_became_active":"2024-05-10T14:02:36.703671+0000","last_became_peered":"2024-05-10T14:02:36.703671+0000","last_unstale":"2024-05-10T14:02:57.005369+0000","last_undegraded":"2024-05-10T14:02:57.005369+0000","last_fullsized":"2024-05-10T14:02:57.005369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351737+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:02:56.351737+0000","last_peered":"2024-05-10T14:02:56.351737+0000","last_clean":"2024-05-10T14:02:56.351737+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:02:56.351737+0000","last_undegraded":"2024-05-10T14:02:56.351737+0000","last_fullsized":"2024-05-10T14:02:56.351737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004817+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:02:57.004817+0000","last_peered":"2024-05-10T14:02:57.004817+0000","last_clean":"2024-05-10T14:02:57.004817+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:02:57.004817+0000","last_undegraded":"2024-05-10T14:02:57.004817+0000","last_fullsized":"2024-05-10T14:02:57.004817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349986+0000","last_change":"2024-05-10T14:02:32.680541+0000","last_active":"2024-05-10T14:02:56.349986+0000","last_peered":"2024-05-10T14:02:56.349986+0000","last_clean":"2024-05-10T14:02:56.349986+0000","last_became_active":"2024-05-10T14:02:32.678843+0000","last_became_peered":"2024-05-10T14:02:32.678843+0000","last_unstale":"2024-05-10T14:02:56.349986+0000","last_undegraded":"2024-05-10T14:02:56.349986+0000","last_fullsized":"2024-05-10T14:02:56.349986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000913+0000","last_change":"2024-05-10T14:02:30.657936+0000","last_active":"2024-05-10T14:02:57.000913+0000","last_peered":"2024-05-10T14:02:57.000913+0000","last_clean":"2024-05-10T14:02:57.000913+0000","last_became_active":"2024-05-10T14:02:30.657176+0000","last_became_peered":"2024-05-10T14:02:30.657176+0000","last_unstale":"2024-05-10T14:02:57.000913+0000","last_undegraded":"2024-05-10T14:02:57.000913+0000","last_fullsized":"2024-05-10T14:02:57.000913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349554+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:02:56.349554+0000","last_peered":"2024-05-10T14:02:56.349554+0000","last_clean":"2024-05-10T14:02:56.349554+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:02:56.349554+0000","last_undegraded":"2024-05-10T14:02:56.349554+0000","last_fullsized":"2024-05-10T14:02:56.349554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350857+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:02:56.350857+0000","last_peered":"2024-05-10T14:02:56.350857+0000","last_clean":"2024-05-10T14:02:56.350857+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:02:56.350857+0000","last_undegraded":"2024-05-10T14:02:56.350857+0000","last_fullsized":"2024-05-10T14:02:56.350857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010160+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:02:57.010160+0000","last_peered":"2024-05-10T14:02:57.010160+0000","last_clean":"2024-05-10T14:02:57.010160+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:02:57.010160+0000","last_undegraded":"2024-05-10T14:02:57.010160+0000","last_fullsized":"2024-05-10T14:02:57.010160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999179+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:56.999179+0000","last_peered":"2024-05-10T14:02:56.999179+0000","last_clean":"2024-05-10T14:02:56.999179+0000","last_became_active":"2024-05-10T14:02:40.733097+0000","last_became_peered":"2024-05-10T14:02:40.733097+0000","last_unstale":"2024-05-10T14:02:56.999179+0000","last_undegraded":"2024-05-10T14:02:56.999179+0000","last_fullsized":"2024-05-10T14:02:56.999179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349407+0000","last_change":"2024-05-10T14:02:32.676636+0000","last_active":"2024-05-10T14:02:56.349407+0000","last_peered":"2024-05-10T14:02:56.349407+0000","last_clean":"2024-05-10T14:02:56.349407+0000","last_became_active":"2024-05-10T14:02:32.673068+0000","last_became_peered":"2024-05-10T14:02:32.673068+0000","last_unstale":"2024-05-10T14:02:56.349407+0000","last_undegraded":"2024-05-10T14:02:56.349407+0000","last_fullsized":"2024-05-10T14:02:56.349407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008126+0000","last_change":"2024-05-10T14:02:30.664601+0000","last_active":"2024-05-10T14:02:57.008126+0000","last_peered":"2024-05-10T14:02:57.008126+0000","last_clean":"2024-05-10T14:02:57.008126+0000","last_became_active":"2024-05-10T14:02:30.664274+0000","last_became_peered":"2024-05-10T14:02:30.664274+0000","last_unstale":"2024-05-10T14:02:57.008126+0000","last_undegraded":"2024-05-10T14:02:57.008126+0000","last_fullsized":"2024-05-10T14:02:57.008126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010184+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:02:57.010184+0000","last_peered":"2024-05-10T14:02:57.010184+0000","last_clean":"2024-05-10T14:02:57.010184+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:02:57.010184+0000","last_undegraded":"2024-05-10T14:02:57.010184+0000","last_fullsized":"2024-05-10T14:02:57.010184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350455+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:02:56.350455+0000","last_peered":"2024-05-10T14:02:56.350455+0000","last_clean":"2024-05-10T14:02:56.350455+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:02:56.350455+0000","last_undegraded":"2024-05-10T14:02:56.350455+0000","last_fullsized":"2024-05-10T14:02:56.350455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006011+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:02:57.006011+0000","last_peered":"2024-05-10T14:02:57.006011+0000","last_clean":"2024-05-10T14:02:57.006011+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:02:57.006011+0000","last_undegraded":"2024-05-10T14:02:57.006011+0000","last_fullsized":"2024-05-10T14:02:57.006011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010996+0000","last_change":"2024-05-10T14:02:32.684577+0000","last_active":"2024-05-10T14:02:57.010996+0000","last_peered":"2024-05-10T14:02:57.010996+0000","last_clean":"2024-05-10T14:02:57.010996+0000","last_became_active":"2024-05-10T14:02:32.683843+0000","last_became_peered":"2024-05-10T14:02:32.683843+0000","last_unstale":"2024-05-10T14:02:57.010996+0000","last_undegraded":"2024-05-10T14:02:57.010996+0000","last_fullsized":"2024-05-10T14:02:57.010996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349881+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:02:56.349881+0000","last_peered":"2024-05-10T14:02:56.349881+0000","last_clean":"2024-05-10T14:02:56.349881+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:02:56.349881+0000","last_undegraded":"2024-05-10T14:02:56.349881+0000","last_fullsized":"2024-05-10T14:02:56.349881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007867+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:02:57.007867+0000","last_peered":"2024-05-10T14:02:57.007867+0000","last_clean":"2024-05-10T14:02:57.007867+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:02:57.007867+0000","last_undegraded":"2024-05-10T14:02:57.007867+0000","last_fullsized":"2024-05-10T14:02:57.007867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324893+0000","last_change":"2024-05-10T14:02:36.696412+0000","last_active":"2024-05-10T14:02:54.324893+0000","last_peered":"2024-05-10T14:02:54.324893+0000","last_clean":"2024-05-10T14:02:54.324893+0000","last_became_active":"2024-05-10T14:02:36.695516+0000","last_became_peered":"2024-05-10T14:02:36.695516+0000","last_unstale":"2024-05-10T14:02:54.324893+0000","last_undegraded":"2024-05-10T14:02:54.324893+0000","last_fullsized":"2024-05-10T14:02:54.324893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:24.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000298+0000","last_change":"2024-05-10T14:02:38.730974+0000","last_active":"2024-05-10T14:02:57.000298+0000","last_peered":"2024-05-10T14:02:57.000298+0000","last_clean":"2024-05-10T14:02:57.000298+0000","last_became_active":"2024-05-10T14:02:38.730309+0000","last_became_peered":"2024-05-10T14:02:38.730309+0000","last_unstale":"2024-05-10T14:02:57.000298+0000","last_undegraded":"2024-05-10T14:02:57.000298+0000","last_fullsized":"2024-05-10T14:02:57.000298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350563+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:02:56.350563+0000","last_peered":"2024-05-10T14:02:56.350563+0000","last_clean":"2024-05-10T14:02:56.350563+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:02:56.350563+0000","last_undegraded":"2024-05-10T14:02:56.350563+0000","last_fullsized":"2024-05-10T14:02:56.350563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004838+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:02:57.004838+0000","last_peered":"2024-05-10T14:02:57.004838+0000","last_clean":"2024-05-10T14:02:57.004838+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:02:57.004838+0000","last_undegraded":"2024-05-10T14:02:57.004838+0000","last_fullsized":"2024-05-10T14:02:57.004838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324984+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:02:54.324984+0000","last_peered":"2024-05-10T14:02:54.324984+0000","last_clean":"2024-05-10T14:02:54.324984+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:02:54.324984+0000","last_undegraded":"2024-05-10T14:02:54.324984+0000","last_fullsized":"2024-05-10T14:02:54.324984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010844+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:02:57.010844+0000","last_peered":"2024-05-10T14:02:57.010844+0000","last_clean":"2024-05-10T14:02:57.010844+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:02:57.010844+0000","last_undegraded":"2024-05-10T14:02:57.010844+0000","last_fullsized":"2024-05-10T14:02:57.010844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350366+0000","last_change":"2024-05-10T14:02:36.699400+0000","last_active":"2024-05-10T14:02:56.350366+0000","last_peered":"2024-05-10T14:02:56.350366+0000","last_clean":"2024-05-10T14:02:56.350366+0000","last_became_active":"2024-05-10T14:02:36.698700+0000","last_became_peered":"2024-05-10T14:02:36.698700+0000","last_unstale":"2024-05-10T14:02:56.350366+0000","last_undegraded":"2024-05-10T14:02:56.350366+0000","last_fullsized":"2024-05-10T14:02:56.350366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325196+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:02:54.325196+0000","last_peered":"2024-05-10T14:02:54.325196+0000","last_clean":"2024-05-10T14:02:54.325196+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:02:54.325196+0000","last_undegraded":"2024-05-10T14:02:54.325196+0000","last_fullsized":"2024-05-10T14:02:54.325196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009897+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:02:57.009897+0000","last_peered":"2024-05-10T14:02:57.009897+0000","last_clean":"2024-05-10T14:02:57.009897+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:02:57.009897+0000","last_undegraded":"2024-05-10T14:02:57.009897+0000","last_fullsized":"2024-05-10T14:02:57.009897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351039+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:02:56.351039+0000","last_peered":"2024-05-10T14:02:56.351039+0000","last_clean":"2024-05-10T14:02:56.351039+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:02:56.351039+0000","last_undegraded":"2024-05-10T14:02:56.351039+0000","last_fullsized":"2024-05-10T14:02:56.351039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330641+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:02:55.330641+0000","last_peered":"2024-05-10T14:02:55.330641+0000","last_clean":"2024-05-10T14:02:55.330641+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:02:55.330641+0000","last_undegraded":"2024-05-10T14:02:55.330641+0000","last_fullsized":"2024-05-10T14:02:55.330641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331228+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:02:55.331228+0000","last_peered":"2024-05-10T14:02:55.331228+0000","last_clean":"2024-05-10T14:02:55.331228+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:02:55.331228+0000","last_undegraded":"2024-05-10T14:02:55.331228+0000","last_fullsized":"2024-05-10T14:02:55.331228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354616+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:02:56.354616+0000","last_peered":"2024-05-10T14:02:56.354616+0000","last_clean":"2024-05-10T14:02:56.354616+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:02:56.354616+0000","last_undegraded":"2024-05-10T14:02:56.354616+0000","last_fullsized":"2024-05-10T14:02:56.354616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324301+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:02:54.324301+0000","last_peered":"2024-05-10T14:02:54.324301+0000","last_clean":"2024-05-10T14:02:54.324301+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:02:54.324301+0000","last_undegraded":"2024-05-10T14:02:54.324301+0000","last_fullsized":"2024-05-10T14:02:54.324301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999103+0000","last_change":"2024-05-10T14:02:40.733960+0000","last_active":"2024-05-10T14:02:56.999103+0000","last_peered":"2024-05-10T14:02:56.999103+0000","last_clean":"2024-05-10T14:02:56.999103+0000","last_became_active":"2024-05-10T14:02:40.733072+0000","last_became_peered":"2024-05-10T14:02:40.733072+0000","last_unstale":"2024-05-10T14:02:56.999103+0000","last_undegraded":"2024-05-10T14:02:56.999103+0000","last_fullsized":"2024-05-10T14:02:56.999103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847420+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:02:55.847420+0000","last_peered":"2024-05-10T14:02:55.847420+0000","last_clean":"2024-05-10T14:02:55.847420+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:02:55.847420+0000","last_undegraded":"2024-05-10T14:02:55.847420+0000","last_fullsized":"2024-05-10T14:02:55.847420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006129+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:02:57.006129+0000","last_peered":"2024-05-10T14:02:57.006129+0000","last_clean":"2024-05-10T14:02:57.006129+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:02:57.006129+0000","last_undegraded":"2024-05-10T14:02:57.006129+0000","last_fullsized":"2024-05-10T14:02:57.006129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325446+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:02:54.325446+0000","last_peered":"2024-05-10T14:02:54.325446+0000","last_clean":"2024-05-10T14:02:54.325446+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:02:54.325446+0000","last_undegraded":"2024-05-10T14:02:54.325446+0000","last_fullsized":"2024-05-10T14:02:54.325446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331578+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:02:55.331578+0000","last_peered":"2024-05-10T14:02:55.331578+0000","last_clean":"2024-05-10T14:02:55.331578+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:02:55.331578+0000","last_undegraded":"2024-05-10T14:02:55.331578+0000","last_fullsized":"2024-05-10T14:02:55.331578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010670+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:02:57.010670+0000","last_peered":"2024-05-10T14:02:57.010670+0000","last_clean":"2024-05-10T14:02:57.010670+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:02:57.010670+0000","last_undegraded":"2024-05-10T14:02:57.010670+0000","last_fullsized":"2024-05-10T14:02:57.010670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349554+0000","last_change":"2024-05-10T14:02:40.736838+0000","last_active":"2024-05-10T14:02:56.349554+0000","last_peered":"2024-05-10T14:02:56.349554+0000","last_clean":"2024-05-10T14:02:56.349554+0000","last_became_active":"2024-05-10T14:02:40.735991+0000","last_became_peered":"2024-05-10T14:02:40.735991+0000","last_unstale":"2024-05-10T14:02:56.349554+0000","last_undegraded":"2024-05-10T14:02:56.349554+0000","last_fullsized":"2024-05-10T14:02:56.349554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:22.716620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329982+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:02:55.329982+0000","last_peered":"2024-05-10T14:02:55.329982+0000","last_clean":"2024-05-10T14:02:55.329982+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:02:55.329982+0000","last_undegraded":"2024-05-10T14:02:55.329982+0000","last_fullsized":"2024-05-10T14:02:55.329982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000475+0000","last_change":"2024-05-10T14:02:30.661826+0000","last_active":"2024-05-10T14:02:57.000475+0000","last_peered":"2024-05-10T14:02:57.000475+0000","last_clean":"2024-05-10T14:02:57.000475+0000","last_became_active":"2024-05-10T14:02:30.660030+0000","last_became_peered":"2024-05-10T14:02:30.660030+0000","last_unstale":"2024-05-10T14:02:57.000475+0000","last_undegraded":"2024-05-10T14:02:57.000475+0000","last_fullsized":"2024-05-10T14:02:57.000475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350747+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:02:56.350747+0000","last_peered":"2024-05-10T14:02:56.350747+0000","last_clean":"2024-05-10T14:02:56.350747+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:02:56.350747+0000","last_undegraded":"2024-05-10T14:02:56.350747+0000","last_fullsized":"2024-05-10T14:02:56.350747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999847+0000","last_change":"2024-05-10T14:02:36.701658+0000","last_active":"2024-05-10T14:02:56.999847+0000","last_peered":"2024-05-10T14:02:56.999847+0000","last_clean":"2024-05-10T14:02:56.999847+0000","last_became_active":"2024-05-10T14:02:36.700840+0000","last_became_peered":"2024-05-10T14:02:36.700840+0000","last_unstale":"2024-05-10T14:02:56.999847+0000","last_undegraded":"2024-05-10T14:02:56.999847+0000","last_fullsized":"2024-05-10T14:02:56.999847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005213+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:02:57.005213+0000","last_peered":"2024-05-10T14:02:57.005213+0000","last_clean":"2024-05-10T14:02:57.005213+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:02:57.005213+0000","last_undegraded":"2024-05-10T14:02:57.005213+0000","last_fullsized":"2024-05-10T14:02:57.005213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352049+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:02:56.352049+0000","last_peered":"2024-05-10T14:02:56.352049+0000","last_clean":"2024-05-10T14:02:56.352049+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:02:56.352049+0000","last_undegraded":"2024-05-10T14:02:56.352049+0000","last_fullsized":"2024-05-10T14:02:56.352049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330342+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:02:55.330342+0000","last_peered":"2024-05-10T14:02:55.330342+0000","last_clean":"2024-05-10T14:02:55.330342+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:02:55.330342+0000","last_undegraded":"2024-05-10T14:02:55.330342+0000","last_fullsized":"2024-05-10T14:02:55.330342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000699+0000","last_change":"2024-05-10T14:02:30.660120+0000","last_active":"2024-05-10T14:02:57.000699+0000","last_peered":"2024-05-10T14:02:57.000699+0000","last_clean":"2024-05-10T14:02:57.000699+0000","last_became_active":"2024-05-10T14:02:30.658976+0000","last_became_peered":"2024-05-10T14:02:30.658976+0000","last_unstale":"2024-05-10T14:02:57.000699+0000","last_undegraded":"2024-05-10T14:02:57.000699+0000","last_fullsized":"2024-05-10T14:02:57.000699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000200+0000","last_change":"2024-05-10T14:02:34.700027+0000","last_active":"2024-05-10T14:02:57.000200+0000","last_peered":"2024-05-10T14:02:57.000200+0000","last_clean":"2024-05-10T14:02:57.000200+0000","last_became_active":"2024-05-10T14:02:34.699301+0000","last_became_peered":"2024-05-10T14:02:34.699301+0000","last_unstale":"2024-05-10T14:02:57.000200+0000","last_undegraded":"2024-05-10T14:02:57.000200+0000","last_fullsized":"2024-05-10T14:02:57.000200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:30:40.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005225+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:02:57.005225+0000","last_peered":"2024-05-10T14:02:57.005225+0000","last_clean":"2024-05-10T14:02:57.005225+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:02:57.005225+0000","last_undegraded":"2024-05-10T14:02:57.005225+0000","last_fullsized":"2024-05-10T14:02:57.005225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010063+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:02:57.010063+0000","last_peered":"2024-05-10T14:02:57.010063+0000","last_clean":"2024-05-10T14:02:57.010063+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:02:57.010063+0000","last_undegraded":"2024-05-10T14:02:57.010063+0000","last_fullsized":"2024-05-10T14:02:57.010063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353769+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:02:56.353769+0000","last_peered":"2024-05-10T14:02:56.353769+0000","last_clean":"2024-05-10T14:02:56.353769+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:02:56.353769+0000","last_undegraded":"2024-05-10T14:02:56.353769+0000","last_fullsized":"2024-05-10T14:02:56.353769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350071+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:02:56.350071+0000","last_peered":"2024-05-10T14:02:56.350071+0000","last_clean":"2024-05-10T14:02:56.350071+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:02:56.350071+0000","last_undegraded":"2024-05-10T14:02:56.350071+0000","last_fullsized":"2024-05-10T14:02:56.350071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354223+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:02:56.354223+0000","last_peered":"2024-05-10T14:02:56.354223+0000","last_clean":"2024-05-10T14:02:56.354223+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:02:56.354223+0000","last_undegraded":"2024-05-10T14:02:56.354223+0000","last_fullsized":"2024-05-10T14:02:56.354223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328839+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:02:55.328839+0000","last_peered":"2024-05-10T14:02:55.328839+0000","last_clean":"2024-05-10T14:02:55.328839+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:02:55.328839+0000","last_undegraded":"2024-05-10T14:02:55.328839+0000","last_fullsized":"2024-05-10T14:02:55.328839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351646+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:02:56.351646+0000","last_peered":"2024-05-10T14:02:56.351646+0000","last_clean":"2024-05-10T14:02:56.351646+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:02:56.351646+0000","last_undegraded":"2024-05-10T14:02:56.351646+0000","last_fullsized":"2024-05-10T14:02:56.351646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329146+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:02:55.329146+0000","last_peered":"2024-05-10T14:02:55.329146+0000","last_clean":"2024-05-10T14:02:55.329146+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:02:55.329146+0000","last_undegraded":"2024-05-10T14:02:55.329146+0000","last_fullsized":"2024-05-10T14:02:55.329146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351677+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:02:56.351677+0000","last_peered":"2024-05-10T14:02:56.351677+0000","last_clean":"2024-05-10T14:02:56.351677+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:02:56.351677+0000","last_undegraded":"2024-05-10T14:02:56.351677+0000","last_fullsized":"2024-05-10T14:02:56.351677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329689+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:02:55.329689+0000","last_peered":"2024-05-10T14:02:55.329689+0000","last_clean":"2024-05-10T14:02:55.329689+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:02:55.329689+0000","last_undegraded":"2024-05-10T14:02:55.329689+0000","last_fullsized":"2024-05-10T14:02:55.329689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008140+0000","last_change":"2024-05-10T14:02:30.664222+0000","last_active":"2024-05-10T14:02:57.008140+0000","last_peered":"2024-05-10T14:02:57.008140+0000","last_clean":"2024-05-10T14:02:57.008140+0000","last_became_active":"2024-05-10T14:02:30.663784+0000","last_became_peered":"2024-05-10T14:02:30.663784+0000","last_unstale":"2024-05-10T14:02:57.008140+0000","last_undegraded":"2024-05-10T14:02:57.008140+0000","last_fullsized":"2024-05-10T14:02:57.008140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324206+0000","last_change":"2024-05-10T14:02:34.706054+0000","last_active":"2024-05-10T14:02:54.324206+0000","last_peered":"2024-05-10T14:02:54.324206+0000","last_clean":"2024-05-10T14:02:54.324206+0000","last_became_active":"2024-05-10T14:02:34.705486+0000","last_became_peered":"2024-05-10T14:02:34.705486+0000","last_unstale":"2024-05-10T14:02:54.324206+0000","last_undegraded":"2024-05-10T14:02:54.324206+0000","last_fullsized":"2024-05-10T14:02:54.324206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:05.822560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329312+0000","last_change":"2024-05-10T14:02:36.695528+0000","last_active":"2024-05-10T14:02:55.329312+0000","last_peered":"2024-05-10T14:02:55.329312+0000","last_clean":"2024-05-10T14:02:55.329312+0000","last_became_active":"2024-05-10T14:02:36.694789+0000","last_became_peered":"2024-05-10T14:02:36.694789+0000","last_unstale":"2024-05-10T14:02:55.329312+0000","last_undegraded":"2024-05-10T14:02:55.329312+0000","last_fullsized":"2024-05-10T14:02:55.329312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006439+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:02:57.006439+0000","last_peered":"2024-05-10T14:02:57.006439+0000","last_clean":"2024-05-10T14:02:57.006439+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:02:57.006439+0000","last_undegraded":"2024-05-10T14:02:57.006439+0000","last_fullsized":"2024-05-10T14:02:57.006439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331348+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:02:55.331348+0000","last_peered":"2024-05-10T14:02:55.331348+0000","last_clean":"2024-05-10T14:02:55.331348+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:02:55.331348+0000","last_undegraded":"2024-05-10T14:02:55.331348+0000","last_fullsized":"2024-05-10T14:02:55.331348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326979+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:02:54.326979+0000","last_peered":"2024-05-10T14:02:54.326979+0000","last_clean":"2024-05-10T14:02:54.326979+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:02:54.326979+0000","last_undegraded":"2024-05-10T14:02:54.326979+0000","last_fullsized":"2024-05-10T14:02:54.326979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010137+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:02:57.010137+0000","last_peered":"2024-05-10T14:02:57.010137+0000","last_clean":"2024-05-10T14:02:57.010137+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:02:57.010137+0000","last_undegraded":"2024-05-10T14:02:57.010137+0000","last_fullsized":"2024-05-10T14:02:57.010137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326757+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:02:54.326757+0000","last_peered":"2024-05-10T14:02:54.326757+0000","last_clean":"2024-05-10T14:02:54.326757+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:02:54.326757+0000","last_undegraded":"2024-05-10T14:02:54.326757+0000","last_fullsized":"2024-05-10T14:02:54.326757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.846962+0000","last_change":"2024-05-10T14:02:30.663047+0000","last_active":"2024-05-10T14:02:55.846962+0000","last_peered":"2024-05-10T14:02:55.846962+0000","last_clean":"2024-05-10T14:02:55.846962+0000","last_became_active":"2024-05-10T14:02:30.662722+0000","last_became_peered":"2024-05-10T14:02:30.662722+0000","last_unstale":"2024-05-10T14:02:55.846962+0000","last_undegraded":"2024-05-10T14:02:55.846962+0000","last_fullsized":"2024-05-10T14:02:55.846962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999293+0000","last_change":"2024-05-10T14:02:32.685578+0000","last_active":"2024-05-10T14:02:56.999293+0000","last_peered":"2024-05-10T14:02:56.999293+0000","last_clean":"2024-05-10T14:02:56.999293+0000","last_became_active":"2024-05-10T14:02:32.682816+0000","last_became_peered":"2024-05-10T14:02:32.682816+0000","last_unstale":"2024-05-10T14:02:56.999293+0000","last_undegraded":"2024-05-10T14:02:56.999293+0000","last_fullsized":"2024-05-10T14:02:56.999293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000193+0000","last_change":"2024-05-10T14:02:30.667144+0000","last_active":"2024-05-10T14:02:57.000193+0000","last_peered":"2024-05-10T14:02:57.000193+0000","last_clean":"2024-05-10T14:02:57.000193+0000","last_became_active":"2024-05-10T14:02:30.666407+0000","last_became_peered":"2024-05-10T14:02:30.666407+0000","last_unstale":"2024-05-10T14:02:57.000193+0000","last_undegraded":"2024-05-10T14:02:57.000193+0000","last_fullsized":"2024-05-10T14:02:57.000193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325592+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:02:54.325592+0000","last_peered":"2024-05-10T14:02:54.325592+0000","last_clean":"2024-05-10T14:02:54.325592+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:02:54.325592+0000","last_undegraded":"2024-05-10T14:02:54.325592+0000","last_fullsized":"2024-05-10T14:02:54.325592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006240+0000","last_change":"2024-05-10T14:02:30.644592+0000","last_active":"2024-05-10T14:02:57.006240+0000","last_peered":"2024-05-10T14:02:57.006240+0000","last_clean":"2024-05-10T14:02:57.006240+0000","last_became_active":"2024-05-10T14:02:30.644241+0000","last_became_peered":"2024-05-10T14:02:30.644241+0000","last_unstale":"2024-05-10T14:02:57.006240+0000","last_undegraded":"2024-05-10T14:02:57.006240+0000","last_fullsized":"2024-05-10T14:02:57.006240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351359+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:02:56.351359+0000","last_peered":"2024-05-10T14:02:56.351359+0000","last_clean":"2024-05-10T14:02:56.351359+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:02:56.351359+0000","last_undegraded":"2024-05-10T14:02:56.351359+0000","last_fullsized":"2024-05-10T14:02:56.351359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353323+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:02:56.353323+0000","last_peered":"2024-05-10T14:02:56.353323+0000","last_clean":"2024-05-10T14:02:56.353323+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:02:56.353323+0000","last_undegraded":"2024-05-10T14:02:56.353323+0000","last_fullsized":"2024-05-10T14:02:56.353323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330479+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:02:55.330479+0000","last_peered":"2024-05-10T14:02:55.330479+0000","last_clean":"2024-05-10T14:02:55.330479+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:02:55.330479+0000","last_undegraded":"2024-05-10T14:02:55.330479+0000","last_fullsized":"2024-05-10T14:02:55.330479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325729+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:02:54.325729+0000","last_peered":"2024-05-10T14:02:54.325729+0000","last_clean":"2024-05-10T14:02:54.325729+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:02:54.325729+0000","last_undegraded":"2024-05-10T14:02:54.325729+0000","last_fullsized":"2024-05-10T14:02:54.325729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349933+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:02:56.349933+0000","last_peered":"2024-05-10T14:02:56.349933+0000","last_clean":"2024-05-10T14:02:56.349933+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:02:56.349933+0000","last_undegraded":"2024-05-10T14:02:56.349933+0000","last_fullsized":"2024-05-10T14:02:56.349933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.011005+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:02:57.011005+0000","last_peered":"2024-05-10T14:02:57.011005+0000","last_clean":"2024-05-10T14:02:57.011005+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:02:57.011005+0000","last_undegraded":"2024-05-10T14:02:57.011005+0000","last_fullsized":"2024-05-10T14:02:57.011005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010034+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:02:57.010034+0000","last_peered":"2024-05-10T14:02:57.010034+0000","last_clean":"2024-05-10T14:02:57.010034+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:02:57.010034+0000","last_undegraded":"2024-05-10T14:02:57.010034+0000","last_fullsized":"2024-05-10T14:02:57.010034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354375+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:02:56.354375+0000","last_peered":"2024-05-10T14:02:56.354375+0000","last_clean":"2024-05-10T14:02:56.354375+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:02:56.354375+0000","last_undegraded":"2024-05-10T14:02:56.354375+0000","last_fullsized":"2024-05-10T14:02:56.354375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004696+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:02:57.004696+0000","last_peered":"2024-05-10T14:02:57.004696+0000","last_clean":"2024-05-10T14:02:57.004696+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:02:57.004696+0000","last_undegraded":"2024-05-10T14:02:57.004696+0000","last_fullsized":"2024-05-10T14:02:57.004696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999898+0000","last_change":"2024-05-10T14:02:30.656911+0000","last_active":"2024-05-10T14:02:56.999898+0000","last_peered":"2024-05-10T14:02:56.999898+0000","last_clean":"2024-05-10T14:02:56.999898+0000","last_became_active":"2024-05-10T14:02:30.650731+0000","last_became_peered":"2024-05-10T14:02:30.650731+0000","last_unstale":"2024-05-10T14:02:56.999898+0000","last_undegraded":"2024-05-10T14:02:56.999898+0000","last_fullsized":"2024-05-10T14:02:56.999898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331846+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:02:55.331846+0000","last_peered":"2024-05-10T14:02:55.331846+0000","last_clean":"2024-05-10T14:02:55.331846+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:02:55.331846+0000","last_undegraded":"2024-05-10T14:02:55.331846+0000","last_fullsized":"2024-05-10T14:02:55.331846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350121+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:02:56.350121+0000","last_peered":"2024-05-10T14:02:56.350121+0000","last_clean":"2024-05-10T14:02:56.350121+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:02:56.350121+0000","last_undegraded":"2024-05-10T14:02:56.350121+0000","last_fullsized":"2024-05-10T14:02:56.350121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847619+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:02:55.847619+0000","last_peered":"2024-05-10T14:02:55.847619+0000","last_clean":"2024-05-10T14:02:55.847619+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:02:55.847619+0000","last_undegraded":"2024-05-10T14:02:55.847619+0000","last_fullsized":"2024-05-10T14:02:55.847619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000056+0000","last_change":"2024-05-10T14:02:30.665295+0000","last_active":"2024-05-10T14:02:57.000056+0000","last_peered":"2024-05-10T14:02:57.000056+0000","last_clean":"2024-05-10T14:02:57.000056+0000","last_became_active":"2024-05-10T14:02:30.663923+0000","last_became_peered":"2024-05-10T14:02:30.663923+0000","last_unstale":"2024-05-10T14:02:57.000056+0000","last_undegraded":"2024-05-10T14:02:57.000056+0000","last_fullsized":"2024-05-10T14:02:57.000056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330951+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:02:55.330951+0000","last_peered":"2024-05-10T14:02:55.330951+0000","last_clean":"2024-05-10T14:02:55.330951+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:02:55.330951+0000","last_undegraded":"2024-05-10T14:02:55.330951+0000","last_fullsized":"2024-05-10T14:02:55.330951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006410+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:02:57.006410+0000","last_peered":"2024-05-10T14:02:57.006410+0000","last_clean":"2024-05-10T14:02:57.006410+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:02:57.006410+0000","last_undegraded":"2024-05-10T14:02:57.006410+0000","last_fullsized":"2024-05-10T14:02:57.006410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350878+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:02:56.350878+0000","last_peered":"2024-05-10T14:02:56.350878+0000","last_clean":"2024-05-10T14:02:56.350878+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:02:56.350878+0000","last_undegraded":"2024-05-10T14:02:56.350878+0000","last_fullsized":"2024-05-10T14:02:56.350878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010650+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:02:57.010650+0000","last_peered":"2024-05-10T14:02:57.010650+0000","last_clean":"2024-05-10T14:02:57.010650+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:02:57.010650+0000","last_undegraded":"2024-05-10T14:02:57.010650+0000","last_fullsized":"2024-05-10T14:02:57.010650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004461+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:02:57.004461+0000","last_peered":"2024-05-10T14:02:57.004461+0000","last_clean":"2024-05-10T14:02:57.004461+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:02:57.004461+0000","last_undegraded":"2024-05-10T14:02:57.004461+0000","last_fullsized":"2024-05-10T14:02:57.004461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352425+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:02:56.352425+0000","last_peered":"2024-05-10T14:02:56.352425+0000","last_clean":"2024-05-10T14:02:56.352425+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:02:56.352425+0000","last_undegraded":"2024-05-10T14:02:56.352425+0000","last_fullsized":"2024-05-10T14:02:56.352425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349877+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:02:56.349877+0000","last_peered":"2024-05-10T14:02:56.349877+0000","last_clean":"2024-05-10T14:02:56.349877+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:02:56.349877+0000","last_undegraded":"2024-05-10T14:02:56.349877+0000","last_fullsized":"2024-05-10T14:02:56.349877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847797+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:02:55.847797+0000","last_peered":"2024-05-10T14:02:55.847797+0000","last_clean":"2024-05-10T14:02:55.847797+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:02:55.847797+0000","last_undegraded":"2024-05-10T14:02:55.847797+0000","last_fullsized":"2024-05-10T14:02:55.847797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350046+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:02:56.350046+0000","last_peered":"2024-05-10T14:02:56.350046+0000","last_clean":"2024-05-10T14:02:56.350046+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:02:56.350046+0000","last_undegraded":"2024-05-10T14:02:56.350046+0000","last_fullsized":"2024-05-10T14:02:56.350046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.001111+0000","last_change":"2024-05-10T14:02:30.662908+0000","last_active":"2024-05-10T14:02:57.001111+0000","last_peered":"2024-05-10T14:02:57.001111+0000","last_clean":"2024-05-10T14:02:57.001111+0000","last_became_active":"2024-05-10T14:02:30.661976+0000","last_became_peered":"2024-05-10T14:02:30.661976+0000","last_unstale":"2024-05-10T14:02:57.001111+0000","last_undegraded":"2024-05-10T14:02:57.001111+0000","last_fullsized":"2024-05-10T14:02:57.001111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999893+0000","last_change":"2024-05-10T14:02:30.667582+0000","last_active":"2024-05-10T14:02:56.999893+0000","last_peered":"2024-05-10T14:02:56.999893+0000","last_clean":"2024-05-10T14:02:56.999893+0000","last_became_active":"2024-05-10T14:02:30.657669+0000","last_became_peered":"2024-05-10T14:02:30.657669+0000","last_unstale":"2024-05-10T14:02:56.999893+0000","last_undegraded":"2024-05-10T14:02:56.999893+0000","last_fullsized":"2024-05-10T14:02:56.999893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004832+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:02:57.004832+0000","last_peered":"2024-05-10T14:02:57.004832+0000","last_clean":"2024-05-10T14:02:57.004832+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:02:57.004832+0000","last_undegraded":"2024-05-10T14:02:57.004832+0000","last_fullsized":"2024-05-10T14:02:57.004832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324822+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:02:54.324822+0000","last_peered":"2024-05-10T14:02:54.324822+0000","last_clean":"2024-05-10T14:02:54.324822+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:02:54.324822+0000","last_undegraded":"2024-05-10T14:02:54.324822+0000","last_fullsized":"2024-05-10T14:02:54.324822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000830+0000","last_change":"2024-05-10T14:02:32.681773+0000","last_active":"2024-05-10T14:02:57.000830+0000","last_peered":"2024-05-10T14:02:57.000830+0000","last_clean":"2024-05-10T14:02:57.000830+0000","last_became_active":"2024-05-10T14:02:32.681013+0000","last_became_peered":"2024-05-10T14:02:32.681013+0000","last_unstale":"2024-05-10T14:02:57.000830+0000","last_undegraded":"2024-05-10T14:02:57.000830+0000","last_fullsized":"2024-05-10T14:02:57.000830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":798115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":207523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":207578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":487424,"data_stored":207483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":206649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1073152,"data_stored":797957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":462848,"data_stored":192053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:58.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:02:58.932 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:58.935+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:59.014 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:59.014 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:02:59.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:02:59.014 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 39.466171148999997, 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:02:59.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:02:59.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:02:59.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.843267392000001, 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.021 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:02:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:02:59.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747733746000002, 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:02:59.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.74767954, 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:02:59.033 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:02:59.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:02:59.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747642669999998, 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.039 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:02:59.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.044 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747481125, 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:59.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:02:59.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:02:59.049 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747427784999999, 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.050 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:02:59.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:02:59.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.055 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747369866, 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:02:59.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:02:59.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:02:59.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747240116999997, 2024-05-10T14:02:59.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:02:59.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:02:59.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.067 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.747201660000002, 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:02:59.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:02:59.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:02:59.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:02:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.520078537000003, 2024-05-10T14:02:59.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:02:59.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:02:59.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:02:59.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:02:59.078 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519871092000002, 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.079 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.084 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519757206000001, 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:59.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519588800999998, 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.090 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:59.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:02:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:02:59.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519551241000002, 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.096 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.101 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519497825000002, 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519372535999999, 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519332392999999, 2024-05-10T14:02:59.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519280010000003, 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.118 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:02:59.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:02:59.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:02:59.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:02:59.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 38.519095612000001, 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:02:59.123 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:02:59.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:02:59.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:02:59.128 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:02:59.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:02:59.129 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:59.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:02:59.131 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:02:59.128+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:02:59.231 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:02:59.232+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:02:59.254 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:02:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:02:59.255 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:02:59.275 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:02:59.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:02:59.288 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-05-10T14:02:58.361364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254372,"kb_used_data":4912,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720348,"statfs":{"total":773094113280,"available":772833636352,"internally_reserved":0,"allocated":5029888,"data_stored":2826266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046351"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351630+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:02:56.351630+0000","last_peered":"2024-05-10T14:02:56.351630+0000","last_clean":"2024-05-10T14:02:56.351630+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:02:56.351630+0000","last_undegraded":"2024-05-10T14:02:56.351630+0000","last_fullsized":"2024-05-10T14:02:56.351630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999689+0000","last_change":"2024-05-10T14:02:32.701008+0000","last_active":"2024-05-10T14:02:56.999689+0000","last_peered":"2024-05-10T14:02:56.999689+0000","last_clean":"2024-05-10T14:02:56.999689+0000","last_became_active":"2024-05-10T14:02:32.700023+0000","last_became_peered":"2024-05-10T14:02:32.700023+0000","last_unstale":"2024-05-10T14:02:56.999689+0000","last_undegraded":"2024-05-10T14:02:56.999689+0000","last_fullsized":"2024-05-10T14:02:56.999689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326993+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:02:54.326993+0000","last_peered":"2024-05-10T14:02:54.326993+0000","last_clean":"2024-05-10T14:02:54.326993+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:02:54.326993+0000","last_undegraded":"2024-05-10T14:02:54.326993+0000","last_fullsized":"2024-05-10T14:02:54.326993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350382+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:02:56.350382+0000","last_peered":"2024-05-10T14:02:56.350382+0000","last_clean":"2024-05-10T14:02:56.350382+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:02:56.350382+0000","last_undegraded":"2024-05-10T14:02:56.350382+0000","last_fullsized":"2024-05-10T14:02:56.350382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006810+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:02:57.006810+0000","last_peered":"2024-05-10T14:02:57.006810+0000","last_clean":"2024-05-10T14:02:57.006810+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:02:57.006810+0000","last_undegraded":"2024-05-10T14:02:57.006810+0000","last_fullsized":"2024-05-10T14:02:57.006810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330054+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:02:55.330054+0000","last_peered":"2024-05-10T14:02:55.330054+0000","last_clean":"2024-05-10T14:02:55.330054+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:02:55.330054+0000","last_undegraded":"2024-05-10T14:02:55.330054+0000","last_fullsized":"2024-05-10T14:02:55.330054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000407+0000","last_change":"2024-05-10T14:02:30.662364+0000","last_active":"2024-05-10T14:02:57.000407+0000","last_peered":"2024-05-10T14:02:57.000407+0000","last_clean":"2024-05-10T14:02:57.000407+0000","last_became_active":"2024-05-10T14:02:30.661072+0000","last_became_peered":"2024-05-10T14:02:30.661072+0000","last_unstale":"2024-05-10T14:02:57.000407+0000","last_undegraded":"2024-05-10T14:02:57.000407+0000","last_fullsized":"2024-05-10T14:02:57.000407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004491+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:02:57.004491+0000","last_peered":"2024-05-10T14:02:57.004491+0000","last_clean":"2024-05-10T14:02:57.004491+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:02:57.004491+0000","last_undegraded":"2024-05-10T14:02:57.004491+0000","last_fullsized":"2024-05-10T14:02:57.004491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351135+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:02:56.351135+0000","last_peered":"2024-05-10T14:02:56.351135+0000","last_clean":"2024-05-10T14:02:56.351135+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:02:56.351135+0000","last_undegraded":"2024-05-10T14:02:56.351135+0000","last_fullsized":"2024-05-10T14:02:56.351135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010563+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:02:57.010563+0000","last_peered":"2024-05-10T14:02:57.010563+0000","last_clean":"2024-05-10T14:02:57.010563+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:02:57.010563+0000","last_undegraded":"2024-05-10T14:02:57.010563+0000","last_fullsized":"2024-05-10T14:02:57.010563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999860+0000","last_change":"2024-05-10T14:02:30.664655+0000","last_active":"2024-05-10T14:02:56.999860+0000","last_peered":"2024-05-10T14:02:56.999860+0000","last_clean":"2024-05-10T14:02:56.999860+0000","last_became_active":"2024-05-10T14:02:30.662964+0000","last_became_peered":"2024-05-10T14:02:30.662964+0000","last_unstale":"2024-05-10T14:02:56.999860+0000","last_undegraded":"2024-05-10T14:02:56.999860+0000","last_fullsized":"2024-05-10T14:02:56.999860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331265+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:02:55.331265+0000","last_peered":"2024-05-10T14:02:55.331265+0000","last_clean":"2024-05-10T14:02:55.331265+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:02:55.331265+0000","last_undegraded":"2024-05-10T14:02:55.331265+0000","last_fullsized":"2024-05-10T14:02:55.331265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350946+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:02:56.350946+0000","last_peered":"2024-05-10T14:02:56.350946+0000","last_clean":"2024-05-10T14:02:56.350946+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:02:56.350946+0000","last_undegraded":"2024-05-10T14:02:56.350946+0000","last_fullsized":"2024-05-10T14:02:56.350946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999278+0000","last_change":"2024-05-10T14:02:32.685860+0000","last_active":"2024-05-10T14:02:56.999278+0000","last_peered":"2024-05-10T14:02:56.999278+0000","last_clean":"2024-05-10T14:02:56.999278+0000","last_became_active":"2024-05-10T14:02:32.684996+0000","last_became_peered":"2024-05-10T14:02:32.684996+0000","last_unstale":"2024-05-10T14:02:56.999278+0000","last_undegraded":"2024-05-10T14:02:56.999278+0000","last_fullsized":"2024-05-10T14:02:56.999278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349622+0000","last_change":"2024-05-10T14:02:30.659078+0000","last_active":"2024-05-10T14:02:56.349622+0000","last_peered":"2024-05-10T14:02:56.349622+0000","last_clean":"2024-05-10T14:02:56.349622+0000","last_became_active":"2024-05-10T14:02:30.658769+0000","last_became_peered":"2024-05-10T14:02:30.658769+0000","last_unstale":"2024-05-10T14:02:56.349622+0000","last_undegraded":"2024-05-10T14:02:56.349622+0000","last_fullsized":"2024-05-10T14:02:56.349622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847796+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:02:55.847796+0000","last_peered":"2024-05-10T14:02:55.847796+0000","last_clean":"2024-05-10T14:02:55.847796+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:02:55.847796+0000","last_undegraded":"2024-05-10T14:02:55.847796+0000","last_fullsized":"2024-05-10T14:02:55.847796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329447+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:02:55.329447+0000","last_peered":"2024-05-10T14:02:55.329447+0000","last_clean":"2024-05-10T14:02:55.329447+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:02:55.329447+0000","last_undegraded":"2024-05-10T14:02:55.329447+0000","last_fullsized":"2024-05-10T14:02:55.329447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351781+0000","last_change":"2024-05-10T14:02:30.670919+0000","last_active":"2024-05-10T14:02:56.351781+0000","last_peered":"2024-05-10T14:02:56.351781+0000","last_clean":"2024-05-10T14:02:56.351781+0000","last_became_active":"2024-05-10T14:02:30.670238+0000","last_became_peered":"2024-05-10T14:02:30.670238+0000","last_unstale":"2024-05-10T14:02:56.351781+0000","last_undegraded":"2024-05-10T14:02:56.351781+0000","last_fullsized":"2024-05-10T14:02:56.351781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350694+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:02:56.350694+0000","last_peered":"2024-05-10T14:02:56.350694+0000","last_clean":"2024-05-10T14:02:56.350694+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:02:56.350694+0000","last_undegraded":"2024-05-10T14:02:56.350694+0000","last_fullsized":"2024-05-10T14:02:56.350694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010836+0000","last_change":"2024-05-10T14:02:30.660232+0000","last_active":"2024-05-10T14:02:57.010836+0000","last_peered":"2024-05-10T14:02:57.010836+0000","last_clean":"2024-05-10T14:02:57.010836+0000","last_became_active":"2024-05-10T14:02:30.659541+0000","last_became_peered":"2024-05-10T14:02:30.659541+0000","last_unstale":"2024-05-10T14:02:57.010836+0000","last_undegraded":"2024-05-10T14:02:57.010836+0000","last_fullsized":"2024-05-10T14:02:57.010836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000052+0000","last_change":"2024-05-10T14:02:32.687835+0000","last_active":"2024-05-10T14:02:57.000052+0000","last_peered":"2024-05-10T14:02:57.000052+0000","last_clean":"2024-05-10T14:02:57.000052+0000","last_became_active":"2024-05-10T14:02:32.687123+0000","last_became_peered":"2024-05-10T14:02:32.687123+0000","last_unstale":"2024-05-10T14:02:57.000052+0000","last_undegraded":"2024-05-10T14:02:57.000052+0000","last_fullsized":"2024-05-10T14:02:57.000052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010837+0000","last_change":"2024-05-10T14:02:30.669888+0000","last_active":"2024-05-10T14:02:57.010837+0000","last_peered":"2024-05-10T14:02:57.010837+0000","last_clean":"2024-05-10T14:02:57.010837+0000","last_became_active":"2024-05-10T14:02:30.668900+0000","last_became_peered":"2024-05-10T14:02:30.668900+0000","last_unstale":"2024-05-10T14:02:57.010837+0000","last_undegraded":"2024-05-10T14:02:57.010837+0000","last_fullsized":"2024-05-10T14:02:57.010837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847425+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:02:55.847425+0000","last_peered":"2024-05-10T14:02:55.847425+0000","last_clean":"2024-05-10T14:02:55.847425+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:02:55.847425+0000","last_undegraded":"2024-05-10T14:02:55.847425+0000","last_fullsized":"2024-05-10T14:02:55.847425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330250+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:02:55.330250+0000","last_peered":"2024-05-10T14:02:55.330250+0000","last_clean":"2024-05-10T14:02:55.330250+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:02:55.330250+0000","last_undegraded":"2024-05-10T14:02:55.330250+0000","last_fullsized":"2024-05-10T14:02:55.330250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847376+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:02:55.847376+0000","last_peered":"2024-05-10T14:02:55.847376+0000","last_clean":"2024-05-10T14:02:55.847376+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:02:55.847376+0000","last_undegraded":"2024-05-10T14:02:55.847376+0000","last_fullsized":"2024-05-10T14:02:55.847376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350978+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:02:56.350978+0000","last_peered":"2024-05-10T14:02:56.350978+0000","last_clean":"2024-05-10T14:02:56.350978+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:02:56.350978+0000","last_undegraded":"2024-05-10T14:02:56.350978+0000","last_fullsized":"2024-05-10T14:02:56.350978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331334+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:02:55.331334+0000","last_peered":"2024-05-10T14:02:55.331334+0000","last_clean":"2024-05-10T14:02:55.331334+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:02:55.331334+0000","last_undegraded":"2024-05-10T14:02:55.331334+0000","last_fullsized":"2024-05-10T14:02:55.331334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006299+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:02:57.006299+0000","last_peered":"2024-05-10T14:02:57.006299+0000","last_clean":"2024-05-10T14:02:57.006299+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:02:57.006299+0000","last_undegraded":"2024-05-10T14:02:57.006299+0000","last_fullsized":"2024-05-10T14:02:57.006299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328834+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:02:55.328834+0000","last_peered":"2024-05-10T14:02:55.328834+0000","last_clean":"2024-05-10T14:02:55.328834+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:02:55.328834+0000","last_undegraded":"2024-05-10T14:02:55.328834+0000","last_fullsized":"2024-05-10T14:02:55.328834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352513+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:02:56.352513+0000","last_peered":"2024-05-10T14:02:56.352513+0000","last_clean":"2024-05-10T14:02:56.352513+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:02:56.352513+0000","last_undegraded":"2024-05-10T14:02:56.352513+0000","last_fullsized":"2024-05-10T14:02:56.352513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351638+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:02:56.351638+0000","last_peered":"2024-05-10T14:02:56.351638+0000","last_clean":"2024-05-10T14:02:56.351638+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:02:56.351638+0000","last_undegraded":"2024-05-10T14:02:56.351638+0000","last_fullsized":"2024-05-10T14:02:56.351638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000428+0000","last_change":"2024-05-10T14:02:34.703721+0000","last_active":"2024-05-10T14:02:57.000428+0000","last_peered":"2024-05-10T14:02:57.000428+0000","last_clean":"2024-05-10T14:02:57.000428+0000","last_became_active":"2024-05-10T14:02:34.702006+0000","last_became_peered":"2024-05-10T14:02:34.702006+0000","last_unstale":"2024-05-10T14:02:57.000428+0000","last_undegraded":"2024-05-10T14:02:57.000428+0000","last_fullsized":"2024-05-10T14:02:57.000428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006899+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:02:57.006899+0000","last_peered":"2024-05-10T14:02:57.006899+0000","last_clean":"2024-05-10T14:02:57.006899+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:02:57.006899+0000","last_undegraded":"2024-05-10T14:02:57.006899+0000","last_fullsized":"2024-05-10T14:02:57.006899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351387+0000","last_change":"2024-05-10T14:02:38.724178+0000","last_active":"2024-05-10T14:02:56.351387+0000","last_peered":"2024-05-10T14:02:56.351387+0000","last_clean":"2024-05-10T14:02:56.351387+0000","last_became_active":"2024-05-10T14:02:38.721491+0000","last_became_peered":"2024-05-10T14:02:38.721491+0000","last_unstale":"2024-05-10T14:02:56.351387+0000","last_undegraded":"2024-05-10T14:02:56.351387+0000","last_fullsized":"2024-05-10T14:02:56.351387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999645+0000","last_change":"2024-05-10T14:02:40.733937+0000","last_active":"2024-05-10T14:02:56.999645+0000","last_peered":"2024-05-10T14:02:56.999645+0000","last_clean":"2024-05-10T14:02:56.999645+0000","last_became_active":"2024-05-10T14:02:40.733205+0000","last_became_peered":"2024-05-10T14:02:40.733205+0000","last_unstale":"2024-05-10T14:02:56.999645+0000","last_undegraded":"2024-05-10T14:02:56.999645+0000","last_fullsized":"2024-05-10T14:02:56.999645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:40.961641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999231+0000","last_change":"2024-05-10T14:02:32.683159+0000","last_active":"2024-05-10T14:02:56.999231+0000","last_peered":"2024-05-10T14:02:56.999231+0000","last_clean":"2024-05-10T14:02:56.999231+0000","last_became_active":"2024-05-10T14:02:32.682442+0000","last_became_peered":"2024-05-10T14:02:32.682442+0000","last_unstale":"2024-05-10T14:02:56.999231+0000","last_undegraded":"2024-05-10T14:02:56.999231+0000","last_fullsized":"2024-05-10T14:02:56.999231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006345+0000","last_change":"2024-05-10T14:02:30.649814+0000","last_active":"2024-05-10T14:02:57.006345+0000","last_peered":"2024-05-10T14:02:57.006345+0000","last_clean":"2024-05-10T14:02:57.006345+0000","last_became_active":"2024-05-10T14:02:30.649470+0000","last_became_peered":"2024-05-10T14:02:30.649470+0000","last_unstale":"2024-05-10T14:02:57.006345+0000","last_undegraded":"2024-05-10T14:02:57.006345+0000","last_fullsized":"2024-05-10T14:02:57.006345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352137+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:02:56.352137+0000","last_peered":"2024-05-10T14:02:56.352137+0000","last_clean":"2024-05-10T14:02:56.352137+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:02:56.352137+0000","last_undegraded":"2024-05-10T14:02:56.352137+0000","last_fullsized":"2024-05-10T14:02:56.352137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331751+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:02:55.331751+0000","last_peered":"2024-05-10T14:02:55.331751+0000","last_clean":"2024-05-10T14:02:55.331751+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:02:55.331751+0000","last_undegraded":"2024-05-10T14:02:55.331751+0000","last_fullsized":"2024-05-10T14:02:55.331751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331280+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:02:55.331280+0000","last_peered":"2024-05-10T14:02:55.331280+0000","last_clean":"2024-05-10T14:02:55.331280+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:02:55.331280+0000","last_undegraded":"2024-05-10T14:02:55.331280+0000","last_fullsized":"2024-05-10T14:02:55.331280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005904+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:02:57.005904+0000","last_peered":"2024-05-10T14:02:57.005904+0000","last_clean":"2024-05-10T14:02:57.005904+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:02:57.005904+0000","last_undegraded":"2024-05-10T14:02:57.005904+0000","last_fullsized":"2024-05-10T14:02:57.005904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004489+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:02:57.004489+0000","last_peered":"2024-05-10T14:02:57.004489+0000","last_clean":"2024-05-10T14:02:57.004489+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:02:57.004489+0000","last_undegraded":"2024-05-10T14:02:57.004489+0000","last_fullsized":"2024-05-10T14:02:57.004489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351203+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:02:56.351203+0000","last_peered":"2024-05-10T14:02:56.351203+0000","last_clean":"2024-05-10T14:02:56.351203+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:02:56.351203+0000","last_undegraded":"2024-05-10T14:02:56.351203+0000","last_fullsized":"2024-05-10T14:02:56.351203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354931+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:02:56.354931+0000","last_peered":"2024-05-10T14:02:56.354931+0000","last_clean":"2024-05-10T14:02:56.354931+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:02:56.354931+0000","last_undegraded":"2024-05-10T14:02:56.354931+0000","last_fullsized":"2024-05-10T14:02:56.354931+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847211+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:02:55.847211+0000","last_peered":"2024-05-10T14:02:55.847211+0000","last_clean":"2024-05-10T14:02:55.847211+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:02:55.847211+0000","last_undegraded":"2024-05-10T14:02:55.847211+0000","last_fullsized":"2024-05-10T14:02:55.847211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351089+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:02:56.351089+0000","last_peered":"2024-05-10T14:02:56.351089+0000","last_clean":"2024-05-10T14:02:56.351089+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:02:56.351089+0000","last_undegraded":"2024-05-10T14:02:56.351089+0000","last_fullsized":"2024-05-10T14:02:56.351089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329682+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:02:55.329682+0000","last_peered":"2024-05-10T14:02:55.329682+0000","last_clean":"2024-05-10T14:02:55.329682+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:02:55.329682+0000","last_undegraded":"2024-05-10T14:02:55.329682+0000","last_fullsized":"2024-05-10T14:02:55.329682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354317+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:02:56.354317+0000","last_peered":"2024-05-10T14:02:56.354317+0000","last_clean":"2024-05-10T14:02:56.354317+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:02:56.354317+0000","last_undegraded":"2024-05-10T14:02:56.354317+0000","last_fullsized":"2024-05-10T14:02:56.354317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010147+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:02:57.010147+0000","last_peered":"2024-05-10T14:02:57.010147+0000","last_clean":"2024-05-10T14:02:57.010147+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:02:57.010147+0000","last_undegraded":"2024-05-10T14:02:57.010147+0000","last_fullsized":"2024-05-10T14:02:57.010147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000642+0000","last_change":"2024-05-10T14:02:34.703716+0000","last_active":"2024-05-10T14:02:57.000642+0000","last_peered":"2024-05-10T14:02:57.000642+0000","last_clean":"2024-05-10T14:02:57.000642+0000","last_became_active":"2024-05-10T14:02:34.702179+0000","last_became_peered":"2024-05-10T14:02:34.702179+0000","last_unstale":"2024-05-10T14:02:57.000642+0000","last_undegraded":"2024-05-10T14:02:57.000642+0000","last_fullsized":"2024-05-10T14:02:57.000642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351366+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:02:56.351366+0000","last_peered":"2024-05-10T14:02:56.351366+0000","last_clean":"2024-05-10T14:02:56.351366+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:02:56.351366+0000","last_undegraded":"2024-05-10T14:02:56.351366+0000","last_fullsized":"2024-05-10T14:02:56.351366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351345+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:02:56.351345+0000","last_peered":"2024-05-10T14:02:56.351345+0000","last_clean":"2024-05-10T14:02:56.351345+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:02:56.351345+0000","last_undegraded":"2024-05-10T14:02:56.351345+0000","last_fullsized":"2024-05-10T14:02:56.351345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999097+0000","last_change":"2024-05-10T14:02:32.683119+0000","last_active":"2024-05-10T14:02:56.999097+0000","last_peered":"2024-05-10T14:02:56.999097+0000","last_clean":"2024-05-10T14:02:56.999097+0000","last_became_active":"2024-05-10T14:02:32.682312+0000","last_became_peered":"2024-05-10T14:02:32.682312+0000","last_unstale":"2024-05-10T14:02:56.999097+0000","last_undegraded":"2024-05-10T14:02:56.999097+0000","last_fullsized":"2024-05-10T14:02:56.999097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351903+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:02:56.351903+0000","last_peered":"2024-05-10T14:02:56.351903+0000","last_clean":"2024-05-10T14:02:56.351903+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:02:56.351903+0000","last_undegraded":"2024-05-10T14:02:56.351903+0000","last_fullsized":"2024-05-10T14:02:56.351903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350016+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:02:56.350016+0000","last_peered":"2024-05-10T14:02:56.350016+0000","last_clean":"2024-05-10T14:02:56.350016+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:02:56.350016+0000","last_undegraded":"2024-05-10T14:02:56.350016+0000","last_fullsized":"2024-05-10T14:02:56.350016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999714+0000","last_change":"2024-05-10T14:02:36.760567+0000","last_active":"2024-05-10T14:02:56.999714+0000","last_peered":"2024-05-10T14:02:56.999714+0000","last_clean":"2024-05-10T14:02:56.999714+0000","last_became_active":"2024-05-10T14:02:36.759783+0000","last_became_peered":"2024-05-10T14:02:36.759783+0000","last_unstale":"2024-05-10T14:02:56.999714+0000","last_undegraded":"2024-05-10T14:02:56.999714+0000","last_fullsized":"2024-05-10T14:02:56.999714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324474+0000","last_change":"2024-05-10T14:02:38.721490+0000","last_active":"2024-05-10T14:02:54.324474+0000","last_peered":"2024-05-10T14:02:54.324474+0000","last_clean":"2024-05-10T14:02:54.324474+0000","last_became_active":"2024-05-10T14:02:38.720706+0000","last_became_peered":"2024-05-10T14:02:38.720706+0000","last_unstale":"2024-05-10T14:02:54.324474+0000","last_undegraded":"2024-05-10T14:02:54.324474+0000","last_fullsized":"2024-05-10T14:02:54.324474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.457471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000290+0000","last_change":"2024-05-10T14:02:40.737217+0000","last_active":"2024-05-10T14:02:57.000290+0000","last_peered":"2024-05-10T14:02:57.000290+0000","last_clean":"2024-05-10T14:02:57.000290+0000","last_became_active":"2024-05-10T14:02:40.734397+0000","last_became_peered":"2024-05-10T14:02:40.734397+0000","last_unstale":"2024-05-10T14:02:57.000290+0000","last_undegraded":"2024-05-10T14:02:57.000290+0000","last_fullsized":"2024-05-10T14:02:57.000290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329207+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:02:55.329207+0000","last_peered":"2024-05-10T14:02:55.329207+0000","last_clean":"2024-05-10T14:02:55.329207+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:02:55.329207+0000","last_undegraded":"2024-05-10T14:02:55.329207+0000","last_fullsized":"2024-05-10T14:02:55.329207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352190+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:02:56.352190+0000","last_peered":"2024-05-10T14:02:56.352190+0000","last_clean":"2024-05-10T14:02:56.352190+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:02:56.352190+0000","last_undegraded":"2024-05-10T14:02:56.352190+0000","last_fullsized":"2024-05-10T14:02:56.352190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847160+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:02:55.847160+0000","last_peered":"2024-05-10T14:02:55.847160+0000","last_clean":"2024-05-10T14:02:55.847160+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:02:55.847160+0000","last_undegraded":"2024-05-10T14:02:55.847160+0000","last_fullsized":"2024-05-10T14:02:55.847160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351410+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:02:56.351410+0000","last_peered":"2024-05-10T14:02:56.351410+0000","last_clean":"2024-05-10T14:02:56.351410+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:02:56.351410+0000","last_undegraded":"2024-05-10T14:02:56.351410+0000","last_fullsized":"2024-05-10T14:02:56.351410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.347901+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:02:56.347901+0000","last_peered":"2024-05-10T14:02:56.347901+0000","last_clean":"2024-05-10T14:02:56.347901+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:02:56.347901+0000","last_undegraded":"2024-05-10T14:02:56.347901+0000","last_fullsized":"2024-05-10T14:02:56.347901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010458+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:02:57.010458+0000","last_peered":"2024-05-10T14:02:57.010458+0000","last_clean":"2024-05-10T14:02:57.010458+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:02:57.010458+0000","last_undegraded":"2024-05-10T14:02:57.010458+0000","last_fullsized":"2024-05-10T14:02:57.010458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009717+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:02:57.009717+0000","last_peered":"2024-05-10T14:02:57.009717+0000","last_clean":"2024-05-10T14:02:57.009717+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:02:57.009717+0000","last_undegraded":"2024-05-10T14:02:57.009717+0000","last_fullsized":"2024-05-10T14:02:57.009717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352283+0000","last_change":"2024-05-10T14:02:30.676357+0000","last_active":"2024-05-10T14:02:56.352283+0000","last_peered":"2024-05-10T14:02:56.352283+0000","last_clean":"2024-05-10T14:02:56.352283+0000","last_became_active":"2024-05-10T14:02:30.675551+0000","last_became_peered":"2024-05-10T14:02:30.675551+0000","last_unstale":"2024-05-10T14:02:56.352283+0000","last_undegraded":"2024-05-10T14:02:56.352283+0000","last_fullsized":"2024-05-10T14:02:56.352283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847722+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:02:55.847722+0000","last_peered":"2024-05-10T14:02:55.847722+0000","last_clean":"2024-05-10T14:02:55.847722+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:02:55.847722+0000","last_undegraded":"2024-05-10T14:02:55.847722+0000","last_fullsized":"2024-05-10T14:02:55.847722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350396+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:02:56.350396+0000","last_peered":"2024-05-10T14:02:56.350396+0000","last_clean":"2024-05-10T14:02:56.350396+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:02:56.350396+0000","last_undegraded":"2024-05-10T14:02:56.350396+0000","last_fullsized":"2024-05-10T14:02:56.350396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005474+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:02:57.005474+0000","last_peered":"2024-05-10T14:02:57.005474+0000","last_clean":"2024-05-10T14:02:57.005474+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:02:57.005474+0000","last_undegraded":"2024-05-10T14:02:57.005474+0000","last_fullsized":"2024-05-10T14:02:57.005474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007022+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:02:57.007022+0000","last_peered":"2024-05-10T14:02:57.007022+0000","last_clean":"2024-05-10T14:02:57.007022+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:02:57.007022+0000","last_undegraded":"2024-05-10T14:02:57.007022+0000","last_fullsized":"2024-05-10T14:02:57.007022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004379+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:02:57.004379+0000","last_peered":"2024-05-10T14:02:57.004379+0000","last_clean":"2024-05-10T14:02:57.004379+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:02:57.004379+0000","last_undegraded":"2024-05-10T14:02:57.004379+0000","last_fullsized":"2024-05-10T14:02:57.004379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000596+0000","last_change":"2024-05-10T14:02:30.668980+0000","last_active":"2024-05-10T14:02:57.000596+0000","last_peered":"2024-05-10T14:02:57.000596+0000","last_clean":"2024-05-10T14:02:57.000596+0000","last_became_active":"2024-05-10T14:02:30.666369+0000","last_became_peered":"2024-05-10T14:02:30.666369+0000","last_unstale":"2024-05-10T14:02:57.000596+0000","last_undegraded":"2024-05-10T14:02:57.000596+0000","last_fullsized":"2024-05-10T14:02:57.000596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847269+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:02:55.847269+0000","last_peered":"2024-05-10T14:02:55.847269+0000","last_clean":"2024-05-10T14:02:55.847269+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:02:55.847269+0000","last_undegraded":"2024-05-10T14:02:55.847269+0000","last_fullsized":"2024-05-10T14:02:55.847269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005755+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:02:57.005755+0000","last_peered":"2024-05-10T14:02:57.005755+0000","last_clean":"2024-05-10T14:02:57.005755+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:02:57.005755+0000","last_undegraded":"2024-05-10T14:02:57.005755+0000","last_fullsized":"2024-05-10T14:02:57.005755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.846934+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:02:55.846934+0000","last_peered":"2024-05-10T14:02:55.846934+0000","last_clean":"2024-05-10T14:02:55.846934+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:02:55.846934+0000","last_undegraded":"2024-05-10T14:02:55.846934+0000","last_fullsized":"2024-05-10T14:02:55.846934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326728+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:02:54.326728+0000","last_peered":"2024-05-10T14:02:54.326728+0000","last_clean":"2024-05-10T14:02:54.326728+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:02:54.326728+0000","last_undegraded":"2024-05-10T14:02:54.326728+0000","last_fullsized":"2024-05-10T14:02:54.326728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330936+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:02:55.330936+0000","last_peered":"2024-05-10T14:02:55.330936+0000","last_clean":"2024-05-10T14:02:55.330936+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:02:55.330936+0000","last_undegraded":"2024-05-10T14:02:55.330936+0000","last_fullsized":"2024-05-10T14:02:55.330936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350684+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:02:56.350684+0000","last_peered":"2024-05-10T14:02:56.350684+0000","last_clean":"2024-05-10T14:02:56.350684+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:02:56.350684+0000","last_undegraded":"2024-05-10T14:02:56.350684+0000","last_fullsized":"2024-05-10T14:02:56.350684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847420+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:02:55.847420+0000","last_peered":"2024-05-10T14:02:55.847420+0000","last_clean":"2024-05-10T14:02:55.847420+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:02:55.847420+0000","last_undegraded":"2024-05-10T14:02:55.847420+0000","last_fullsized":"2024-05-10T14:02:55.847420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331359+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:02:55.331359+0000","last_peered":"2024-05-10T14:02:55.331359+0000","last_clean":"2024-05-10T14:02:55.331359+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:02:55.331359+0000","last_undegraded":"2024-05-10T14:02:55.331359+0000","last_fullsized":"2024-05-10T14:02:55.331359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007936+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:02:57.007936+0000","last_peered":"2024-05-10T14:02:57.007936+0000","last_clean":"2024-05-10T14:02:57.007936+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:02:57.007936+0000","last_undegraded":"2024-05-10T14:02:57.007936+0000","last_fullsized":"2024-05-10T14:02:57.007936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348092+0000","last_change":"2024-05-10T14:02:40.734940+0000","last_active":"2024-05-10T14:02:56.348092+0000","last_peered":"2024-05-10T14:02:56.348092+0000","last_clean":"2024-05-10T14:02:56.348092+0000","last_became_active":"2024-05-10T14:02:40.734017+0000","last_became_peered":"2024-05-10T14:02:40.734017+0000","last_unstale":"2024-05-10T14:02:56.348092+0000","last_undegraded":"2024-05-10T14:02:56.348092+0000","last_fullsized":"2024-05-10T14:02:56.348092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:27.803176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331590+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:02:55.331590+0000","last_peered":"2024-05-10T14:02:55.331590+0000","last_clean":"2024-05-10T14:02:55.331590+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:02:55.331590+0000","last_undegraded":"2024-05-10T14:02:55.331590+0000","last_fullsized":"2024-05-10T14:02:55.331590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010515+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:02:57.010515+0000","last_peered":"2024-05-10T14:02:57.010515+0000","last_clean":"2024-05-10T14:02:57.010515+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:02:57.010515+0000","last_undegraded":"2024-05-10T14:02:57.010515+0000","last_fullsized":"2024-05-10T14:02:57.010515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325165+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:02:54.325165+0000","last_peered":"2024-05-10T14:02:54.325165+0000","last_clean":"2024-05-10T14:02:54.325165+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:02:54.325165+0000","last_undegraded":"2024-05-10T14:02:54.325165+0000","last_fullsized":"2024-05-10T14:02:54.325165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847693+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:02:55.847693+0000","last_peered":"2024-05-10T14:02:55.847693+0000","last_clean":"2024-05-10T14:02:55.847693+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:02:55.847693+0000","last_undegraded":"2024-05-10T14:02:55.847693+0000","last_fullsized":"2024-05-10T14:02:55.847693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":32,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847329+0000","last_change":"2024-05-10T14:02:38.723250+0000","last_active":"2024-05-10T14:02:55.847329+0000","last_peered":"2024-05-10T14:02:55.847329+0000","last_clean":"2024-05-10T14:02:55.847329+0000","last_became_active":"2024-05-10T14:02:38.722515+0000","last_became_peered":"2024-05-10T14:02:38.722515+0000","last_unstale":"2024-05-10T14:02:55.847329+0000","last_undegraded":"2024-05-10T14:02:55.847329+0000","last_fullsized":"2024-05-10T14:02:55.847329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:43.700192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324526+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:02:54.324526+0000","last_peered":"2024-05-10T14:02:54.324526+0000","last_clean":"2024-05-10T14:02:54.324526+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:02:54.324526+0000","last_undegraded":"2024-05-10T14:02:54.324526+0000","last_fullsized":"2024-05-10T14:02:54.324526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331857+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:02:55.331857+0000","last_peered":"2024-05-10T14:02:55.331857+0000","last_clean":"2024-05-10T14:02:55.331857+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:02:55.331857+0000","last_undegraded":"2024-05-10T14:02:55.331857+0000","last_fullsized":"2024-05-10T14:02:55.331857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330188+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:02:55.330188+0000","last_peered":"2024-05-10T14:02:55.330188+0000","last_clean":"2024-05-10T14:02:55.330188+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:02:55.330188+0000","last_undegraded":"2024-05-10T14:02:55.330188+0000","last_fullsized":"2024-05-10T14:02:55.330188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000763+0000","last_change":"2024-05-10T14:02:34.704402+0000","last_active":"2024-05-10T14:02:57.000763+0000","last_peered":"2024-05-10T14:02:57.000763+0000","last_clean":"2024-05-10T14:02:57.000763+0000","last_became_active":"2024-05-10T14:02:34.703650+0000","last_became_peered":"2024-05-10T14:02:34.703650+0000","last_unstale":"2024-05-10T14:02:57.000763+0000","last_undegraded":"2024-05-10T14:02:57.000763+0000","last_fullsized":"2024-05-10T14:02:57.000763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351622+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:02:56.351622+0000","last_peered":"2024-05-10T14:02:56.351622+0000","last_clean":"2024-05-10T14:02:56.351622+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:02:56.351622+0000","last_undegraded":"2024-05-10T14:02:56.351622+0000","last_fullsized":"2024-05-10T14:02:56.351622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010555+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:02:57.010555+0000","last_peered":"2024-05-10T14:02:57.010555+0000","last_clean":"2024-05-10T14:02:57.010555+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:02:57.010555+0000","last_undegraded":"2024-05-10T14:02:57.010555+0000","last_fullsized":"2024-05-10T14:02:57.010555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329762+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:02:55.329762+0000","last_peered":"2024-05-10T14:02:55.329762+0000","last_clean":"2024-05-10T14:02:55.329762+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:02:55.329762+0000","last_undegraded":"2024-05-10T14:02:55.329762+0000","last_fullsized":"2024-05-10T14:02:55.329762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327104+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:02:54.327104+0000","last_peered":"2024-05-10T14:02:54.327104+0000","last_clean":"2024-05-10T14:02:54.327104+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:02:54.327104+0000","last_undegraded":"2024-05-10T14:02:54.327104+0000","last_fullsized":"2024-05-10T14:02:54.327104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350120+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:02:56.350120+0000","last_peered":"2024-05-10T14:02:56.350120+0000","last_clean":"2024-05-10T14:02:56.350120+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:02:56.350120+0000","last_undegraded":"2024-05-10T14:02:56.350120+0000","last_fullsized":"2024-05-10T14:02:56.350120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331657+0000","last_change":"2024-05-10T14:02:34.703505+0000","last_active":"2024-05-10T14:02:55.331657+0000","last_peered":"2024-05-10T14:02:55.331657+0000","last_clean":"2024-05-10T14:02:55.331657+0000","last_became_active":"2024-05-10T14:02:34.702702+0000","last_became_peered":"2024-05-10T14:02:34.702702+0000","last_unstale":"2024-05-10T14:02:55.331657+0000","last_undegraded":"2024-05-10T14:02:55.331657+0000","last_fullsized":"2024-05-10T14:02:55.331657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000428+0000","last_change":"2024-05-10T14:02:36.699924+0000","last_active":"2024-05-10T14:02:57.000428+0000","last_peered":"2024-05-10T14:02:57.000428+0000","last_clean":"2024-05-10T14:02:57.000428+0000","last_became_active":"2024-05-10T14:02:36.699071+0000","last_became_peered":"2024-05-10T14:02:36.699071+0000","last_unstale":"2024-05-10T14:02:57.000428+0000","last_undegraded":"2024-05-10T14:02:57.000428+0000","last_fullsized":"2024-05-10T14:02:57.000428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010350+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:02:57.010350+0000","last_peered":"2024-05-10T14:02:57.010350+0000","last_clean":"2024-05-10T14:02:57.010350+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:02:57.010350+0000","last_undegraded":"2024-05-10T14:02:57.010350+0000","last_fullsized":"2024-05-10T14:02:57.010350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324304+0000","last_change":"2024-05-10T14:02:40.734906+0000","last_active":"2024-05-10T14:02:54.324304+0000","last_peered":"2024-05-10T14:02:54.324304+0000","last_clean":"2024-05-10T14:02:54.324304+0000","last_became_active":"2024-05-10T14:02:40.734153+0000","last_became_peered":"2024-05-10T14:02:40.734153+0000","last_unstale":"2024-05-10T14:02:54.324304+0000","last_undegraded":"2024-05-10T14:02:54.324304+0000","last_fullsized":"2024-05-10T14:02:54.324304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:19.709648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010715+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:02:57.010715+0000","last_peered":"2024-05-10T14:02:57.010715+0000","last_clean":"2024-05-10T14:02:57.010715+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:02:57.010715+0000","last_undegraded":"2024-05-10T14:02:57.010715+0000","last_fullsized":"2024-05-10T14:02:57.010715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350716+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:02:56.350716+0000","last_peered":"2024-05-10T14:02:56.350716+0000","last_clean":"2024-05-10T14:02:56.350716+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:02:56.350716+0000","last_undegraded":"2024-05-10T14:02:56.350716+0000","last_fullsized":"2024-05-10T14:02:56.350716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000283+0000","last_change":"2024-05-10T14:02:24.590942+0000","last_active":"2024-05-10T14:02:57.000283+0000","last_peered":"2024-05-10T14:02:57.000283+0000","last_clean":"2024-05-10T14:02:57.000283+0000","last_became_active":"2024-05-10T14:02:24.590072+0000","last_became_peered":"2024-05-10T14:02:24.590072+0000","last_unstale":"2024-05-10T14:02:57.000283+0000","last_undegraded":"2024-05-10T14:02:57.000283+0000","last_fullsized":"2024-05-10T14:02:57.000283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350783+0000","last_change":"2024-05-10T14:02:30.664055+0000","last_active":"2024-05-10T14:02:56.350783+0000","last_peered":"2024-05-10T14:02:56.350783+0000","last_clean":"2024-05-10T14:02:56.350783+0000","last_became_active":"2024-05-10T14:02:30.663754+0000","last_became_peered":"2024-05-10T14:02:30.663754+0000","last_unstale":"2024-05-10T14:02:56.350783+0000","last_undegraded":"2024-05-10T14:02:56.350783+0000","last_fullsized":"2024-05-10T14:02:56.350783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350584+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:02:56.350584+0000","last_peered":"2024-05-10T14:02:56.350584+0000","last_clean":"2024-05-10T14:02:56.350584+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:02:56.350584+0000","last_undegraded":"2024-05-10T14:02:56.350584+0000","last_fullsized":"2024-05-10T14:02:56.350584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000852+0000","last_change":"2024-05-10T14:02:36.708452+0000","last_active":"2024-05-10T14:02:57.000852+0000","last_peered":"2024-05-10T14:02:57.000852+0000","last_clean":"2024-05-10T14:02:57.000852+0000","last_became_active":"2024-05-10T14:02:36.707872+0000","last_became_peered":"2024-05-10T14:02:36.707872+0000","last_unstale":"2024-05-10T14:02:57.000852+0000","last_undegraded":"2024-05-10T14:02:57.000852+0000","last_fullsized":"2024-05-10T14:02:57.000852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007030+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:02:57.007030+0000","last_peered":"2024-05-10T14:02:57.007030+0000","last_clean":"2024-05-10T14:02:57.007030+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:02:57.007030+0000","last_undegraded":"2024-05-10T14:02:57.007030+0000","last_fullsized":"2024-05-10T14:02:57.007030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009921+0000","last_change":"2024-05-10T14:02:40.742200+0000","last_active":"2024-05-10T14:02:57.009921+0000","last_peered":"2024-05-10T14:02:57.009921+0000","last_clean":"2024-05-10T14:02:57.009921+0000","last_became_active":"2024-05-10T14:02:40.741540+0000","last_became_peered":"2024-05-10T14:02:40.741540+0000","last_unstale":"2024-05-10T14:02:57.009921+0000","last_undegraded":"2024-05-10T14:02:57.009921+0000","last_fullsized":"2024-05-10T14:02:57.009921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:43.260808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004705+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:02:57.004705+0000","last_peered":"2024-05-10T14:02:57.004705+0000","last_clean":"2024-05-10T14:02:57.004705+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:02:57.004705+0000","last_undegraded":"2024-05-10T14:02:57.004705+0000","last_fullsized":"2024-05-10T14:02:57.004705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351008+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:02:56.351008+0000","last_peered":"2024-05-10T14:02:56.351008+0000","last_clean":"2024-05-10T14:02:56.351008+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:02:56.351008+0000","last_undegraded":"2024-05-10T14:02:56.351008+0000","last_fullsized":"2024-05-10T14:02:56.351008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005871+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:02:57.005871+0000","last_peered":"2024-05-10T14:02:57.005871+0000","last_clean":"2024-05-10T14:02:57.005871+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:02:57.005871+0000","last_undegraded":"2024-05-10T14:02:57.005871+0000","last_fullsized":"2024-05-10T14:02:57.005871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.001019+0000","last_change":"2024-05-10T14:02:34.702777+0000","last_active":"2024-05-10T14:02:57.001019+0000","last_peered":"2024-05-10T14:02:57.001019+0000","last_clean":"2024-05-10T14:02:57.001019+0000","last_became_active":"2024-05-10T14:02:34.701897+0000","last_became_peered":"2024-05-10T14:02:34.701897+0000","last_unstale":"2024-05-10T14:02:57.001019+0000","last_undegraded":"2024-05-10T14:02:57.001019+0000","last_fullsized":"2024-05-10T14:02:57.001019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325120+0000","last_change":"2024-05-10T14:02:36.699050+0000","last_active":"2024-05-10T14:02:54.325120+0000","last_peered":"2024-05-10T14:02:54.325120+0000","last_clean":"2024-05-10T14:02:54.325120+0000","last_became_active":"2024-05-10T14:02:36.698360+0000","last_became_peered":"2024-05-10T14:02:36.698360+0000","last_unstale":"2024-05-10T14:02:54.325120+0000","last_undegraded":"2024-05-10T14:02:54.325120+0000","last_fullsized":"2024-05-10T14:02:54.325120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:35:40.504956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351562+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:02:56.351562+0000","last_peered":"2024-05-10T14:02:56.351562+0000","last_clean":"2024-05-10T14:02:56.351562+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:02:56.351562+0000","last_undegraded":"2024-05-10T14:02:56.351562+0000","last_fullsized":"2024-05-10T14:02:56.351562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324425+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:02:54.324425+0000","last_peered":"2024-05-10T14:02:54.324425+0000","last_clean":"2024-05-10T14:02:54.324425+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:02:54.324425+0000","last_undegraded":"2024-05-10T14:02:54.324425+0000","last_fullsized":"2024-05-10T14:02:54.324425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327233+0000","last_change":"2024-05-10T14:02:32.685938+0000","last_active":"2024-05-10T14:02:54.327233+0000","last_peered":"2024-05-10T14:02:54.327233+0000","last_clean":"2024-05-10T14:02:54.327233+0000","last_became_active":"2024-05-10T14:02:32.685539+0000","last_became_peered":"2024-05-10T14:02:32.685539+0000","last_unstale":"2024-05-10T14:02:54.327233+0000","last_undegraded":"2024-05-10T14:02:54.327233+0000","last_fullsized":"2024-05-10T14:02:54.327233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:48.031945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847110+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:02:55.847110+0000","last_peered":"2024-05-10T14:02:55.847110+0000","last_clean":"2024-05-10T14:02:55.847110+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:02:55.847110+0000","last_undegraded":"2024-05-10T14:02:55.847110+0000","last_fullsized":"2024-05-10T14:02:55.847110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324337+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:02:54.324337+0000","last_peered":"2024-05-10T14:02:54.324337+0000","last_clean":"2024-05-10T14:02:54.324337+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:02:54.324337+0000","last_undegraded":"2024-05-10T14:02:54.324337+0000","last_fullsized":"2024-05-10T14:02:54.324337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847563+0000","last_change":"2024-05-10T14:02:34.702881+0000","last_active":"2024-05-10T14:02:55.847563+0000","last_peered":"2024-05-10T14:02:55.847563+0000","last_clean":"2024-05-10T14:02:55.847563+0000","last_became_active":"2024-05-10T14:02:34.702177+0000","last_became_peered":"2024-05-10T14:02:34.702177+0000","last_unstale":"2024-05-10T14:02:55.847563+0000","last_undegraded":"2024-05-10T14:02:55.847563+0000","last_fullsized":"2024-05-10T14:02:55.847563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:25.709529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351868+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:56.351868+0000","last_peered":"2024-05-10T14:02:56.351868+0000","last_clean":"2024-05-10T14:02:56.351868+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:02:56.351868+0000","last_undegraded":"2024-05-10T14:02:56.351868+0000","last_fullsized":"2024-05-10T14:02:56.351868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006204+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:02:57.006204+0000","last_peered":"2024-05-10T14:02:57.006204+0000","last_clean":"2024-05-10T14:02:57.006204+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:02:57.006204+0000","last_undegraded":"2024-05-10T14:02:57.006204+0000","last_fullsized":"2024-05-10T14:02:57.006204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351190+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:02:56.351190+0000","last_peered":"2024-05-10T14:02:56.351190+0000","last_clean":"2024-05-10T14:02:56.351190+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:02:56.351190+0000","last_undegraded":"2024-05-10T14:02:56.351190+0000","last_fullsized":"2024-05-10T14:02:56.351190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325466+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:02:54.325466+0000","last_peered":"2024-05-10T14:02:54.325466+0000","last_clean":"2024-05-10T14:02:54.325466+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:02:54.325466+0000","last_undegraded":"2024-05-10T14:02:54.325466+0000","last_fullsized":"2024-05-10T14:02:54.325466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999140+0000","last_change":"2024-05-10T14:02:24.585054+0000","last_active":"2024-05-10T14:02:56.999140+0000","last_peered":"2024-05-10T14:02:56.999140+0000","last_clean":"2024-05-10T14:02:56.999140+0000","last_became_active":"2024-05-10T14:02:24.584215+0000","last_became_peered":"2024-05-10T14:02:24.584215+0000","last_unstale":"2024-05-10T14:02:56.999140+0000","last_undegraded":"2024-05-10T14:02:56.999140+0000","last_fullsized":"2024-05-10T14:02:56.999140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:44.532971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330734+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:02:55.330734+0000","last_peered":"2024-05-10T14:02:55.330734+0000","last_clean":"2024-05-10T14:02:55.330734+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:02:55.330734+0000","last_undegraded":"2024-05-10T14:02:55.330734+0000","last_fullsized":"2024-05-10T14:02:55.330734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006699+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:02:57.006699+0000","last_peered":"2024-05-10T14:02:57.006699+0000","last_clean":"2024-05-10T14:02:57.006699+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:02:57.006699+0000","last_undegraded":"2024-05-10T14:02:57.006699+0000","last_fullsized":"2024-05-10T14:02:57.006699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354066+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:02:56.354066+0000","last_peered":"2024-05-10T14:02:56.354066+0000","last_clean":"2024-05-10T14:02:56.354066+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:02:56.354066+0000","last_undegraded":"2024-05-10T14:02:56.354066+0000","last_fullsized":"2024-05-10T14:02:56.354066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010790+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:02:57.010790+0000","last_peered":"2024-05-10T14:02:57.010790+0000","last_clean":"2024-05-10T14:02:57.010790+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:02:57.010790+0000","last_undegraded":"2024-05-10T14:02:57.010790+0000","last_fullsized":"2024-05-10T14:02:57.010790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999280+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:56.999280+0000","last_peered":"2024-05-10T14:02:56.999280+0000","last_clean":"2024-05-10T14:02:56.999280+0000","last_became_active":"2024-05-10T14:02:40.733023+0000","last_became_peered":"2024-05-10T14:02:40.733023+0000","last_unstale":"2024-05-10T14:02:56.999280+0000","last_undegraded":"2024-05-10T14:02:56.999280+0000","last_fullsized":"2024-05-10T14:02:56.999280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324974+0000","last_change":"2024-05-10T14:02:32.690026+0000","last_active":"2024-05-10T14:02:54.324974+0000","last_peered":"2024-05-10T14:02:54.324974+0000","last_clean":"2024-05-10T14:02:54.324974+0000","last_became_active":"2024-05-10T14:02:32.689610+0000","last_became_peered":"2024-05-10T14:02:32.689610+0000","last_unstale":"2024-05-10T14:02:54.324974+0000","last_undegraded":"2024-05-10T14:02:54.324974+0000","last_fullsized":"2024-05-10T14:02:54.324974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:02.876675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000750+0000","last_change":"2024-05-10T14:02:30.668078+0000","last_active":"2024-05-10T14:02:57.000750+0000","last_peered":"2024-05-10T14:02:57.000750+0000","last_clean":"2024-05-10T14:02:57.000750+0000","last_became_active":"2024-05-10T14:02:30.658626+0000","last_became_peered":"2024-05-10T14:02:30.658626+0000","last_unstale":"2024-05-10T14:02:57.000750+0000","last_undegraded":"2024-05-10T14:02:57.000750+0000","last_fullsized":"2024-05-10T14:02:57.000750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325652+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:02:54.325652+0000","last_peered":"2024-05-10T14:02:54.325652+0000","last_clean":"2024-05-10T14:02:54.325652+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:02:54.325652+0000","last_undegraded":"2024-05-10T14:02:54.325652+0000","last_fullsized":"2024-05-10T14:02:54.325652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006347+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:02:57.006347+0000","last_peered":"2024-05-10T14:02:57.006347+0000","last_clean":"2024-05-10T14:02:57.006347+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:02:57.006347+0000","last_undegraded":"2024-05-10T14:02:57.006347+0000","last_fullsized":"2024-05-10T14:02:57.006347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":64,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005591+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:02:57.005591+0000","last_peered":"2024-05-10T14:02:57.005591+0000","last_clean":"2024-05-10T14:02:57.005591+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:02:57.005591+0000","last_undegraded":"2024-05-10T14:02:57.005591+0000","last_fullsized":"2024-05-10T14:02:57.005591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328844+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:02:55.328844+0000","last_peered":"2024-05-10T14:02:55.328844+0000","last_clean":"2024-05-10T14:02:55.328844+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:02:55.328844+0000","last_undegraded":"2024-05-10T14:02:55.328844+0000","last_fullsized":"2024-05-10T14:02:55.328844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006776+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:02:57.006776+0000","last_peered":"2024-05-10T14:02:57.006776+0000","last_clean":"2024-05-10T14:02:57.006776+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:02:57.006776+0000","last_undegraded":"2024-05-10T14:02:57.006776+0000","last_fullsized":"2024-05-10T14:02:57.006776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006649+0000","last_change":"2024-05-10T14:02:32.684861+0000","last_active":"2024-05-10T14:02:57.006649+0000","last_peered":"2024-05-10T14:02:57.006649+0000","last_clean":"2024-05-10T14:02:57.006649+0000","last_became_active":"2024-05-10T14:02:32.683137+0000","last_became_peered":"2024-05-10T14:02:32.683137+0000","last_unstale":"2024-05-10T14:02:57.006649+0000","last_undegraded":"2024-05-10T14:02:57.006649+0000","last_fullsized":"2024-05-10T14:02:57.006649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325513+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:02:54.325513+0000","last_peered":"2024-05-10T14:02:54.325513+0000","last_clean":"2024-05-10T14:02:54.325513+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:02:54.325513+0000","last_undegraded":"2024-05-10T14:02:54.325513+0000","last_fullsized":"2024-05-10T14:02:54.325513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352515+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:02:56.352515+0000","last_peered":"2024-05-10T14:02:56.352515+0000","last_clean":"2024-05-10T14:02:56.352515+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:02:56.352515+0000","last_undegraded":"2024-05-10T14:02:56.352515+0000","last_fullsized":"2024-05-10T14:02:56.352515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010297+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:02:57.010297+0000","last_peered":"2024-05-10T14:02:57.010297+0000","last_clean":"2024-05-10T14:02:57.010297+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:02:57.010297+0000","last_undegraded":"2024-05-10T14:02:57.010297+0000","last_fullsized":"2024-05-10T14:02:57.010297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324033+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:02:54.324033+0000","last_peered":"2024-05-10T14:02:54.324033+0000","last_clean":"2024-05-10T14:02:54.324033+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:02:54.324033+0000","last_undegraded":"2024-05-10T14:02:54.324033+0000","last_fullsized":"2024-05-10T14:02:54.324033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999742+0000","last_change":"2024-05-10T14:02:38.720704+0000","last_active":"2024-05-10T14:02:56.999742+0000","last_peered":"2024-05-10T14:02:56.999742+0000","last_clean":"2024-05-10T14:02:56.999742+0000","last_became_active":"2024-05-10T14:02:38.719862+0000","last_became_peered":"2024-05-10T14:02:38.719862+0000","last_unstale":"2024-05-10T14:02:56.999742+0000","last_undegraded":"2024-05-10T14:02:56.999742+0000","last_fullsized":"2024-05-10T14:02:56.999742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354426+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:02:56.354426+0000","last_peered":"2024-05-10T14:02:56.354426+0000","last_clean":"2024-05-10T14:02:56.354426+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:02:56.354426+0000","last_undegraded":"2024-05-10T14:02:56.354426+0000","last_fullsized":"2024-05-10T14:02:56.354426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349070+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:02:56.349070+0000","last_peered":"2024-05-10T14:02:56.349070+0000","last_clean":"2024-05-10T14:02:56.349070+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:02:56.349070+0000","last_undegraded":"2024-05-10T14:02:56.349070+0000","last_fullsized":"2024-05-10T14:02:56.349070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354140+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:02:56.354140+0000","last_peered":"2024-05-10T14:02:56.354140+0000","last_clean":"2024-05-10T14:02:56.354140+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:02:56.354140+0000","last_undegraded":"2024-05-10T14:02:56.354140+0000","last_fullsized":"2024-05-10T14:02:56.354140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.327073+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:02:54.327073+0000","last_peered":"2024-05-10T14:02:54.327073+0000","last_clean":"2024-05-10T14:02:54.327073+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:02:54.327073+0000","last_undegraded":"2024-05-10T14:02:54.327073+0000","last_fullsized":"2024-05-10T14:02:54.327073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329147+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:02:55.329147+0000","last_peered":"2024-05-10T14:02:55.329147+0000","last_clean":"2024-05-10T14:02:55.329147+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:02:55.329147+0000","last_undegraded":"2024-05-10T14:02:55.329147+0000","last_fullsized":"2024-05-10T14:02:55.329147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330211+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:02:55.330211+0000","last_peered":"2024-05-10T14:02:55.330211+0000","last_clean":"2024-05-10T14:02:55.330211+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:02:55.330211+0000","last_undegraded":"2024-05-10T14:02:55.330211+0000","last_fullsized":"2024-05-10T14:02:55.330211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351747+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:02:56.351747+0000","last_peered":"2024-05-10T14:02:56.351747+0000","last_clean":"2024-05-10T14:02:56.351747+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:02:56.351747+0000","last_undegraded":"2024-05-10T14:02:56.351747+0000","last_fullsized":"2024-05-10T14:02:56.351747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004431+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:02:57.004431+0000","last_peered":"2024-05-10T14:02:57.004431+0000","last_clean":"2024-05-10T14:02:57.004431+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:02:57.004431+0000","last_undegraded":"2024-05-10T14:02:57.004431+0000","last_fullsized":"2024-05-10T14:02:57.004431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329430+0000","last_change":"2024-05-10T14:02:32.671389+0000","last_active":"2024-05-10T14:02:55.329430+0000","last_peered":"2024-05-10T14:02:55.329430+0000","last_clean":"2024-05-10T14:02:55.329430+0000","last_became_active":"2024-05-10T14:02:32.670629+0000","last_became_peered":"2024-05-10T14:02:32.670629+0000","last_unstale":"2024-05-10T14:02:55.329430+0000","last_undegraded":"2024-05-10T14:02:55.329430+0000","last_fullsized":"2024-05-10T14:02:55.329430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:54.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008083+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:02:57.008083+0000","last_peered":"2024-05-10T14:02:57.008083+0000","last_clean":"2024-05-10T14:02:57.008083+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:02:57.008083+0000","last_undegraded":"2024-05-10T14:02:57.008083+0000","last_fullsized":"2024-05-10T14:02:57.008083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009760+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:02:57.009760+0000","last_peered":"2024-05-10T14:02:57.009760+0000","last_clean":"2024-05-10T14:02:57.009760+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:02:57.009760+0000","last_undegraded":"2024-05-10T14:02:57.009760+0000","last_fullsized":"2024-05-10T14:02:57.009760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348730+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:02:56.348730+0000","last_peered":"2024-05-10T14:02:56.348730+0000","last_clean":"2024-05-10T14:02:56.348730+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:02:56.348730+0000","last_undegraded":"2024-05-10T14:02:56.348730+0000","last_fullsized":"2024-05-10T14:02:56.348730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":68,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350271+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:02:56.350271+0000","last_peered":"2024-05-10T14:02:56.350271+0000","last_clean":"2024-05-10T14:02:56.350271+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:02:56.350271+0000","last_undegraded":"2024-05-10T14:02:56.350271+0000","last_fullsized":"2024-05-10T14:02:56.350271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350470+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:02:56.350470+0000","last_peered":"2024-05-10T14:02:56.350470+0000","last_clean":"2024-05-10T14:02:56.350470+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:02:56.350470+0000","last_undegraded":"2024-05-10T14:02:56.350470+0000","last_fullsized":"2024-05-10T14:02:56.350470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999378+0000","last_change":"2024-05-10T14:02:40.733773+0000","last_active":"2024-05-10T14:02:56.999378+0000","last_peered":"2024-05-10T14:02:56.999378+0000","last_clean":"2024-05-10T14:02:56.999378+0000","last_became_active":"2024-05-10T14:02:40.732976+0000","last_became_peered":"2024-05-10T14:02:40.732976+0000","last_unstale":"2024-05-10T14:02:56.999378+0000","last_undegraded":"2024-05-10T14:02:56.999378+0000","last_fullsized":"2024-05-10T14:02:56.999378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006960+0000","last_change":"2024-05-10T14:02:40.734335+0000","last_active":"2024-05-10T14:02:57.006960+0000","last_peered":"2024-05-10T14:02:57.006960+0000","last_clean":"2024-05-10T14:02:57.006960+0000","last_became_active":"2024-05-10T14:02:40.733789+0000","last_became_peered":"2024-05-10T14:02:40.733789+0000","last_unstale":"2024-05-10T14:02:57.006960+0000","last_undegraded":"2024-05-10T14:02:57.006960+0000","last_fullsized":"2024-05-10T14:02:57.006960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330231+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:02:55.330231+0000","last_peered":"2024-05-10T14:02:55.330231+0000","last_clean":"2024-05-10T14:02:55.330231+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:02:55.330231+0000","last_undegraded":"2024-05-10T14:02:55.330231+0000","last_fullsized":"2024-05-10T14:02:55.330231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330012+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:02:55.330012+0000","last_peered":"2024-05-10T14:02:55.330012+0000","last_clean":"2024-05-10T14:02:55.330012+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:02:55.330012+0000","last_undegraded":"2024-05-10T14:02:55.330012+0000","last_fullsized":"2024-05-10T14:02:55.330012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325102+0000","last_change":"2024-05-10T14:02:34.706456+0000","last_active":"2024-05-10T14:02:54.325102+0000","last_peered":"2024-05-10T14:02:54.325102+0000","last_clean":"2024-05-10T14:02:54.325102+0000","last_became_active":"2024-05-10T14:02:34.705604+0000","last_became_peered":"2024-05-10T14:02:34.705604+0000","last_unstale":"2024-05-10T14:02:54.325102+0000","last_undegraded":"2024-05-10T14:02:54.325102+0000","last_fullsized":"2024-05-10T14:02:54.325102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:54.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349729+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:02:56.349729+0000","last_peered":"2024-05-10T14:02:56.349729+0000","last_clean":"2024-05-10T14:02:56.349729+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:02:56.349729+0000","last_undegraded":"2024-05-10T14:02:56.349729+0000","last_fullsized":"2024-05-10T14:02:56.349729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.348346+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:02:56.348346+0000","last_peered":"2024-05-10T14:02:56.348346+0000","last_clean":"2024-05-10T14:02:56.348346+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:02:56.348346+0000","last_undegraded":"2024-05-10T14:02:56.348346+0000","last_fullsized":"2024-05-10T14:02:56.348346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353542+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:02:56.353542+0000","last_peered":"2024-05-10T14:02:56.353542+0000","last_clean":"2024-05-10T14:02:56.353542+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:02:56.353542+0000","last_undegraded":"2024-05-10T14:02:56.353542+0000","last_fullsized":"2024-05-10T14:02:56.353542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324836+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:02:54.324836+0000","last_peered":"2024-05-10T14:02:54.324836+0000","last_clean":"2024-05-10T14:02:54.324836+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:02:54.324836+0000","last_undegraded":"2024-05-10T14:02:54.324836+0000","last_fullsized":"2024-05-10T14:02:54.324836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352187+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:02:56.352187+0000","last_peered":"2024-05-10T14:02:56.352187+0000","last_clean":"2024-05-10T14:02:56.352187+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:02:56.352187+0000","last_undegraded":"2024-05-10T14:02:56.352187+0000","last_fullsized":"2024-05-10T14:02:56.352187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351084+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:02:56.351084+0000","last_peered":"2024-05-10T14:02:56.351084+0000","last_clean":"2024-05-10T14:02:56.351084+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:02:56.351084+0000","last_undegraded":"2024-05-10T14:02:56.351084+0000","last_fullsized":"2024-05-10T14:02:56.351084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005369+0000","last_change":"2024-05-10T14:02:36.704252+0000","last_active":"2024-05-10T14:02:57.005369+0000","last_peered":"2024-05-10T14:02:57.005369+0000","last_clean":"2024-05-10T14:02:57.005369+0000","last_became_active":"2024-05-10T14:02:36.703671+0000","last_became_peered":"2024-05-10T14:02:36.703671+0000","last_unstale":"2024-05-10T14:02:57.005369+0000","last_undegraded":"2024-05-10T14:02:57.005369+0000","last_fullsized":"2024-05-10T14:02:57.005369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351737+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:02:56.351737+0000","last_peered":"2024-05-10T14:02:56.351737+0000","last_clean":"2024-05-10T14:02:56.351737+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:02:56.351737+0000","last_undegraded":"2024-05-10T14:02:56.351737+0000","last_fullsized":"2024-05-10T14:02:56.351737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004817+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:02:57.004817+0000","last_peered":"2024-05-10T14:02:57.004817+0000","last_clean":"2024-05-10T14:02:57.004817+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:02:57.004817+0000","last_undegraded":"2024-05-10T14:02:57.004817+0000","last_fullsized":"2024-05-10T14:02:57.004817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349986+0000","last_change":"2024-05-10T14:02:32.680541+0000","last_active":"2024-05-10T14:02:56.349986+0000","last_peered":"2024-05-10T14:02:56.349986+0000","last_clean":"2024-05-10T14:02:56.349986+0000","last_became_active":"2024-05-10T14:02:32.678843+0000","last_became_peered":"2024-05-10T14:02:32.678843+0000","last_unstale":"2024-05-10T14:02:56.349986+0000","last_undegraded":"2024-05-10T14:02:56.349986+0000","last_fullsized":"2024-05-10T14:02:56.349986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000913+0000","last_change":"2024-05-10T14:02:30.657936+0000","last_active":"2024-05-10T14:02:57.000913+0000","last_peered":"2024-05-10T14:02:57.000913+0000","last_clean":"2024-05-10T14:02:57.000913+0000","last_became_active":"2024-05-10T14:02:30.657176+0000","last_became_peered":"2024-05-10T14:02:30.657176+0000","last_unstale":"2024-05-10T14:02:57.000913+0000","last_undegraded":"2024-05-10T14:02:57.000913+0000","last_fullsized":"2024-05-10T14:02:57.000913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349554+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:02:56.349554+0000","last_peered":"2024-05-10T14:02:56.349554+0000","last_clean":"2024-05-10T14:02:56.349554+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:02:56.349554+0000","last_undegraded":"2024-05-10T14:02:56.349554+0000","last_fullsized":"2024-05-10T14:02:56.349554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350857+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:02:56.350857+0000","last_peered":"2024-05-10T14:02:56.350857+0000","last_clean":"2024-05-10T14:02:56.350857+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:02:56.350857+0000","last_undegraded":"2024-05-10T14:02:56.350857+0000","last_fullsized":"2024-05-10T14:02:56.350857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010160+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:02:57.010160+0000","last_peered":"2024-05-10T14:02:57.010160+0000","last_clean":"2024-05-10T14:02:57.010160+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:02:57.010160+0000","last_undegraded":"2024-05-10T14:02:57.010160+0000","last_fullsized":"2024-05-10T14:02:57.010160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999179+0000","last_change":"2024-05-10T14:02:40.733924+0000","last_active":"2024-05-10T14:02:56.999179+0000","last_peered":"2024-05-10T14:02:56.999179+0000","last_clean":"2024-05-10T14:02:56.999179+0000","last_became_active":"2024-05-10T14:02:40.733097+0000","last_became_peered":"2024-05-10T14:02:40.733097+0000","last_unstale":"2024-05-10T14:02:56.999179+0000","last_undegraded":"2024-05-10T14:02:56.999179+0000","last_fullsized":"2024-05-10T14:02:56.999179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349407+0000","last_change":"2024-05-10T14:02:32.676636+0000","last_active":"2024-05-10T14:02:56.349407+0000","last_peered":"2024-05-10T14:02:56.349407+0000","last_clean":"2024-05-10T14:02:56.349407+0000","last_became_active":"2024-05-10T14:02:32.673068+0000","last_became_peered":"2024-05-10T14:02:32.673068+0000","last_unstale":"2024-05-10T14:02:56.349407+0000","last_undegraded":"2024-05-10T14:02:56.349407+0000","last_fullsized":"2024-05-10T14:02:56.349407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008126+0000","last_change":"2024-05-10T14:02:30.664601+0000","last_active":"2024-05-10T14:02:57.008126+0000","last_peered":"2024-05-10T14:02:57.008126+0000","last_clean":"2024-05-10T14:02:57.008126+0000","last_became_active":"2024-05-10T14:02:30.664274+0000","last_became_peered":"2024-05-10T14:02:30.664274+0000","last_unstale":"2024-05-10T14:02:57.008126+0000","last_undegraded":"2024-05-10T14:02:57.008126+0000","last_fullsized":"2024-05-10T14:02:57.008126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010184+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:02:57.010184+0000","last_peered":"2024-05-10T14:02:57.010184+0000","last_clean":"2024-05-10T14:02:57.010184+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:02:57.010184+0000","last_undegraded":"2024-05-10T14:02:57.010184+0000","last_fullsized":"2024-05-10T14:02:57.010184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350455+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:02:56.350455+0000","last_peered":"2024-05-10T14:02:56.350455+0000","last_clean":"2024-05-10T14:02:56.350455+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:02:56.350455+0000","last_undegraded":"2024-05-10T14:02:56.350455+0000","last_fullsized":"2024-05-10T14:02:56.350455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006011+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:02:57.006011+0000","last_peered":"2024-05-10T14:02:57.006011+0000","last_clean":"2024-05-10T14:02:57.006011+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:02:57.006011+0000","last_undegraded":"2024-05-10T14:02:57.006011+0000","last_fullsized":"2024-05-10T14:02:57.006011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010996+0000","last_change":"2024-05-10T14:02:32.684577+0000","last_active":"2024-05-10T14:02:57.010996+0000","last_peered":"2024-05-10T14:02:57.010996+0000","last_clean":"2024-05-10T14:02:57.010996+0000","last_became_active":"2024-05-10T14:02:32.683843+0000","last_became_peered":"2024-05-10T14:02:32.683843+0000","last_unstale":"2024-05-10T14:02:57.010996+0000","last_undegraded":"2024-05-10T14:02:57.010996+0000","last_fullsized":"2024-05-10T14:02:57.010996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349881+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:02:56.349881+0000","last_peered":"2024-05-10T14:02:56.349881+0000","last_clean":"2024-05-10T14:02:56.349881+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:02:56.349881+0000","last_undegraded":"2024-05-10T14:02:56.349881+0000","last_fullsized":"2024-05-10T14:02:56.349881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.007867+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:02:57.007867+0000","last_peered":"2024-05-10T14:02:57.007867+0000","last_clean":"2024-05-10T14:02:57.007867+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:02:57.007867+0000","last_undegraded":"2024-05-10T14:02:57.007867+0000","last_fullsized":"2024-05-10T14:02:57.007867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324893+0000","last_change":"2024-05-10T14:02:36.696412+0000","last_active":"2024-05-10T14:02:54.324893+0000","last_peered":"2024-05-10T14:02:54.324893+0000","last_clean":"2024-05-10T14:02:54.324893+0000","last_became_active":"2024-05-10T14:02:36.695516+0000","last_became_peered":"2024-05-10T14:02:36.695516+0000","last_unstale":"2024-05-10T14:02:54.324893+0000","last_undegraded":"2024-05-10T14:02:54.324893+0000","last_fullsized":"2024-05-10T14:02:54.324893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:24.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000298+0000","last_change":"2024-05-10T14:02:38.730974+0000","last_active":"2024-05-10T14:02:57.000298+0000","last_peered":"2024-05-10T14:02:57.000298+0000","last_clean":"2024-05-10T14:02:57.000298+0000","last_became_active":"2024-05-10T14:02:38.730309+0000","last_became_peered":"2024-05-10T14:02:38.730309+0000","last_unstale":"2024-05-10T14:02:57.000298+0000","last_undegraded":"2024-05-10T14:02:57.000298+0000","last_fullsized":"2024-05-10T14:02:57.000298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350563+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:02:56.350563+0000","last_peered":"2024-05-10T14:02:56.350563+0000","last_clean":"2024-05-10T14:02:56.350563+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:02:56.350563+0000","last_undegraded":"2024-05-10T14:02:56.350563+0000","last_fullsized":"2024-05-10T14:02:56.350563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004838+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:02:57.004838+0000","last_peered":"2024-05-10T14:02:57.004838+0000","last_clean":"2024-05-10T14:02:57.004838+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:02:57.004838+0000","last_undegraded":"2024-05-10T14:02:57.004838+0000","last_fullsized":"2024-05-10T14:02:57.004838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324984+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:02:54.324984+0000","last_peered":"2024-05-10T14:02:54.324984+0000","last_clean":"2024-05-10T14:02:54.324984+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:02:54.324984+0000","last_undegraded":"2024-05-10T14:02:54.324984+0000","last_fullsized":"2024-05-10T14:02:54.324984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010844+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:02:57.010844+0000","last_peered":"2024-05-10T14:02:57.010844+0000","last_clean":"2024-05-10T14:02:57.010844+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:02:57.010844+0000","last_undegraded":"2024-05-10T14:02:57.010844+0000","last_fullsized":"2024-05-10T14:02:57.010844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350366+0000","last_change":"2024-05-10T14:02:36.699400+0000","last_active":"2024-05-10T14:02:56.350366+0000","last_peered":"2024-05-10T14:02:56.350366+0000","last_clean":"2024-05-10T14:02:56.350366+0000","last_became_active":"2024-05-10T14:02:36.698700+0000","last_became_peered":"2024-05-10T14:02:36.698700+0000","last_unstale":"2024-05-10T14:02:56.350366+0000","last_undegraded":"2024-05-10T14:02:56.350366+0000","last_fullsized":"2024-05-10T14:02:56.350366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325196+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:02:54.325196+0000","last_peered":"2024-05-10T14:02:54.325196+0000","last_clean":"2024-05-10T14:02:54.325196+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:02:54.325196+0000","last_undegraded":"2024-05-10T14:02:54.325196+0000","last_fullsized":"2024-05-10T14:02:54.325196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.009897+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:02:57.009897+0000","last_peered":"2024-05-10T14:02:57.009897+0000","last_clean":"2024-05-10T14:02:57.009897+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:02:57.009897+0000","last_undegraded":"2024-05-10T14:02:57.009897+0000","last_fullsized":"2024-05-10T14:02:57.009897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351039+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:02:56.351039+0000","last_peered":"2024-05-10T14:02:56.351039+0000","last_clean":"2024-05-10T14:02:56.351039+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:02:56.351039+0000","last_undegraded":"2024-05-10T14:02:56.351039+0000","last_fullsized":"2024-05-10T14:02:56.351039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330641+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:02:55.330641+0000","last_peered":"2024-05-10T14:02:55.330641+0000","last_clean":"2024-05-10T14:02:55.330641+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:02:55.330641+0000","last_undegraded":"2024-05-10T14:02:55.330641+0000","last_fullsized":"2024-05-10T14:02:55.330641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331228+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:02:55.331228+0000","last_peered":"2024-05-10T14:02:55.331228+0000","last_clean":"2024-05-10T14:02:55.331228+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:02:55.331228+0000","last_undegraded":"2024-05-10T14:02:55.331228+0000","last_fullsized":"2024-05-10T14:02:55.331228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354616+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:02:56.354616+0000","last_peered":"2024-05-10T14:02:56.354616+0000","last_clean":"2024-05-10T14:02:56.354616+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:02:56.354616+0000","last_undegraded":"2024-05-10T14:02:56.354616+0000","last_fullsized":"2024-05-10T14:02:56.354616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324301+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:02:54.324301+0000","last_peered":"2024-05-10T14:02:54.324301+0000","last_clean":"2024-05-10T14:02:54.324301+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:02:54.324301+0000","last_undegraded":"2024-05-10T14:02:54.324301+0000","last_fullsized":"2024-05-10T14:02:54.324301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999103+0000","last_change":"2024-05-10T14:02:40.733960+0000","last_active":"2024-05-10T14:02:56.999103+0000","last_peered":"2024-05-10T14:02:56.999103+0000","last_clean":"2024-05-10T14:02:56.999103+0000","last_became_active":"2024-05-10T14:02:40.733072+0000","last_became_peered":"2024-05-10T14:02:40.733072+0000","last_unstale":"2024-05-10T14:02:56.999103+0000","last_undegraded":"2024-05-10T14:02:56.999103+0000","last_fullsized":"2024-05-10T14:02:56.999103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847420+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:02:55.847420+0000","last_peered":"2024-05-10T14:02:55.847420+0000","last_clean":"2024-05-10T14:02:55.847420+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:02:55.847420+0000","last_undegraded":"2024-05-10T14:02:55.847420+0000","last_fullsized":"2024-05-10T14:02:55.847420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006129+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:02:57.006129+0000","last_peered":"2024-05-10T14:02:57.006129+0000","last_clean":"2024-05-10T14:02:57.006129+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:02:57.006129+0000","last_undegraded":"2024-05-10T14:02:57.006129+0000","last_fullsized":"2024-05-10T14:02:57.006129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325446+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:02:54.325446+0000","last_peered":"2024-05-10T14:02:54.325446+0000","last_clean":"2024-05-10T14:02:54.325446+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:02:54.325446+0000","last_undegraded":"2024-05-10T14:02:54.325446+0000","last_fullsized":"2024-05-10T14:02:54.325446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331578+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:02:55.331578+0000","last_peered":"2024-05-10T14:02:55.331578+0000","last_clean":"2024-05-10T14:02:55.331578+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:02:55.331578+0000","last_undegraded":"2024-05-10T14:02:55.331578+0000","last_fullsized":"2024-05-10T14:02:55.331578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010670+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:02:57.010670+0000","last_peered":"2024-05-10T14:02:57.010670+0000","last_clean":"2024-05-10T14:02:57.010670+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:02:57.010670+0000","last_undegraded":"2024-05-10T14:02:57.010670+0000","last_fullsized":"2024-05-10T14:02:57.010670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349554+0000","last_change":"2024-05-10T14:02:40.736838+0000","last_active":"2024-05-10T14:02:56.349554+0000","last_peered":"2024-05-10T14:02:56.349554+0000","last_clean":"2024-05-10T14:02:56.349554+0000","last_became_active":"2024-05-10T14:02:40.735991+0000","last_became_peered":"2024-05-10T14:02:40.735991+0000","last_unstale":"2024-05-10T14:02:56.349554+0000","last_undegraded":"2024-05-10T14:02:56.349554+0000","last_fullsized":"2024-05-10T14:02:56.349554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:22.716620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329982+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:02:55.329982+0000","last_peered":"2024-05-10T14:02:55.329982+0000","last_clean":"2024-05-10T14:02:55.329982+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:02:55.329982+0000","last_undegraded":"2024-05-10T14:02:55.329982+0000","last_fullsized":"2024-05-10T14:02:55.329982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000475+0000","last_change":"2024-05-10T14:02:30.661826+0000","last_active":"2024-05-10T14:02:57.000475+0000","last_peered":"2024-05-10T14:02:57.000475+0000","last_clean":"2024-05-10T14:02:57.000475+0000","last_became_active":"2024-05-10T14:02:30.660030+0000","last_became_peered":"2024-05-10T14:02:30.660030+0000","last_unstale":"2024-05-10T14:02:57.000475+0000","last_undegraded":"2024-05-10T14:02:57.000475+0000","last_fullsized":"2024-05-10T14:02:57.000475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350747+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:02:56.350747+0000","last_peered":"2024-05-10T14:02:56.350747+0000","last_clean":"2024-05-10T14:02:56.350747+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:02:56.350747+0000","last_undegraded":"2024-05-10T14:02:56.350747+0000","last_fullsized":"2024-05-10T14:02:56.350747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999847+0000","last_change":"2024-05-10T14:02:36.701658+0000","last_active":"2024-05-10T14:02:56.999847+0000","last_peered":"2024-05-10T14:02:56.999847+0000","last_clean":"2024-05-10T14:02:56.999847+0000","last_became_active":"2024-05-10T14:02:36.700840+0000","last_became_peered":"2024-05-10T14:02:36.700840+0000","last_unstale":"2024-05-10T14:02:56.999847+0000","last_undegraded":"2024-05-10T14:02:56.999847+0000","last_fullsized":"2024-05-10T14:02:56.999847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005213+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:02:57.005213+0000","last_peered":"2024-05-10T14:02:57.005213+0000","last_clean":"2024-05-10T14:02:57.005213+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:02:57.005213+0000","last_undegraded":"2024-05-10T14:02:57.005213+0000","last_fullsized":"2024-05-10T14:02:57.005213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352049+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:02:56.352049+0000","last_peered":"2024-05-10T14:02:56.352049+0000","last_clean":"2024-05-10T14:02:56.352049+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:02:56.352049+0000","last_undegraded":"2024-05-10T14:02:56.352049+0000","last_fullsized":"2024-05-10T14:02:56.352049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330342+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:02:55.330342+0000","last_peered":"2024-05-10T14:02:55.330342+0000","last_clean":"2024-05-10T14:02:55.330342+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:02:55.330342+0000","last_undegraded":"2024-05-10T14:02:55.330342+0000","last_fullsized":"2024-05-10T14:02:55.330342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000699+0000","last_change":"2024-05-10T14:02:30.660120+0000","last_active":"2024-05-10T14:02:57.000699+0000","last_peered":"2024-05-10T14:02:57.000699+0000","last_clean":"2024-05-10T14:02:57.000699+0000","last_became_active":"2024-05-10T14:02:30.658976+0000","last_became_peered":"2024-05-10T14:02:30.658976+0000","last_unstale":"2024-05-10T14:02:57.000699+0000","last_undegraded":"2024-05-10T14:02:57.000699+0000","last_fullsized":"2024-05-10T14:02:57.000699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000200+0000","last_change":"2024-05-10T14:02:34.700027+0000","last_active":"2024-05-10T14:02:57.000200+0000","last_peered":"2024-05-10T14:02:57.000200+0000","last_clean":"2024-05-10T14:02:57.000200+0000","last_became_active":"2024-05-10T14:02:34.699301+0000","last_became_peered":"2024-05-10T14:02:34.699301+0000","last_unstale":"2024-05-10T14:02:57.000200+0000","last_undegraded":"2024-05-10T14:02:57.000200+0000","last_fullsized":"2024-05-10T14:02:57.000200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:30:40.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.005225+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:02:57.005225+0000","last_peered":"2024-05-10T14:02:57.005225+0000","last_clean":"2024-05-10T14:02:57.005225+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:02:57.005225+0000","last_undegraded":"2024-05-10T14:02:57.005225+0000","last_fullsized":"2024-05-10T14:02:57.005225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010063+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:02:57.010063+0000","last_peered":"2024-05-10T14:02:57.010063+0000","last_clean":"2024-05-10T14:02:57.010063+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:02:57.010063+0000","last_undegraded":"2024-05-10T14:02:57.010063+0000","last_fullsized":"2024-05-10T14:02:57.010063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353769+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:02:56.353769+0000","last_peered":"2024-05-10T14:02:56.353769+0000","last_clean":"2024-05-10T14:02:56.353769+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:02:56.353769+0000","last_undegraded":"2024-05-10T14:02:56.353769+0000","last_fullsized":"2024-05-10T14:02:56.353769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350071+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:02:56.350071+0000","last_peered":"2024-05-10T14:02:56.350071+0000","last_clean":"2024-05-10T14:02:56.350071+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:02:56.350071+0000","last_undegraded":"2024-05-10T14:02:56.350071+0000","last_fullsized":"2024-05-10T14:02:56.350071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354223+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:02:56.354223+0000","last_peered":"2024-05-10T14:02:56.354223+0000","last_clean":"2024-05-10T14:02:56.354223+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:02:56.354223+0000","last_undegraded":"2024-05-10T14:02:56.354223+0000","last_fullsized":"2024-05-10T14:02:56.354223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.328839+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:02:55.328839+0000","last_peered":"2024-05-10T14:02:55.328839+0000","last_clean":"2024-05-10T14:02:55.328839+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:02:55.328839+0000","last_undegraded":"2024-05-10T14:02:55.328839+0000","last_fullsized":"2024-05-10T14:02:55.328839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351646+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:02:56.351646+0000","last_peered":"2024-05-10T14:02:56.351646+0000","last_clean":"2024-05-10T14:02:56.351646+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:02:56.351646+0000","last_undegraded":"2024-05-10T14:02:56.351646+0000","last_fullsized":"2024-05-10T14:02:56.351646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329146+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:02:55.329146+0000","last_peered":"2024-05-10T14:02:55.329146+0000","last_clean":"2024-05-10T14:02:55.329146+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:02:55.329146+0000","last_undegraded":"2024-05-10T14:02:55.329146+0000","last_fullsized":"2024-05-10T14:02:55.329146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351677+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:02:56.351677+0000","last_peered":"2024-05-10T14:02:56.351677+0000","last_clean":"2024-05-10T14:02:56.351677+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:02:56.351677+0000","last_undegraded":"2024-05-10T14:02:56.351677+0000","last_fullsized":"2024-05-10T14:02:56.351677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329689+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:02:55.329689+0000","last_peered":"2024-05-10T14:02:55.329689+0000","last_clean":"2024-05-10T14:02:55.329689+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:02:55.329689+0000","last_undegraded":"2024-05-10T14:02:55.329689+0000","last_fullsized":"2024-05-10T14:02:55.329689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.008140+0000","last_change":"2024-05-10T14:02:30.664222+0000","last_active":"2024-05-10T14:02:57.008140+0000","last_peered":"2024-05-10T14:02:57.008140+0000","last_clean":"2024-05-10T14:02:57.008140+0000","last_became_active":"2024-05-10T14:02:30.663784+0000","last_became_peered":"2024-05-10T14:02:30.663784+0000","last_unstale":"2024-05-10T14:02:57.008140+0000","last_undegraded":"2024-05-10T14:02:57.008140+0000","last_fullsized":"2024-05-10T14:02:57.008140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324206+0000","last_change":"2024-05-10T14:02:34.706054+0000","last_active":"2024-05-10T14:02:54.324206+0000","last_peered":"2024-05-10T14:02:54.324206+0000","last_clean":"2024-05-10T14:02:54.324206+0000","last_became_active":"2024-05-10T14:02:34.705486+0000","last_became_peered":"2024-05-10T14:02:34.705486+0000","last_unstale":"2024-05-10T14:02:54.324206+0000","last_undegraded":"2024-05-10T14:02:54.324206+0000","last_fullsized":"2024-05-10T14:02:54.324206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:39:05.822560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.329312+0000","last_change":"2024-05-10T14:02:36.695528+0000","last_active":"2024-05-10T14:02:55.329312+0000","last_peered":"2024-05-10T14:02:55.329312+0000","last_clean":"2024-05-10T14:02:55.329312+0000","last_became_active":"2024-05-10T14:02:36.694789+0000","last_became_peered":"2024-05-10T14:02:36.694789+0000","last_unstale":"2024-05-10T14:02:55.329312+0000","last_undegraded":"2024-05-10T14:02:55.329312+0000","last_fullsized":"2024-05-10T14:02:55.329312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:36.308120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006439+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:02:57.006439+0000","last_peered":"2024-05-10T14:02:57.006439+0000","last_clean":"2024-05-10T14:02:57.006439+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:02:57.006439+0000","last_undegraded":"2024-05-10T14:02:57.006439+0000","last_fullsized":"2024-05-10T14:02:57.006439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331348+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:02:55.331348+0000","last_peered":"2024-05-10T14:02:55.331348+0000","last_clean":"2024-05-10T14:02:55.331348+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:02:55.331348+0000","last_undegraded":"2024-05-10T14:02:55.331348+0000","last_fullsized":"2024-05-10T14:02:55.331348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326979+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:02:54.326979+0000","last_peered":"2024-05-10T14:02:54.326979+0000","last_clean":"2024-05-10T14:02:54.326979+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:02:54.326979+0000","last_undegraded":"2024-05-10T14:02:54.326979+0000","last_fullsized":"2024-05-10T14:02:54.326979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010137+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:02:57.010137+0000","last_peered":"2024-05-10T14:02:57.010137+0000","last_clean":"2024-05-10T14:02:57.010137+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:02:57.010137+0000","last_undegraded":"2024-05-10T14:02:57.010137+0000","last_fullsized":"2024-05-10T14:02:57.010137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.326757+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:02:54.326757+0000","last_peered":"2024-05-10T14:02:54.326757+0000","last_clean":"2024-05-10T14:02:54.326757+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:02:54.326757+0000","last_undegraded":"2024-05-10T14:02:54.326757+0000","last_fullsized":"2024-05-10T14:02:54.326757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.846962+0000","last_change":"2024-05-10T14:02:30.663047+0000","last_active":"2024-05-10T14:02:55.846962+0000","last_peered":"2024-05-10T14:02:55.846962+0000","last_clean":"2024-05-10T14:02:55.846962+0000","last_became_active":"2024-05-10T14:02:30.662722+0000","last_became_peered":"2024-05-10T14:02:30.662722+0000","last_unstale":"2024-05-10T14:02:55.846962+0000","last_undegraded":"2024-05-10T14:02:55.846962+0000","last_fullsized":"2024-05-10T14:02:55.846962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999293+0000","last_change":"2024-05-10T14:02:32.685578+0000","last_active":"2024-05-10T14:02:56.999293+0000","last_peered":"2024-05-10T14:02:56.999293+0000","last_clean":"2024-05-10T14:02:56.999293+0000","last_became_active":"2024-05-10T14:02:32.682816+0000","last_became_peered":"2024-05-10T14:02:32.682816+0000","last_unstale":"2024-05-10T14:02:56.999293+0000","last_undegraded":"2024-05-10T14:02:56.999293+0000","last_fullsized":"2024-05-10T14:02:56.999293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000193+0000","last_change":"2024-05-10T14:02:30.667144+0000","last_active":"2024-05-10T14:02:57.000193+0000","last_peered":"2024-05-10T14:02:57.000193+0000","last_clean":"2024-05-10T14:02:57.000193+0000","last_became_active":"2024-05-10T14:02:30.666407+0000","last_became_peered":"2024-05-10T14:02:30.666407+0000","last_unstale":"2024-05-10T14:02:57.000193+0000","last_undegraded":"2024-05-10T14:02:57.000193+0000","last_fullsized":"2024-05-10T14:02:57.000193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325592+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:02:54.325592+0000","last_peered":"2024-05-10T14:02:54.325592+0000","last_clean":"2024-05-10T14:02:54.325592+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:02:54.325592+0000","last_undegraded":"2024-05-10T14:02:54.325592+0000","last_fullsized":"2024-05-10T14:02:54.325592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006240+0000","last_change":"2024-05-10T14:02:30.644592+0000","last_active":"2024-05-10T14:02:57.006240+0000","last_peered":"2024-05-10T14:02:57.006240+0000","last_clean":"2024-05-10T14:02:57.006240+0000","last_became_active":"2024-05-10T14:02:30.644241+0000","last_became_peered":"2024-05-10T14:02:30.644241+0000","last_unstale":"2024-05-10T14:02:57.006240+0000","last_undegraded":"2024-05-10T14:02:57.006240+0000","last_fullsized":"2024-05-10T14:02:57.006240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.351359+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:02:56.351359+0000","last_peered":"2024-05-10T14:02:56.351359+0000","last_clean":"2024-05-10T14:02:56.351359+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:02:56.351359+0000","last_undegraded":"2024-05-10T14:02:56.351359+0000","last_fullsized":"2024-05-10T14:02:56.351359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.353323+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:02:56.353323+0000","last_peered":"2024-05-10T14:02:56.353323+0000","last_clean":"2024-05-10T14:02:56.353323+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:02:56.353323+0000","last_undegraded":"2024-05-10T14:02:56.353323+0000","last_fullsized":"2024-05-10T14:02:56.353323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330479+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:02:55.330479+0000","last_peered":"2024-05-10T14:02:55.330479+0000","last_clean":"2024-05-10T14:02:55.330479+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:02:55.330479+0000","last_undegraded":"2024-05-10T14:02:55.330479+0000","last_fullsized":"2024-05-10T14:02:55.330479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.325729+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:02:54.325729+0000","last_peered":"2024-05-10T14:02:54.325729+0000","last_clean":"2024-05-10T14:02:54.325729+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:02:54.325729+0000","last_undegraded":"2024-05-10T14:02:54.325729+0000","last_fullsized":"2024-05-10T14:02:54.325729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349933+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:02:56.349933+0000","last_peered":"2024-05-10T14:02:56.349933+0000","last_clean":"2024-05-10T14:02:56.349933+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:02:56.349933+0000","last_undegraded":"2024-05-10T14:02:56.349933+0000","last_fullsized":"2024-05-10T14:02:56.349933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.011005+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:02:57.011005+0000","last_peered":"2024-05-10T14:02:57.011005+0000","last_clean":"2024-05-10T14:02:57.011005+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:02:57.011005+0000","last_undegraded":"2024-05-10T14:02:57.011005+0000","last_fullsized":"2024-05-10T14:02:57.011005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010034+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:02:57.010034+0000","last_peered":"2024-05-10T14:02:57.010034+0000","last_clean":"2024-05-10T14:02:57.010034+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:02:57.010034+0000","last_undegraded":"2024-05-10T14:02:57.010034+0000","last_fullsized":"2024-05-10T14:02:57.010034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.354375+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:02:56.354375+0000","last_peered":"2024-05-10T14:02:56.354375+0000","last_clean":"2024-05-10T14:02:56.354375+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:02:56.354375+0000","last_undegraded":"2024-05-10T14:02:56.354375+0000","last_fullsized":"2024-05-10T14:02:56.354375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004696+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:02:57.004696+0000","last_peered":"2024-05-10T14:02:57.004696+0000","last_clean":"2024-05-10T14:02:57.004696+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:02:57.004696+0000","last_undegraded":"2024-05-10T14:02:57.004696+0000","last_fullsized":"2024-05-10T14:02:57.004696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999898+0000","last_change":"2024-05-10T14:02:30.656911+0000","last_active":"2024-05-10T14:02:56.999898+0000","last_peered":"2024-05-10T14:02:56.999898+0000","last_clean":"2024-05-10T14:02:56.999898+0000","last_became_active":"2024-05-10T14:02:30.650731+0000","last_became_peered":"2024-05-10T14:02:30.650731+0000","last_unstale":"2024-05-10T14:02:56.999898+0000","last_undegraded":"2024-05-10T14:02:56.999898+0000","last_fullsized":"2024-05-10T14:02:56.999898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.331846+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:02:55.331846+0000","last_peered":"2024-05-10T14:02:55.331846+0000","last_clean":"2024-05-10T14:02:55.331846+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:02:55.331846+0000","last_undegraded":"2024-05-10T14:02:55.331846+0000","last_fullsized":"2024-05-10T14:02:55.331846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350121+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:02:56.350121+0000","last_peered":"2024-05-10T14:02:56.350121+0000","last_clean":"2024-05-10T14:02:56.350121+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:02:56.350121+0000","last_undegraded":"2024-05-10T14:02:56.350121+0000","last_fullsized":"2024-05-10T14:02:56.350121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847619+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:02:55.847619+0000","last_peered":"2024-05-10T14:02:55.847619+0000","last_clean":"2024-05-10T14:02:55.847619+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:02:55.847619+0000","last_undegraded":"2024-05-10T14:02:55.847619+0000","last_fullsized":"2024-05-10T14:02:55.847619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000056+0000","last_change":"2024-05-10T14:02:30.665295+0000","last_active":"2024-05-10T14:02:57.000056+0000","last_peered":"2024-05-10T14:02:57.000056+0000","last_clean":"2024-05-10T14:02:57.000056+0000","last_became_active":"2024-05-10T14:02:30.663923+0000","last_became_peered":"2024-05-10T14:02:30.663923+0000","last_unstale":"2024-05-10T14:02:57.000056+0000","last_undegraded":"2024-05-10T14:02:57.000056+0000","last_fullsized":"2024-05-10T14:02:57.000056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.330951+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:02:55.330951+0000","last_peered":"2024-05-10T14:02:55.330951+0000","last_clean":"2024-05-10T14:02:55.330951+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:02:55.330951+0000","last_undegraded":"2024-05-10T14:02:55.330951+0000","last_fullsized":"2024-05-10T14:02:55.330951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.006410+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:02:57.006410+0000","last_peered":"2024-05-10T14:02:57.006410+0000","last_clean":"2024-05-10T14:02:57.006410+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:02:57.006410+0000","last_undegraded":"2024-05-10T14:02:57.006410+0000","last_fullsized":"2024-05-10T14:02:57.006410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350878+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:02:56.350878+0000","last_peered":"2024-05-10T14:02:56.350878+0000","last_clean":"2024-05-10T14:02:56.350878+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:02:56.350878+0000","last_undegraded":"2024-05-10T14:02:56.350878+0000","last_fullsized":"2024-05-10T14:02:56.350878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.010650+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:02:57.010650+0000","last_peered":"2024-05-10T14:02:57.010650+0000","last_clean":"2024-05-10T14:02:57.010650+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:02:57.010650+0000","last_undegraded":"2024-05-10T14:02:57.010650+0000","last_fullsized":"2024-05-10T14:02:57.010650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004461+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:02:57.004461+0000","last_peered":"2024-05-10T14:02:57.004461+0000","last_clean":"2024-05-10T14:02:57.004461+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:02:57.004461+0000","last_undegraded":"2024-05-10T14:02:57.004461+0000","last_fullsized":"2024-05-10T14:02:57.004461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.352425+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:02:56.352425+0000","last_peered":"2024-05-10T14:02:56.352425+0000","last_clean":"2024-05-10T14:02:56.352425+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:02:56.352425+0000","last_undegraded":"2024-05-10T14:02:56.352425+0000","last_fullsized":"2024-05-10T14:02:56.352425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.349877+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:02:56.349877+0000","last_peered":"2024-05-10T14:02:56.349877+0000","last_clean":"2024-05-10T14:02:56.349877+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:02:56.349877+0000","last_undegraded":"2024-05-10T14:02:56.349877+0000","last_fullsized":"2024-05-10T14:02:56.349877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-10T14:02:55.847797+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:02:55.847797+0000","last_peered":"2024-05-10T14:02:55.847797+0000","last_clean":"2024-05-10T14:02:55.847797+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:02:55.847797+0000","last_undegraded":"2024-05-10T14:02:55.847797+0000","last_fullsized":"2024-05-10T14:02:55.847797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.350046+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:02:56.350046+0000","last_peered":"2024-05-10T14:02:56.350046+0000","last_clean":"2024-05-10T14:02:56.350046+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:02:56.350046+0000","last_undegraded":"2024-05-10T14:02:56.350046+0000","last_fullsized":"2024-05-10T14:02:56.350046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.001111+0000","last_change":"2024-05-10T14:02:30.662908+0000","last_active":"2024-05-10T14:02:57.001111+0000","last_peered":"2024-05-10T14:02:57.001111+0000","last_clean":"2024-05-10T14:02:57.001111+0000","last_became_active":"2024-05-10T14:02:30.661976+0000","last_became_peered":"2024-05-10T14:02:30.661976+0000","last_unstale":"2024-05-10T14:02:57.001111+0000","last_undegraded":"2024-05-10T14:02:57.001111+0000","last_fullsized":"2024-05-10T14:02:57.001111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:11.169647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:56.999893+0000","last_change":"2024-05-10T14:02:30.667582+0000","last_active":"2024-05-10T14:02:56.999893+0000","last_peered":"2024-05-10T14:02:56.999893+0000","last_clean":"2024-05-10T14:02:56.999893+0000","last_became_active":"2024-05-10T14:02:30.657669+0000","last_became_peered":"2024-05-10T14:02:30.657669+0000","last_unstale":"2024-05-10T14:02:56.999893+0000","last_undegraded":"2024-05-10T14:02:56.999893+0000","last_fullsized":"2024-05-10T14:02:56.999893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:35.400613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.004832+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:02:57.004832+0000","last_peered":"2024-05-10T14:02:57.004832+0000","last_clean":"2024-05-10T14:02:57.004832+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:02:57.004832+0000","last_undegraded":"2024-05-10T14:02:57.004832+0000","last_fullsized":"2024-05-10T14:02:57.004832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T14:02:54.324822+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:02:54.324822+0000","last_peered":"2024-05-10T14:02:54.324822+0000","last_clean":"2024-05-10T14:02:54.324822+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:02:54.324822+0000","last_undegraded":"2024-05-10T14:02:54.324822+0000","last_fullsized":"2024-05-10T14:02:54.324822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-10T14:02:57.000830+0000","last_change":"2024-05-10T14:02:32.681773+0000","last_active":"2024-05-10T14:02:57.000830+0000","last_peered":"2024-05-10T14:02:57.000830+0000","last_clean":"2024-05-10T14:02:57.000830+0000","last_became_active":"2024-05-10T14:02:32.681013+0000","last_became_peered":"2024-05-10T14:02:32.681013+0000","last_unstale":"2024-05-10T14:02:57.000830+0000","last_undegraded":"2024-05-10T14:02:57.000830+0000","last_fullsized":"2024-05-10T14:02:57.000830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1089536,"data_stored":798115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":207523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":207578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":487424,"data_stored":207483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":206649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1073152,"data_stored":797957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":462848,"data_stored":192053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:02:59.298 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T14:02:59.298 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:02:59.298 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-05-10T14:02:59.298 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-10T14:02:59.298 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-10T14:02:59.298 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-05-10T14:02:59.344 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:59.347+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:59.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:02:59.429 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:02:59.430 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-05-10T14:02:59.430 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:02:59.433 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:02:59.435+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:02:59.465 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:59.465 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:02:59.465 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:02:59.466 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:02:59.466 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:59.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:02:59.534 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:02:59.535+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:02:59.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.441180950000003, 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:02:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.439647264999998, 2024-05-10T14:02:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:02:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:02:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.105596953000003, 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:02:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:02:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:02:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:40 5.3 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.866026616999999, 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002628563, 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744479+0000", 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2469999999999998e-06 2024-05-10T14:02:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744509+0000", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0043e-05 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744542+0000", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2329000000000002e-05 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744567+0000", 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.48e-05 2024-05-10T14:02:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744643+0000", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.64e-05 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744742+0000", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9531000000000006e-05 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744874+0000", 2024-05-10T14:02:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013199500000000001 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.745910+0000", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001035567 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.746998+0000", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001087502 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747058+0000", 2024-05-10T14:02:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0822000000000001e-05 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747106+0000", 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7327000000000003e-05 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.863473848000002, 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.860219089000001, 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:02:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.901271404999999, 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:02:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:02:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.883432218999999, 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:02:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.846974017000001, 2024-05-10T14:02:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:02:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.833129387, 2024-05-10T14:02:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:02:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:02:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.803903376000001, 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:02:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:02:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.786476233999998, 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:02:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:02:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.732317766000001, 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:02:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:02:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:02:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:02:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.519426832000001, 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.51503885, 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:02:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.341533978000001, 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:02:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.288759192000001, 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:02:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.283999608999999, 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:02:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:02:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.103647303999999, 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:02:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:02:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:02:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.099843506999999, 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:02:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:02:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:02:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:02:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:02:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:02:59.722 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:02:59.723 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:02:59.724 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:59.724+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:59.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:02:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:02:59.757 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:02:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:02:59.774 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:02:59.774 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:02:59.790 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:02:59.791 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:02:59.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:02:59.811 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:02:59.824 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:02:59.823+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:02:59.833 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:02:59.834 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:02:59.854 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:02:59.854 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:02:59.856 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:59.856 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:02:59.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:02:59.875 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:02:59.876 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:02:59.939 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:02:59.940+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:02:59.998 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:02:59.998 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:00.055 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:00.056+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:00.126 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:00.127+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:00.173 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.173 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:00.235 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:00.236+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:00.309 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.309 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:00.367 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:00.368+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:00.379 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:03:00.429 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:00.431+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:00.500 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.500 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:00.559 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:00.560+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:00.631 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:00.631+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:00.651 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.651 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:00.731 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:00.731+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:00.830 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.831 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.832 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:00.831+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:00.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:00.933 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:00.935+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:00.975 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:00.975 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:00.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:01.034 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:01.035+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:01.121 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.121 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.135 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:01.135+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:01.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:01.236 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:01.236+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:01.267 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.267 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:01.337 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:01.336+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:01.404 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.405 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.419 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:01.465 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:01.467+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:01.539 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:01.540+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:01.542 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.542 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:01.640 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:01.640+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:01.719 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.719 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:01.741 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:01.740+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:01.842 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:01.843+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:01.851 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:01.851 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:01.865 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:01.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:01.942 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:01.940+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:02.035 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:02.035 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:02.043 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:02.043+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:02.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:02.059 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:02.059 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:02.076 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:02.093 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:02.093 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:02.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:02.116 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:02.136 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:02.136 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:02.144 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:02.144+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:02.154 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:02.180 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:02.180 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:02.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:02.206 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:02.218 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:02.218 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:02.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:02.276 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:02.279+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:02.346 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:02.347+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:02.352 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:02.352 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:02.352 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:02.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:02.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:03:02.451 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:02.452+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:02.531 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.785882804, 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:03:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.833277063000001, 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:03:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:03:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:03:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.805833089, 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:03:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:03:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:03:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:03:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.792575634999999, 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:03:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.790003719000001, 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:03:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.693391128000002, 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:03:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.777276304000001, 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:03:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:03:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.737934697, 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:03:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.678964733000001, 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.663423099999999, 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.662917066999999, 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:03:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.658697548999999, 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:03:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:03:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.643632551, 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:03:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.642246529000001, 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:03:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:03:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:03:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.637305065, 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:03:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.636849216999998, 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:03:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:03:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.621829950999999, 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:03:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:03:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:03:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.616763930000001, 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:03:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:03:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.522793830000001, 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:03:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:03:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:03:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 2.7131820950000001, 2024-05-10T14:03:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:03:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:02.626 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:02.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:02.628 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:02.628+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:02.729 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:02.728+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:02.759 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:02.759 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:02.759 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:02.759 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:02.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:02.830 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:02.828+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:02.889 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:02.890 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:02.890 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:02.890 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:02.890 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:02.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:02.931 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:02.932+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:03.021 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 43.4753319, 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:03:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:03.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:03:03.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:03:03.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:03:03.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.030 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.852428142999997, 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.031 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:03:03.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:03:03.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756894496999998, 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.039 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:03:03.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:03:03.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:03:03.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:03:03.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.046 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756840291000003, 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.047 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:03:03.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756803421000001, 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.054 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.055 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:03:03.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756641876000003, 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.063 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:03:03.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756588536000002, 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.069 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:03:03.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:03:03.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.076 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756530617000003, 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.077 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:03:03.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:03:03.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756400868, 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:03:03.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:03:03.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.756362410999998, 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.091 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:03:03.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:03:03.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:03.098 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.529239287999999, 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:03:03.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.106 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.529031842999999, 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:03:03.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.112 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528917956999997, 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.113 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:03:03.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:03:03.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.118 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528749552000001, 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:03:03.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:03:03.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528711991999998, 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.125 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:03:03.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:03:03.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528658575999998, 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.131 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:03.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:03:03.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:03:03.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.136 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528533287000002, 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:03:03.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:03:03.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528493144000002, 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:03:03.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:03:03.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:03.148 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528440760999999, 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:03:03.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 42.528256362999997, 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:03.154 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:03.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:03.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:03.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.159 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.160 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.160 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:03.160 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:03.160 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:03.161 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:03.163+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:03.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:03.263 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:03.263+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:03.298 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:03.298 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:03.298 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:03.298 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:03.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:03.364 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:03.363+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:03.387 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:03:03.444 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:03.445 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:03.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:03.467 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:03.467+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:03.568 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:03.567+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:03.633 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:03.634 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:03.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:03.634 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.463031979999997, 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.461498294999998, 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:03.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.127447983000003, 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:03.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:03.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:40 5.3 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.887877647, 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002628563, 2024-05-10T14:03:03.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744479+0000", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2469999999999998e-06 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744509+0000", 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0043e-05 2024-05-10T14:03:03.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744542+0000", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2329000000000002e-05 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744567+0000", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.48e-05 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744643+0000", 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.64e-05 2024-05-10T14:03:03.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744742+0000", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9531000000000006e-05 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744874+0000", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013199500000000001 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.745910+0000", 2024-05-10T14:03:03.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001035567 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.746998+0000", 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001087502 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747058+0000", 2024-05-10T14:03:03.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0822000000000001e-05 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747106+0000", 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7327000000000003e-05 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.885324877999999, 2024-05-10T14:03:03.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:03.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:03.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.882070119000002, 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.923122435, 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.905283249, 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.868825047000001, 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.854980417, 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.689 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.825754406000001, 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.690 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:03.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:03.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.695 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.808327263999999, 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:03.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:03.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.754168795999998, 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:03.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:03.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.541277862000001, 2024-05-10T14:03:03.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.713 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.53688988, 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:03.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:03.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:03.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.719 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.363385008000002, 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:03.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:03.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.310610222000001, 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:03.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:03.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:03.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.305850638999999, 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:03.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:03.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.125498334, 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:03.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:03.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:03.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.121694537, 2024-05-10T14:03:03.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:03.748 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:03.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:03.750 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:03.751+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:03.850 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:03.848+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:03.884 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:03.884 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:03.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:03.987 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:03.988+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:04.052 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:04.052+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:04.065 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:04.065 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:04.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:04.153 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:04.155+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:04.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:04.254 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.574039691999999, 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.527970638999999, 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.522460293000002, 2024-05-10T14:03:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.412201464999999, 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.535975382, 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.513412499000001, 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.487084469999999, 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.469487912000002, 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:04.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.437149335000001, 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:04.305 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.403072671, 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:04.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.392516261000001, 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:04.311 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:04.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:04.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.111553495999999, 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:04.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:04.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.107264316999998, 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:04.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:04.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:04.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.065817207999999, 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:04.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:04.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:04.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:04.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.002505896999999, 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:04.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.967576389000001, 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:04.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.946111532, 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.881577845999999, 2024-05-10T14:03:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:04.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.719886794000001, 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.358 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:04.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.614263303000001, 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:04.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:04.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:04.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:04.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:04.369 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:04.370 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:04.252+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:04.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:04.372 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:04.371+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:04.378 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:04.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:04.397 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:04.414 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:04.431 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:04.431 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:04.453 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:04.453 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:04.473 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:04.475+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:04.474 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:04.474 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:04.495 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:04.495 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:04.496 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:04.496 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:04.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:04.518 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:04.583 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:04.584+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:04.648 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:04.648 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:04.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:04.711 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:04.712+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:04.777 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:04.778+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:04.842 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:04.842 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:04.857 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:04.903 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:04.904+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:04.979 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:04.978+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:04.986 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:04.986 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:05.080 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:05.078+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:05.181 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:05.180+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:05.184 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:05.184 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:05.282 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:05.282+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:05.381 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:05.381 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.382 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:05.380+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:05.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:05.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:03:05.483 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:05.482+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:05.584 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:05.584+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:05.685 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:05.686+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:05.787 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:05.788+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:05.838 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:03:05.883 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:05.883 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:05.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:05.907 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:05.908+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:05.989 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:05.990+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:06.022 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:06.022 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:06.036 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:06.121 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:06.122+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:06.191 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:06.190+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:06.204 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:06.204 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:06.219 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:06.292 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:06.292+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:06.385 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:06.385 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:06.393 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:06.394+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:06.399 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:06.493 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:06.492+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:06.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:06.559 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:06.559 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:06.573 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:06.595 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:06.592+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:06.695 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:06.696+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:06.697 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:06.697 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:06.701 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:06.701 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:06.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:06.719 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:06.719 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:06.736 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:06.753 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:06.754 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:06.769 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:06.770 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:06.787 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:06.788 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:06.796 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:06.794+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:06.805 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:06.823 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:06.823 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:06.828 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 32.083863436000001, 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 28.131257694999999, 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:03:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:03:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 28.103813721000002, 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 28.090556267, 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:03:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 28.087984350999999, 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.99137176, 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:03:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 25.075256935999999, 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:03:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:03:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 25.035915329000002, 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:03:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:03:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.976945364999999, 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.961403732000001, 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.960897699, 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:03:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.956678181000001, 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.941613183000001, 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:06.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:03:06.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.940227160999999, 2024-05-10T14:03:06.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:03:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:03:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.935285697000001, 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.934829849, 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.904 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.908 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.919810583, 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.912 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.914744561999999, 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 24.820774461999999, 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.917 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:03:06.921 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 7.0111627270000003, 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:06.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:06.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:06.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.926 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:06.926 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:06.926 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:06.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:06.928 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:06.926+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:07.028 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:07.028+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:07.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:07.129 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:07.128+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:07.225 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:07.225 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:07.226 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:07.226 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:07.226 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:07.230 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:07.230+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:07.239 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:07.331 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:07.332+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:07.408 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.860222139999998, 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:03:07.409 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:03:07.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:03:07.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:03:07.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:03:07.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.237318383000002, 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.420 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.420 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:03:07.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.420 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:03:07.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:03:07.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141784737000002, 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:03:07.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:03:07.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:07.434 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141730531, 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.441 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141693660999998, 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.442 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:07.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:03:07.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:03:07.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141532116, 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:03:07.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:03:07.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:03:07.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:07.458 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141478776, 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:03:07.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:03:07.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141420857, 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.466 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:03:07.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:03:07.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141291107999997, 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.473 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:03:07.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:03:07.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 47.141252651000002, 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.481 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:03:07.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.914129527999997, 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.487 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:03:07.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.492 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913922083000003, 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:03:07.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913808197000002, 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:03:07.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:03:07.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:03:07.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:03:07.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913639791999998, 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:03:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.510 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913602232000002, 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.511 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.516 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913548816000002, 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:07.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913423526999999, 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.522 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:03:07.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913383383999999, 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.528 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.533 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913331001000003, 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:03:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 46.913146603000001, 2024-05-10T14:03:07.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:03:07.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:03:07.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:07.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:07.545 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:07.547 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:07.546+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:07.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:07.647 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:07.648+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:07.692 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:07.693 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:07.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:07.748 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:07.750+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:07.849 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:07.848+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:07.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:03:07.883 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:07.883 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:07.883 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:07.883 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:07.883 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:07.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:07.988 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:07.988+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:08.051 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:08.050+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:08.066 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.895109669, 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.893575984000002, 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.559525671999999, 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:40 5.3 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.319955336, 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002628563, 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744477+0000", 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744479+0000", 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2469999999999998e-06 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744509+0000", 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0043e-05 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744542+0000", 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2329000000000002e-05 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744567+0000", 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.48e-05 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744643+0000", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.64e-05 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744742+0000", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9531000000000006e-05 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.744874+0000", 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013199500000000001 2024-05-10T14:03:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.745910+0000", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001035567 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.746998+0000", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001087502 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747058+0000", 2024-05-10T14:03:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0822000000000001e-05 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.747106+0000", 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7327000000000003e-05 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.317402566999998, 2024-05-10T14:03:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.314147808000001, 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.355200124, 2024-05-10T14:03:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.337360938, 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.300902736000001, 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.287058106, 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.257832095000001, 2024-05-10T14:03:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.240404952999999, 2024-05-10T14:03:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.186246485000002, 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.973355551000001, 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.968967569, 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.795462697000001, 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.742687911000001, 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.737928327999999, 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:08.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.170 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.557576022999999, 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:08.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:08.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.553772226, 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:08.176 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:08.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:08.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:08.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:08.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.182 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:08.186 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:08.182+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:08.186 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:08.285 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:08.284+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:08.365 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:08.365 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:08.366 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:08.366 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:08.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:08.423 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:08.424+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:08.487 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:08.486+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:08.560 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:08.560 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:08.560 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:08.561 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:08.561 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:08.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:08.588 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:08.590+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:08.690 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:08.690+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.029717333000001, 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.983648280000001, 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.978137933999999, 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.867879106, 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.991653023000001, 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.969090139999999, 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.942762111, 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.925165552999999, 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.892826975999998, 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.858750312000002, 2024-05-10T14:03:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.848193901999998, 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.567231137, 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.562941958, 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.521494849, 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.458183538, 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.423254029999999, 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.401789173000001, 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:08.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:08.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:08.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.813 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.337255487, 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:08.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:08.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:08.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.175564434999998, 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:08.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.069940943999999, 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:08.825 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:08.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:08.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:08.831 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:08.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:08.833 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:08.832+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:08.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:08.979 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:08.980+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:09.014 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:09.014 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:09.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:09.034 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:09.034+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:09.072 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:09.073 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:09.090 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:09.107 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:09.125 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:09.125 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:09.134 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:09.132+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:09.146 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:09.146 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:09.167 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:09.167 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:09.170 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:03:09.192 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.192 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:09.193 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:09.194 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:09.207 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:09.215 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:09.215 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:09.279 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:09.280+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:09.331 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.331 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:09.336 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:09.336+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:09.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:09.438 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:09.438+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:09.515 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.515 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:09.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:09.575 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:09.576+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:09.640 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:09.638+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:09.652 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.653 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:09.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:09.755 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:09.756+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:09.840 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.841 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:09.841 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:09.840+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:09.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:09.942 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:09.940+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:09.987 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:09.987 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:10.045 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:10.046+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:10.118 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.118 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:10.177 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:10.178+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:10.246 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:10.246+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:10.298 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.298 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:10.346 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:10.344+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:10.448 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:10.446+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:10.479 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.479 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:10.585 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:10.586+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:10.649 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:10.650+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:10.664 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.664 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:10.750 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:10.748+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:10.842 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.842 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.850 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:10.852+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:10.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:10.952 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:10.952+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:10.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:11.055 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:11.056+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:11.116 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:11.116 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:11.130 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:11.177 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:11.178+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:11.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:03:11.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:11.259 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:11.258+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:11.267 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:11.359 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:11.358+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:11.398 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:11.398 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:11.415 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:11.415 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:11.432 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:11.434 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:11.434 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:11.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:11.449 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:11.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:11.467 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:11.467 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:11.485 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:11.485 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:11.493 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:11.494+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:11.503 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:11.503 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:11.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:11.520 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:11.564 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:11.564+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:11.614 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:11.614 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:11.614 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:11.614 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:11.614 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:11.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:11.667 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:11.668+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:11.751 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 52.204788295, 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.752 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:03:11.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:03:11.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:03:11.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:03:11.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.581884537999997, 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:03:11.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:03:11.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:03:11.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.767 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.486350891999997, 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:03:11.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:03:11.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.486296686000003, 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.775 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:03:11.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.780 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.486259816, 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.781 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.486098271000003, 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:03:11.788 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:03:11.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:03:11.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:03:11.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.486044931000002, 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.795 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:03:11.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.800 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.485987012000002, 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:03:11.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:03:11.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:03:11.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:03:11.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.806 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.485857263, 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:03:11.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:03:11.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:03:11.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.485818805999997, 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:03:11.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258695682999999, 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:03:11.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.823 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258488237999998, 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:03:11.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258374351999997, 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:03:11.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258205947, 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.835 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:03:11.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:03:11.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258168386999998, 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:03:11.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:03:11.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:11.846 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.258114970999998, 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:11.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:03:11.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:03:11.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.257989682000002, 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:03:11.852 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:03:11.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.257949539000002, 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:03:11.858 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:03:11.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:03:11.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:03:11.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.257897155999999, 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:03:11.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:03:11.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:03:11.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:03:11.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:03:11.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:03:11.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 51.257712757999997, 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:03:11.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:03:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.877 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:11.877 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:11.877 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:11.878 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:11.879 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:11.876+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:11.979 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:11.980+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:12.014 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:12.015 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:12.015 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:12.015 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:12.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:12.081 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:12.082+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:12.182 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:12.182+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:03:12.214 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:12.215 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:12.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:12.315 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:12.316+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:12.383 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:12.384+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.228395853000002, 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:12.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.404 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.226862167999997, 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:12.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:12.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.892811856000002, 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:12.409 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:12.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:12.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.650688750999997, 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:12.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:12.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.647433992000003, 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:12.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:12.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.688486308000002, 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:12.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:12.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:12.431 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.670647121999998, 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:12.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.63418892, 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:12.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:12.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:12.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:12.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.620344289999998, 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:12.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.591118279, 2024-05-10T14:03:12.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:12.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:12.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.573691137000001, 2024-05-10T14:03:12.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.519532669, 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.306641734999999, 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:12.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.302253752999999, 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:12.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.477 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.128748881, 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:12.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.075974094999999, 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.071214512000001, 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.497 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.890862207000001, 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:12.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:12.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.887058410000002, 2024-05-10T14:03:12.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:12.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:12.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:12.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.52759360200000005, 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:12.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:12.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:12.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:12.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:12.515 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:12.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:12.516 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:12.514+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:12.617 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:12.618+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:12.700 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:12.700 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:12.700 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:12.700 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:12.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:12.718 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:12.716+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:12.819 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:12.820+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:12.840 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:12.841 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:12.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:12.943 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:12.944+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:13.020 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:13.020+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:13.032 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.350156073999997, 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.304087021000001, 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.298576675, 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.188317847, 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.312091764000002, 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:13.059 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.289528880999999, 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:13.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:13.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.263200852000001, 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.065 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:13.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.245604294, 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:13.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:13.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.213265716999999, 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:13.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:13.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:13.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.179189053000002, 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:13.082 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:13.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:13.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.168632642999999, 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.887669878000001, 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:13.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:13.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:13.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.099 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.883380699, 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:13.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:13.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:13.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.84193359, 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:13.105 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.110 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.778622279, 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.111 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:13.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:13.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.743692770999999, 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:13.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:13.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:13.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.722227914000001, 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:13.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:13.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.657694228, 2024-05-10T14:03:13.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:13.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:13.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:13.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.496003175999999, 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:13.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.139 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.390379684999999, 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.140 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:13.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:13.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.146 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:13.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:13.148 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:13.146+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:13.248 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:13.246+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:13.328 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:13.328 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:13.328 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:13.328 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:13.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:13.387 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:13.388+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:13.449 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:13.450+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:13.483 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:13.483 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:13.483 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:13.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:13.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:13.551 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:13.550+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:13.652 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:13.650+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.925555422000002, 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.836580337000001, 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.823312944000001, 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.817717502000001, 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.499704217000001, 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.495650951000002, 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.458026054000001, 2024-05-10T14:03:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.326853457999999, 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.322845135000001, 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.269930823999999, 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.26618869, 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026850530000000002, 2024-05-10T14:03:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397700+0000", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.883e-06 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397712+0000", 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.164e-05 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397738+0000", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6270000000000001e-05 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397751+0000", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2617e-05 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397864+0000", 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113202 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398009+0000", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014550899999999999 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398280+0000", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027113499999999998 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.399286+0000", 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005295 2024-05-10T14:03:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400174+0000", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088858000000000003 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400266+0000", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1203000000000001e-05 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400383+0000", 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117719 2024-05-10T14:03:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.256321149000001, 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.252232636999999, 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.205896404000001, 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.202135754, 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.114841474999999, 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.111001850000001, 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:13.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:13.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.016871854000001, 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:13.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.00271274, 2024-05-10T14:03:13.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:13.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:13.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:13.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:13.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.998911442000001, 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:13.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:13.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:13.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:13.784 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:13.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:13.787 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:13.787 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:13.787 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:13.787 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:13.788 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:13.788 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:13.788 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:13.789 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:13.789 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:13.789 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:13.789 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:13.790 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:13.791 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:13.786+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:13.804 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:13.826 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:13.826 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:13.887 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:13.886+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:13.922 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:13.922 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:13.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:13.988 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:13.986+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:14.061 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.061 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:14.121 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:14.120+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:14.190 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:14.188+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:14.214 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.215 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.216 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:03:14.230 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:14.291 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:14.290+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:14.361 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.361 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.375 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:14.417 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:14.418+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:14.494 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:14.494+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:14.534 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.534 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:14.595 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:14.594+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:14.696 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:14.694+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:14.719 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.719 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:14.825 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:14.826+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:14.898 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:14.896+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:14.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:14.999 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:15.000+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:15.082 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.082 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.096 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:15.100 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:15.100+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:15.201 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:15.200+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:15.206 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:03:15.219 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.219 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:15.302 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:15.300+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:15.352 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.352 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:15.403 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:15.404+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:15.482 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.483 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.496 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:15.545 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:15.546+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:15.605 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:15.604+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:15.620 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.620 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.638 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:15.725 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:15.726+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:15.806 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.806 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.807 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:15.806+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:15.820 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:15.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:15.908 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:15.908+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:15.983 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:15.983 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:15.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:16.003 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:16.003 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:16.009 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:16.008+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:16.020 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:16.020 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:16.037 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:16.037 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:16.053 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:16.054 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:16.071 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:16.071 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:16.092 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:16.092 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:16.109 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:16.108+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:16.113 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:16.115 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:16.116 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:16.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:16.130 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:16.131 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:16.210 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:16.210+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:16.254 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:16.254 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:16.254 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:16.254 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:16.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:16.311 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:16.310+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:16.406 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:16.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:16.406 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:16.406 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:16.406 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:16.411 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:16.410+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:16.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:16.512 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:16.510+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.380309134000001, 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.378775449000003, 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.044725137, 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.802602032000003, 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.799347273000002, 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.840399589, 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.822560402999997, 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.786102200999999, 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.772257570999997, 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.743031559999999, 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.725604418000003, 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.671445949999999, 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.458555015999998, 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.454167034000001, 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.280662161999999, 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.227887375999998, 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.223127793000003, 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.042775487999997, 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.038971691, 2024-05-10T14:03:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:16.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:16.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.6795068830000002, 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:16.657 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:16.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:16.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:16.662 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:16.663 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:16.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:16.665 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:16.666+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:16.765 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:16.764+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:16.802 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:16.803 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:16.803 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:16.803 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:16.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:16.866 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:16.866+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:16.967 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:16.966+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:16.995 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:16.995 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:16.995 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:16.995 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:16.995 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:17.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:17.068 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:17.068+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.454140883999997, 2024-05-10T14:03:17.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.408071831000001, 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:17.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:17.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.402561485, 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:17.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.292302657, 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:17.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.416076574000002, 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.393513691000003, 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.367185661999997, 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.349589104000003, 2024-05-10T14:03:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.317250526999999, 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.283173863000002, 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.272617453000002, 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.991654687999997, 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.987365509, 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.945918399999996, 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.882607088999997, 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.847677580999999, 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.826212724000001, 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.761679037999997, 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:17.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.599987986000002, 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.494364494999999, 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.251 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:17.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:03:17.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:17.253 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:17.252+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:17.353 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:17.352+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:17.432 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:17.432 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:17.432 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:17.432 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:17.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:17.495 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:17.496+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:17.556 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:17.556+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:17.616 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:17.616 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:17.616 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:17.617 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:17.617 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:17.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:17.657 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:17.658+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:17.758 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:17.758+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.062692487, 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.973717401999998, 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.960450008999999, 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.954854566999998, 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.636841281999999, 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.826 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:17.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:17.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:17.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.632788015999999, 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:17.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:17.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.837 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.595163118999999, 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.463990523, 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.846 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.847 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:17.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:17.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:17.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.459982199999999, 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.855 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:17.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.860 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.407067888999997, 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:17.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.866 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.403325754999997, 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026850530000000002, 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397700+0000", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.883e-06 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397712+0000", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.164e-05 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397738+0000", 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6270000000000001e-05 2024-05-10T14:03:17.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397751+0000", 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2617e-05 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397864+0000", 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113202 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398009+0000", 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014550899999999999 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398280+0000", 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027113499999999998 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.399286+0000", 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005295 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400174+0000", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088858000000000003 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400266+0000", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1203000000000001e-05 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400383+0000", 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117719 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.393458213999999, 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.873 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:17.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:17.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.878 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.389369702000003, 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.879 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:17.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:17.884 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.343033468999998, 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.885 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:17.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.891 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.339272819000001, 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.251978540000003, 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:17.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.905 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.248138914999998, 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:17.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:17.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:17.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:17.912 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.154008918999999, 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.139849804999997, 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.136048506999998, 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:17.931 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:17.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:17.933 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:17.932+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:18.033 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:18.032+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:18.114 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:18.114 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:18.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:18.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:18.172 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:18.172+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:18.229 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:03:18.235 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:18.234+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:18.302 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:18.302 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:18.302 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:18.302 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:18.302 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:18.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:18.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:18.333 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:18.336 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:18.336+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:18.354 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:18.371 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:18.371 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:18.404 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:18.405 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:18.428 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:18.429 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:18.441 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:18.438+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:18.453 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:18.454 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:18.457 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:18.457 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:18.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:18.474 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:18.495 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:18.496 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:18.537 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:18.538+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:18.606 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:18.606 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:18.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:18.665 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:18.666+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:18.739 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:18.738+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:18.785 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:18.785 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:18.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:18.841 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:18.842+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:18.941 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:18.940+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:18.966 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:18.966 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:18.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:19.043 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:19.042+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:19.098 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.098 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:19.153 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:19.154+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:19.246 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:19.246+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:19.279 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.279 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:19.381 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:19.382+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:19.448 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:19.446+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:19.460 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.460 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:19.561 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:19.562+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:19.642 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.642 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.649 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:19.648+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:19.656 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:19.751 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:19.752+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:19.815 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.815 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.829 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:19.852 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:19.852+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:19.946 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:19.947 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:19.953 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:19.952+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:19.960 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:20.054 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:20.054+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:20.081 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:20.081 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:20.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:20.154 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:20.152+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:20.254 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:03:20.255 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:20.254+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:20.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:20.357 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:20.356+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:20.443 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:20.443 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:20.456 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:20.456+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:20.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:20.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:20.559 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:20.560+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:20.582 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:20.582 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:20.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:20.672 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:20.672 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:20.673 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:20.672+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:20.692 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:20.692 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:20.710 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:20.711 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:20.730 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:20.730 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:20.759 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:20.760+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:20.767 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:20.767 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:20.777 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:20.778 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:20.788 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:20.789 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:20.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:20.814 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:20.814 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:20.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:20.836 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:20.860 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:20.858+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.778190582999997, 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.776656897999999, 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.442606585999997, 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.200483480999999, 2024-05-10T14:03:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.197228721999998, 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.238281037999997, 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.220441852, 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.183983650000002, 2024-05-10T14:03:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.170139020000001, 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.140913009000002, 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.123485866999999, 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.069327399000002, 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.856436465000002, 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.852048482999997, 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.678543611000002, 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.625768825000002, 2024-05-10T14:03:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.621009242, 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.440656937, 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.436853139999997, 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0773883319999999, 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.095 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:21.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:21.097 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:21.096+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:21.197 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:21.198+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:03:21.276 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:21.277 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:21.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:21.298 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:21.298+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:21.399 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:21.400+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:21.458 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:21.458 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:21.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:21.500 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:21.498+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:21.601 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:21.600+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.964866035, 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.918796982000003, 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.913286636000002, 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.803027808000003, 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.926801724999997, 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.904238841999998, 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.877910813, 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.860314254999999, 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.827975678000001, 2024-05-10T14:03:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.793899013999997, 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.783342603999998, 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.502379839, 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.498090660000003, 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.456643550999999, 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.393332239999999, 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.358402732000002, 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.336937874999997, 2024-05-10T14:03:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.272404189, 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.110713136999998, 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.005089646000002, 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:21.769 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:21.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:21.771 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:21.770+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:21.871 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:21.870+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:21.953 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:21.953 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:21.953 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:21.954 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:21.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:21.972 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:21.970+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:22.072 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:22.072+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:22.093 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:22.094 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:22.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:22.173 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:22.174+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:22.274 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:22.272+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.550169953000001, 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:22.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:22.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.461194868, 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:22.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:22.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:22.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.447927475, 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:22.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.442332033, 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:22.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:22.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.315 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.124318748, 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.120265482000001, 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:22.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:22.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:22.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.082640585, 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:22.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:22.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.951467989000001, 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:22.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.947459666, 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.894545354999998, 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:22.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.349 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.890803220999999, 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026850530000000002, 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397700+0000", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.883e-06 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397712+0000", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.164e-05 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397738+0000", 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6270000000000001e-05 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397751+0000", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2617e-05 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397864+0000", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113202 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398009+0000", 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014550899999999999 2024-05-10T14:03:22.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398280+0000", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027113499999999998 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.399286+0000", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005295 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400174+0000", 2024-05-10T14:03:22.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088858000000000003 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400266+0000", 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1203000000000001e-05 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400383+0000", 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117719 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.88093568, 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:22.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:22.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:22.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.876847167999998, 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:22.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.830510935, 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.826750285000003, 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:22.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:22.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.739456005999998, 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:22.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:22.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.735616381, 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:22.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:22.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:22.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:22.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.641486385, 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:22.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.627327270999999, 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.623525973, 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:22.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:22.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.408 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:22.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:22.409 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:22.408+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:22.510 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:22.510+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:22.594 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:22.594 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:22.594 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:22.594 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:22.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:22.611 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:22.612+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:22.712 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:22.710+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:22.745 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:22.746 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:22.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:22.813 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:22.812+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:22.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:22.893 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.149530421000001, 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:22.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.149437949999999, 2024-05-10T14:03:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:22.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.179193091000002, 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:22.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:22.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.136950970000001, 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:22.911 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:22.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:22.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.097651503999998, 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.917 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:22.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:22.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.090647087999997, 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:22.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.083041305999998, 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.929 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:22.934 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.025765299, 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.935 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:22.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:22.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:22.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.014647723000003, 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:22.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:22.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.889808193999997, 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:22.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.794153033000001, 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:22.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:22.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.790014761000002, 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.757263037999998, 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.963 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.968 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.592580839, 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:22.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:22.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.535374130999998, 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.975 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:22.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:22.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.393197424, 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:22.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:22.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:22.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.986 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.372511797999998, 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:22.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.992 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.365955657999997, 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.281011190000001, 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:22.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:22.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:23.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:23.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.274088351000003, 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:23.004 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:23.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:23.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:23.012 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:23.012 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:23.012 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:23.010+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:23.018 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:23.036 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:23.053 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:23.053 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:23.070 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:23.071 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:23.089 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:23.089 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:23.107 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:23.108 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:23.111 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:23.110+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:23.126 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:23.126 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:23.145 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.145 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:23.212 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:23.212+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:23.258 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:03:23.313 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:23.314+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:23.326 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.327 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:23.414 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:23.412+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:23.508 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.508 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.515 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:23.516+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:23.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:23.616 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:23.616+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:23.645 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.645 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:23.717 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:23.716+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:23.782 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.783 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:23.841 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:23.842+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:23.919 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:23.920+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:23.920 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:23.920 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:23.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:24.020 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:24.020+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:24.098 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.099 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:24.157 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:24.158+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:24.222 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:24.222+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:24.235 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.235 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:03:24.327 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:24.328+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:24.415 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.415 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.424 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:24.424+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:24.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:24.524 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:24.524+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:24.546 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.546 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.561 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:24.625 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:24.624+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:24.679 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.679 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:24.726 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:24.724+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:24.803 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.803 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:24.863 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:24.864+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:24.928 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:24.926+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:24.961 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:24.961 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:24.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:25.028 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:25.026+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:25.130 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:25.130+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:25.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:25.151 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:25.151 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:25.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:25.255 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:25.256+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:25.313 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:25.331 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:25.330+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:25.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:25.350 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.181416753999997, 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:25.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:25.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.179883068999999, 2024-05-10T14:03:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:25.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:25.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.845832756999997, 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:25.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.603709651999999, 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:25.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.600454892999998, 2024-05-10T14:03:25.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:25.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.641507208999997, 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:25.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:25.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:25.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:25.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.623668023, 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:25.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.587209821000002, 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:25.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:25.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:25.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.573365191000001, 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:25.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:25.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.406 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.544139180000002, 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:25.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.526712037999999, 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:25.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:25.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:25.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:25.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.472553570000002, 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:25.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:25.426 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.259662636000002, 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:25.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:25.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.255274653999997, 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:25.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:25.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:25.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.081769782000002, 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:25.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.028994996000002, 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:25.447 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:25.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:25.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.024235413, 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:25.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:25.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.843883108, 2024-05-10T14:03:25.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:25.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.840079310999997, 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:25.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:25.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:25.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.480614503, 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:25.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:25.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.482 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:25.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:25.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:25.484 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:25.485 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:25.485 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:25.485 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:25.486 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:25.486 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:25.486 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:25.487 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:25.487 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:25.487 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:25.484+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:25.500 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:25.500 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:25.584 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:25.582+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:25.638 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:25.638 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:25.638 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:25.639 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:25.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:25.703 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:25.704+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:25.782 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:25.782 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:25.786 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:25.786+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:25.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:25.887 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:25.888+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.297545227999997, 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:25.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:25.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.251476175000001, 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.984 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.245965828999999, 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:25.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:25.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.135707001, 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:25.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.259480918000001, 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:25.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.004 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.236918035000002, 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:26.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.210590005999997, 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:26.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:26.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:26.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.192993448000003, 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:26.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:26.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.160654870999998, 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.024 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:26.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:26.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:26.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:26.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.126578207000001, 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.116021797000002, 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:26.036 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:26.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:26.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:26.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.835059031999997, 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:26.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.830769853, 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:26.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.789322744000003, 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:26.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:26.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.726011432999996, 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:26.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:26.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.691081924999999, 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:26.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:26.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.669617068000001, 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.072 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:26.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:26.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.077 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.605083381999997, 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:26.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:26.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:26.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.443392330000002, 2024-05-10T14:03:26.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:26.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.337768838999999, 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:26.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:26.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.095 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:26.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:26.097 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:26.094+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:26.198 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:26.198+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:26.277 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:26.278 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:26.278 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:26.278 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:26.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:03:26.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:26.299 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:26.298+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:26.400 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:26.398+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:26.463 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:26.463 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:26.463 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:26.463 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:26.463 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:26.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:26.523 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:26.524+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.858466479999997, 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.769491395000003, 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.756224002000003, 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.750628560000003, 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.432615275000003, 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.428562008999997, 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.390937112000003, 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.259764515999997, 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.255756193000003, 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.202841882000001, 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.199099748000002, 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026850530000000002, 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-05-10T14:03:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397700+0000", 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.883e-06 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397712+0000", 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.164e-05 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397738+0000", 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6270000000000001e-05 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397751+0000", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2617e-05 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397864+0000", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113202 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398009+0000", 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014550899999999999 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398280+0000", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027113499999999998 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.399286+0000", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005295 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400174+0000", 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088858000000000003 2024-05-10T14:03:26.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400266+0000", 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1203000000000001e-05 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400383+0000", 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117719 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.189232207000003, 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.185143695000001, 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.138807462000003, 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.135046811999999, 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:26.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:26.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:26.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.047752533000001, 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:26.685 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:26.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:26.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:26.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.043912908000003, 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:26.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:26.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.949782912000003, 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.697 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:26.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:26.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:26.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.935623798000002, 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:26.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:26.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.931822500000003, 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:26.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:26.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:26.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:26.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:26.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:26.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:26.714 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:26.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:26.716 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:26.714+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:26.817 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:26.816+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:26.895 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:26.896 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:26.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:26.955 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:26.956+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:27.018 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:27.016+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:27.081 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:27.081 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:27.081 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:27.081 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:27.082 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:27.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:27.119 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:27.118+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:27.220 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:27.218+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:27.271 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.526521588000001, 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.526429116999999, 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.556184258000002, 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.513942137000001, 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:27.298 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.474642670999998, 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:27.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:27.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.467638254999997, 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.460032472999998, 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:27.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:27.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.402756466, 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.315 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:27.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:27.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.391638890000003, 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.325 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.266799360999997, 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:27.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:27.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.171144200000001, 2024-05-10T14:03:27.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:27.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:27.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:27.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:27.337 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.167005928000002, 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:27.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:27.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:27.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 45.134254204999998, 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.343 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:27.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:27.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.348 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.969572006, 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:27.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:27.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:27.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:27.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.912365297999997, 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.359 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.770188591, 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:27.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:27.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.749502964999998, 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:27.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.742946824999997, 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:27.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:27.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.376 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.658002357000001, 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:27.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.651079518000003, 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:27.382 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:27.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:27.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:27.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:27.388 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:27.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:27.391 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:27.388+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:27.490 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:27.490+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:27.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:27.523 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:27.523 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:27.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:27.625 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:27.626+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:27.672 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:27.673 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:27.689 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:27.689 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:27.691 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:27.692+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:27.703 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:27.704 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:27.704 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:27.704 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:27.704 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:27.706 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:27.706 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:27.718 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:27.724 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:27.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:27.746 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:27.764 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:03:27.764 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:03:27.782 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:27.782 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:27.793 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:27.792+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:27.801 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:27.801 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:27.882 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:27.882 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:27.894 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:27.892+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:27.896 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:27.995 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:03:27.994+0000 7f7e76f57640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25264) UID: 0 2024-05-10T14:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:03:28.096 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:28.096+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:28.197 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:28.194+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:28.198 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.198 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:03:28.298 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:28.296+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:28.376 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.377 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:28.399 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:28.400+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:28.500 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:28.500+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:28.512 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.512 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:28.601 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:28.600+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:28.642 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.642 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.656 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:28.702 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:28.702+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:28.782 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.782 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:28.803 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:28.804+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:28.904 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:28.904+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:28.956 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:28.956 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:28.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:29.005 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:29.004+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:29.088 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.088 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:29.106 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:29.104+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:29.207 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:29.208+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:29.219 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.219 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:29.308 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:29.306+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:29.369 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.369 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:29.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:03:29.431 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:29.432+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:29.444 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T14:03:29.444 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:03:29.445 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T14:03:29.445 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T14:03:29.445 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:03:29.509 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:29.510+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:29.513 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.514 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.525 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T14:03:29.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:29.610 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:29.608+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:29.668 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:29.711 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:29.710+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:29.811 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:29.810+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:29.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:29.873 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:29.874 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:29.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:29.935 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:29.936+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:29.973 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:29.991 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:30.007 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:30.008 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:30.019 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:30.018+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:30.025 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:30.025 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:30.039 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:30.039 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:30.045 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:30.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:30.143 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:30.144+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:30.221 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:30.220+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.564842198999997, 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.518773146000001, 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.5132628, 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:30.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.403003972, 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:30.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:30.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:30.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:30.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.526777889000002, 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:30.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:30.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.271 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.504215006000003, 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:30.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:30.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.477886976999997, 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.460290419000003, 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:30.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.427951841999999, 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:30.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.294 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.393875178000002, 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.383318768000002, 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:30.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.102356002999997, 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:30.311 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.098066824, 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:30.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:30.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.056619714999997, 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:30.317 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:30.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:30.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:30.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.993308403999997, 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028621060000000001, 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 781 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251834+0000", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251836+0000", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251845+0000", 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5799999999999998e-06 2024-05-10T14:03:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251870+0000", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.251892+0000", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1562000000000001e-05 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252012+0000", 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119818 2024-05-10T14:03:30.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252242+0000", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023014500000000001 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.252580+0000", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033810099999999999 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.253809+0000", 2024-05-10T14:03:30.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012296799999999999 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254468+0000", 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065850399999999997 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254595+0000", 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127389 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.254696+0000", 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100451 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.958378895999999, 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:30.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:30.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.936914039000001, 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:30.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.872380352999997, 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.346 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.710689301000002, 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028614909999999999, 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 901 2024-05-10T14:03:30.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534453+0000", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534456+0000", 2024-05-10T14:03:30.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2100000000000002e-06 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534468+0000", 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2422999999999999e-05 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534501+0000", 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2563e-05 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534517+0000", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5605999999999999e-05 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534629+0000", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011267 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.534861+0000", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231621 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.535197+0000", 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033565400000000001 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.536338+0000", 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001141408 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537099+0000", 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000761354 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537195+0000", 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5209000000000003e-05 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.537314+0000", 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.352 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.605065809999999, 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:30.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.358 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:30.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-10T14:03:30.360 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:03:30.361 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:30.360+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:30.460 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:30.460+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7.f8c99aee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.23482964200000001, 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.23485409500000001, 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "waiting for peered", 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 1 2024-05-10T14:03:30.538 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:30.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:30.562 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:30.561+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:30.662 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:30.660+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:30.740 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:30.740 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:30.740 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:30.740 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:30.740 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:30.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:30.799 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:30.800+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:30.865 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:30.861+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:30.939 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.191820542999999, 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:30.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:30.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.102845457999997, 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:30.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.089578064999998, 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:30.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:30.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:30.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:30.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.083982622999997, 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:30.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:30.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:30.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.765969337999998, 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:30.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:30.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:30.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:30.969 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.761916071999998, 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:30.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:30.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.724291174999998, 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:30.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:30.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.593118578999999, 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:30.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:30.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.589110255999998, 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:30.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:30.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:30.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.536195945000003, 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:30.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:30.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:30.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:30.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:30.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.532453811000003, 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026850530000000002, 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397698+0000", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397700+0000", 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.883e-06 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397712+0000", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.164e-05 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397738+0000", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6270000000000001e-05 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397751+0000", 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2617e-05 2024-05-10T14:03:31.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.397864+0000", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113202 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398009+0000", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014550899999999999 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.398280+0000", 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027113499999999998 2024-05-10T14:03:31.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.399286+0000", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005295 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400174+0000", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088858000000000003 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400266+0000", 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1203000000000001e-05 2024-05-10T14:03:31.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.400383+0000", 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117719 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.522586269999998, 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:31.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.518497758000002, 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:31.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:31.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.472161524999997, 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:31.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:31.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:31.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:31.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.468400875, 2024-05-10T14:03:31.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:31.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:31.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:31.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.381106596000002, 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:31.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:31.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.377266970999997, 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:31.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:31.039 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.283136974999998, 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:31.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:31.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.268977861000003, 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.045 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:31.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.265176562999997, 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.056 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:31.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:31.058 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:31.056+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:31.159 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:31.157+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:31.237 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:31.237 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:31.237 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:31.237 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:31.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:31.260 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:31.257+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:31.361 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:31.361+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:31.388 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:31.389 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:31.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:31.462 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:31.460+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.549 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.802944793999998, 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:31.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.558 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.802852323000003, 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.559 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:31.564 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.832607463999999, 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:31.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:31.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:31.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.790365342999998, 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:31.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:31.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.751065877000002, 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:31.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:31.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.744061461000001, 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:31.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:31.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.736455679000002, 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.679179671999997, 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:31.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.668062096, 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:31.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:31.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.543222567000001, 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:31.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.611 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.447567405999997, 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.443429133999999, 2024-05-10T14:03:31.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.410677411000002, 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:31.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.245995211999997, 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:31.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:31.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:31.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.188788504000001, 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:31.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:31.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:31.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.642 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.046611796999997, 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:31.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.025926171000002, 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:31.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:31.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:31.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.019370031000001, 2024-05-10T14:03:31.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.934425562999998, 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:31.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.927502724, 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:31.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:31.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:31.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:31.672 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:31.674 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:31.674 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:31.672+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:31.774 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:31.773+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:31.806 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:31.806 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:31.806 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:31.807 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:31.821 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:31.906 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:31.905+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:31.976 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:31.976+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:31.986 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:31.986 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:31.986 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:31.987 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:31.987 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:32.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:32.093 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:32.093+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 55.481919185000002, 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:03:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.454081017999997, 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:03:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.440322295000001, 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:03:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:03:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:03:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.357418701999997, 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:03:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:03:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:03:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.331080943000003, 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:03:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:03:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.329990891999998, 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:03:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.327103835999999, 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:03:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.324525432999998, 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:03:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.293246136999997, 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:03:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:03:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.241607832, 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:03:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:03:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:03:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:03:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.157461681999997, 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:03:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:03:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:03:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.153416151999998, 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:03:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:03:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.087151171000002, 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:03:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:03:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:03:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:03:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.050065883000002, 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:03:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 50.042933040999998, 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:03:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:03:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 49.841191975000001, 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:03:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 49.685261916999998, 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:03:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:03:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:03:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 49.678231437999997, 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:03:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:03:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 49.580429709999997, 2024-05-10T14:03:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:03:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:03:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:03:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 49.573123316, 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:03:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:03:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:32.300 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:32.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:32.302 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:32.301+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:32.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:03:32.407 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:32.408+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:32.475 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:32.475 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:32.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:32.503 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:32.504+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:32.605 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:32.604+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:32.616 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:32.616 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:32.630 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:32.705 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:32.701+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:32.748 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:32.749 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:32.762 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:32.806 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:32.804+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:32.907 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:32.908+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:32.922 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:32.922 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:32.937 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:33.008 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:33.008+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:33.058 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:33.058 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:33.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:33.117 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:33.117+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:33.190 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:33.191 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:33.204 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:33.245 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:33.245+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:33.311 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:33.312+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:03:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:33.350 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:33.350 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:33.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:33.412 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:33.413+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:33.513 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:33.512+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:33.534 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:33.534 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:33.534 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:33.534 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:33.534 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:33.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:33.614 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:33.613+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:33.716 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:33.713+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.557948078999999, 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:33.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.556414394000001, 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:33.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:33.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.222364081999999, 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.736 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:33.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 54.980240977000001, 2024-05-10T14:03:33.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:33.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 54.976986218, 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:33.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:33.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.018038533999999, 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:33.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:33.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.000199348000002, 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.963741145999997, 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:33.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.949896516000003, 2024-05-10T14:03:33.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:33.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:33.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:33.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:33.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.920670504999997, 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:33.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.903243363000001, 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.849084894999997, 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:33.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:33.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.636193961000004, 2024-05-10T14:03:33.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.631805978999999, 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.458301106999997, 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.405526321000004, 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.400766738000002, 2024-05-10T14:03:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.220414433000002, 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.216610635999999, 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.857145828, 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:33.847 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:33.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:33.849 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:33.848+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:33.949 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:33.949+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:34.033 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:34.033 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:34.033 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:34.033 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:34.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:34.051 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:34.049+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:34.151 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:34.152+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:34.183 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:34.183 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:34.183 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:34.183 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:34.183 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:34.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:34.252 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:34.249+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:34.353 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:34.353+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:34.384 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:34.384 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:34.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 59.702087828000003, 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:34.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.389 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.656018775, 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:34.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.650508428999999, 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:34.394 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:34.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.540249600999999, 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.664023518, 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.641460635000001, 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.615132606000003, 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.597536048000002, 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.565197470999998, 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.531120807000001, 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.520564397000001, 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.239601632000003, 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.235312452999999, 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.193865344000002, 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.095624524999998, 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.074159668, 2024-05-10T14:03:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.009625982000003, 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.742311438999998, 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0808809010000004, 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:03:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:03:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0807526080000001, 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:03:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:03:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:03:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:34.500 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:34.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:34.502 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:34.500+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:34.602 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:34.600+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:34.681 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:34.681 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:34.681 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:34.681 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:34.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:34.739 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:34.740+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:34.804 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:34.804+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:34.875 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:34.875 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:34.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:34.905 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:34.905+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:34.955 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:34.980 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:34.981 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:35.006 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:35.004+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:35.015 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:35.015 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:35.019 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:35.019 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:35.067 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:35.067 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:35.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:35.067 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.328894122000001, 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.068 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:35.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.075 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.075 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:35.075 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.239919037, 2024-05-10T14:03:35.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:35.075 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:35.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:35.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:35.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:35.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.226651644, 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.084 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:35.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.221056202, 2024-05-10T14:03:35.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:35.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:35.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.903042917000001, 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:35.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:35.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.103 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.898989651000001, 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:35.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.861364754, 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:35.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:35.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.730192158000001, 2024-05-10T14:03:35.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:35.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:35.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:35.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.726183835, 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:35.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:35.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:35.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.673269523999998, 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:35.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:35.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:35.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.659659849000001, 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:35.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:35.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.655571336999998, 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:35.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.609235104, 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:35.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:35.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.605474454000003, 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:35.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:35.166 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.518180174999998, 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:35.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.51434055, 2024-05-10T14:03:35.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:35.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:35.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:35.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:35.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.420210554000001, 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:35.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:35.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.406051439999999, 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.184 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.189 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.402250142, 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:35.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:35.195 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7667565359999999, 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:35.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.201 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:35.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:35.203 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:35.204+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:35.303 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:35.304+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:35.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:03:35.394 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:35.394 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:35.404 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:35.405+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:35.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:35.504 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:35.505+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:35.580 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:35.580 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:35.580 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:35.580 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:35.580 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:35.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:35.605 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:35.605+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:35.706 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:35.704+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:35.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.994108785999998, 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.994016315000003, 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:35.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:35.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:35.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 54.023771455999999, 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:35.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.981529334999998, 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.756 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:35.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:35.761 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.942229869000002, 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:35.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:35.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:35.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:35.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.935225453000001, 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.767 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.927619671000002, 2024-05-10T14:03:35.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:35.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.870343664000004, 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:35.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:35.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.859226088, 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:35.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:35.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.734386559000001, 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:35.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:35.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.638731397999997, 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:35.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:35.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.634593125999999, 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:35.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:35.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.601841403000002, 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.437159203999997, 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:35.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:35.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:35.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.379952496000001, 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:35.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.819 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.237775788999997, 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.825 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.217090163000002, 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.210534023000001, 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.831 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:35.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:35.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.125589554999998, 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:35.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.118666716, 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:35.842 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:35.848 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:35.848 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:35.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:35.850 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:35.848+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:35.950 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:35.952+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:35.980 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:35.980 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:35.981 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:35.981 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:35.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:36.052 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:36.052+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:36.117 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:36.118 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:36.118 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:36.118 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:36.118 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:36.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:36.177 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:36.177+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:36.253 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:36.252+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:36.254 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:36.257 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:36.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:36.257 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:36.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.257 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 59.562350518999999, 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.534512352, 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:03:36.266 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.520753628999998, 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.267 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:03:36.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:03:36.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.437850036, 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:03:36.273 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:03:36.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:03:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:03:36.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.411512277, 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.279 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:03:36.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:03:36.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:03:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.284 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.410422226000001, 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:03:36.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.407535170000003, 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.404956767000002, 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:03:36.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:03:36.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:03:36.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.373677471000001, 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.299 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.322039166000003, 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:03:36.304 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:03:36.309 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.237893016000001, 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:03:36.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:03:36.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.233847486000002, 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:03:36.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:03:36.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:36.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:36.321 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.167582504999999, 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.130497216999998, 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:03:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:03:36.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:03:36.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.123364375000001, 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.333 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:03:36.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.338 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.921623308999997, 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.339 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.344 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.765693251000002, 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:03:36.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:03:36.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:03:36.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:03:36.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.758662772000001, 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:03:36.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:03:36.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:03:36.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.660861044000001, 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:03:36.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:03:36.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:03:36.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 53.653554649999997, 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:03:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:03:36.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:03:36.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:36.370 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:03:36.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:36.371 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:36.369+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:36.470 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:36.469+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:36.543 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:36.543 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:36.543 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:36.543 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:36.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:36.572 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:36.572+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:36.672 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:36.672+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:36.728 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:36.729 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:36.729 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:36.729 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:36.729 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:36.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:36.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-10T14:03:36.774 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:36.772+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:36.864 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:36.864 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:36.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.117380957999998, 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:36.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:03:36.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.164775216999999, 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.872 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:03:36.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:03:36.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.137331242999998, 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.879 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.884 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.124073789000001, 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:03:36.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:03:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.121501873, 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:03:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:03:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.024889281999997, 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 55.108774457999999, 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 55.069432851000002, 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:03:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:03:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 55.010462887000003, 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:03:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.994921253999998, 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.994415220999997, 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.990195702999998, 2024-05-10T14:03:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:03:36.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:03:36.926 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.975130704999998, 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:03:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.973744683, 2024-05-10T14:03:36.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:36.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:03:36.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:03:36.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.968803219000002, 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:03:36.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.968347371, 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.940 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.953328104999997, 2024-05-10T14:03:36.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:03:36.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:03:36.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.948262084, 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.952 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 54.854291984, 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:36.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 37.044680249000002, 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:36.957 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:36.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:03:36.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:03:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:36.961 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:36.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:36.963 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:36.964+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:37.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:37.064 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:37.061+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:37.089 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:37.089 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:37.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:37.189 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:37.189+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:37.203 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:37.203 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:37.221 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:37.221 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:37.237 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:37.237 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:37.257 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:37.265 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:37.264+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:37.274 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:37.274 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:37.274 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:37.274 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:37.274 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:37.279 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:37.281 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:37.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:37.300 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:37.303 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:37.304 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:37.366 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:37.364+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:37.457 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:37.458 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:37.467 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:37.465+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:37.471 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:37.568 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:37.568+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:37.615 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:37.615 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:37.630 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:37.669 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:37.669+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:37.770 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:37.768+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:37.818 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:37.818 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:37.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:37.872 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:37.869+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:37.973 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:37.973+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:38.079 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:38.080+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:38.161 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.161 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.175 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:38.173+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:38.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:38.276 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:38.273+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:38.351 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.352 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:38.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:03:38.415 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:38.416+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:38.478 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:38.477+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:38.504 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.505 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:38.579 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:38.577+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:38.648 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.648 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:38.680 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:38.677+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:38.781 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:38.780+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:38.795 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.795 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:38.895 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:38.896+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:38.983 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:38.984+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:38.983 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:38.983 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:38.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:39.083 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:39.084+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:39.168 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:39.168 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:39.182 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:39.223 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:39.224+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:39.285 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:39.281+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:39.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:39.338 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:03:39.376 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:39.376 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:39.386 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:39.385+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:39.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:39.454 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:39.454 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:39.471 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:39.471 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:39.487 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:39.488+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:39.488 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:39.488 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:39.505 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:39.506 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:39.526 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:39.527 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:39.527 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:39.548 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:39.555 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.812489386000003, 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.812396915000001, 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.842152056000003, 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.799909935000002, 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.760610469, 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.753606052999999, 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.746000271, 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.688724264000001, 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.677606687999997, 2024-05-10T14:03:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.552767158999998, 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.457111998000002, 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.452973726000003, 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.420222002999999, 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.255539804000001, 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.198333095999999, 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:39.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:39.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:39.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.652 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:39.652 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.056156389000002, 2024-05-10T14:03:39.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:39.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:39.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.654 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:39.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:39.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:39.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.035470762999999, 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:39.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:39.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:39.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:39.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.028914622999999, 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:39.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.943970155000002, 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:39.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.937047315999997, 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:39.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:39.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:39.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:39.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:39.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:39.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:39.691 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:39.692 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:39.692 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:39.693 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:39.694 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:39.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:39.694 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:39.693+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:39.793 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:39.792+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:39.824 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:39.825 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:39.825 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:39.825 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:39.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:39.894 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:39.893+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:39.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:40.022 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:40.021+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:40.096 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:40.096+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:40.148 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 63.456616322999999, 2024-05-10T14:03:40.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:03:40.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:03:40.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:03:40.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:03:40.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:40.156 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 61.428778156, 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.415019432999998, 2024-05-10T14:03:40.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:03:40.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:03:40.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.170 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.33211584, 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.171 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:03:40.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.305778081, 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:03:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:03:40.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:03:40.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.304688030000001, 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.185 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:03:40.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:03:40.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.192 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.301800974000002, 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.193 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:03:40.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:03:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:03:40.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.299222571000001, 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:40.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:03:40.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.203 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.267943275, 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.204 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:03:40.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.209 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.216304970000003, 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.210 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:03:40.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.132158820000001, 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:03:40.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:03:40.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.128113290000002, 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.222 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:03:40.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:03:40.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.061848308999998, 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.024763020999998, 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:03:40.234 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:03:40.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:03:40.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.017630179000001, 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:03:40.240 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.815889112999997, 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.246 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:03:40.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:03:40.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.251 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.659959055000002, 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:40.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.652928576000001, 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:03:40.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.555126848, 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.264 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:03:40.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 57.547820454000004, 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.269 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:03:40.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:03:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.276 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:40.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:40.278 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:40.276+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:40.378 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:40.376+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:40.408 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:40.408 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:40.408 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:40.408 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:40.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:40.479 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:40.477+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:40.542 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:40.542 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:40.542 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:40.542 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:40.542 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:40.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:40.598 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:40.597+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:40.680 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:40.680+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:40.726 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.979522626999994, 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:40.730 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.026916886000002, 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:03:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.736 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 61.999472912000002, 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.737 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:03:40.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:03:40.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 61.986215457999997, 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.742 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:03:40.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 61.983643542000003, 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:03:40.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 61.887030951, 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.753 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:03:40.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:40.757 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.970916127000002, 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:40.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.761 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.931574519999998, 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:03:40.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:03:40.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.872604555999999, 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:40.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:03:40.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.857062923000001, 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:03:40.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:03:40.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:03:40.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.85655689, 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:03:40.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.852337372000001, 2024-05-10T14:03:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:40.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:03:40.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:03:40.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.837272374000001, 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:40.788 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.835886352000003, 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.830944887999998, 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:03:40.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:03:40.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:03:40.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.830489040000003, 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.815469774, 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.801 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:03:40.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:03:40.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:03:40.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.810403753000003, 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:03:40.805 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:03:40.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.809 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 58.716433653000003, 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 40.906821917999999, 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:40.814 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:03:40.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:40.818 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:40.820 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:40.820 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:40.820+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:40.921 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:40.917+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:40.947 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:40.947 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:40.947 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:40.947 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:40.961 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:41.053 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:41.053+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:41.122 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:41.121+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:41.131 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:41.131 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:41.131 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:41.131 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:41.131 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:41.145 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:41.233 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:41.233+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:41.319 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:41.319 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:41.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.770669017000003, 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:03:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:03:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:03:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.326 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.14776526, 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.327 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:41.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.052231613999993, 2024-05-10T14:03:41.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:03:41.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:03:41.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.052177408000006, 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:03:41.339 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:03:41.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:03:41.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.052140538000003, 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.345 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.350 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.051978993000006, 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:03:41.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.356 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.051925652999998, 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.051867733999998, 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:03:41.362 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:03:41.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:03:41.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.051737985000003, 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.368 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:03:41.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 81.051699528, 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.374 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:41.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:03:41.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:03:41.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.824576405000002, 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.824368960000001, 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.389 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:41.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.394 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.824255074000007, 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:03:41.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.824086668999996, 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:03:41.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:03:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:03:41.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:03:41.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.824049109000001, 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.406 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:03:41.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:03:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:03:41.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.823995693000001, 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.823870404000004, 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.417 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.422 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.823830260999998, 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:03:41.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:03:41.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:03:41.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:03:41.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.823777878000001, 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:03:41.428 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.82359348, 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:03:41.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:41.439 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:41.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:03:41.441 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:41.437+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:41.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:41.541 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:41.540+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:41.571 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:41.571 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:41.571 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:41.571 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:41.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:41.642 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:41.641+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:41.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:41.744 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:41.741+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:41.756 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:41.756 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:41.756 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:41.757 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:41.757 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:41.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:41.817 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:03:41.844 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:41.841+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:41.863 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:41.863 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:41.881 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:41.882 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:41.894 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:41.894 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:41.898 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:41.898 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:41.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:41.916 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:41.916 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:41.936 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:41.937 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:41.937 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:41.945 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:41.944+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:41.957 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:41.978 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:41.978 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:41.981 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:41.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:42.046 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:42.045+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:42.049 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.049 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:42.146 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:42.148+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:42.182 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.182 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:42.287 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:42.288+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:42.348 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:42.348+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:42.359 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.359 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:42.459 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:42.460+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:42.550 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:42.552+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:42.556 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.557 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:42.653 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:42.649+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:42.748 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.749 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.753 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:42.752+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:42.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:42.854 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:42.852+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:42.939 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:42.939 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:42.955 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:42.955 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:42.953+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:43.056 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:43.053+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:43.140 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.140 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:43.157 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:43.156+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:43.258 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:43.257+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:43.330 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.330 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:43.358 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:43.357+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:43.459 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:43.460+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:43.472 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.472 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:43.560 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:43.560+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:43.619 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.619 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:43.677 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:43.677+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:43.749 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.749 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.762 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:43.761+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:43.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:43.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:03:43.863 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:43.861+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:43.931 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:43.931 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:43.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:43.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:43.989 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:43.989+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:44.065 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:44.065+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:44.114 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:44.114 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:44.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:44.156 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:44.157 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:44.166 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:44.164+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:44.195 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:44.218 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:44.219 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:44.250 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:44.250 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:44.267 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:44.265+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:44.292 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:44.293 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:44.293 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:44.293 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:44.293 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:44.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:44.309 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:44.309 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:44.312 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:44.312 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:44.367 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:44.368+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:44.468 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:44.468+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:03:44.473 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 69.727849395000007, 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.477 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.775243653999993, 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:44.478 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:03:44.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:03:44.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:44.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:03:44.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:03:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.74779968, 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:03:44.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:03:44.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:03:44.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.734542226000002, 2024-05-10T14:03:44.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:03:44.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:03:44.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:44.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.731970309999994, 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.496 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:03:44.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.635357718999998, 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:03:44.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:44.506 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.719242895000001, 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:03:44.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.679901288000003, 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:03:44.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:03:44.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:03:44.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.620931323999997, 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:03:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:03:44.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.605389690999999, 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:03:44.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.604883657999999, 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.524 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:03:44.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:03:44.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.600664139999999, 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:03:44.528 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.532 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.585599142, 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:03:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.584213120000001, 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:03:44.537 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:03:44.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.579271656000003, 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:44.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.578815808000002, 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:03:44.546 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:03:44.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.563796541999999, 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:03:44.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.558730521000001, 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.555 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:03:44.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:03:44.559 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 62.464760421000001, 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:03:44.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:03:44.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.563 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 44.655148685999997, 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.564 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:03:44.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:03:44.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:44.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:44.568 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:44.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:44.570 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:44.568+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:44.671 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:44.672+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:44.700 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:44.700 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:44.701 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:03:44.701 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:44.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:44.771 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:44.769+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:44.838 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:44.838 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:03:44.838 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:03:44.838 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:03:44.838 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:44.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:44.893 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:44.893+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:44.973 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:44.973+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 85.466282860999996, 2024-05-10T14:03:45.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:45.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.843379103999993, 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:03:45.022 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:03:45.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:03:45.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:45.028 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747845458, 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:45.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:03:45.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:03:45.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747791251999999, 2024-05-10T14:03:45.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:03:45.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:03:45.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747754381999997, 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.040 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747592836999999, 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:03:45.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:03:45.051 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747539497000005, 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.052 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:03:45.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747481578000006, 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.058 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:03:45.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747351828999996, 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:03:45.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.747313371999994, 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.071 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:45.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.520190248999995, 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:03:45.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:03:45.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519982803999994, 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.083 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:03:45.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:03:45.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519868918, 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.089 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:03:45.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.094 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519700513000004, 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:03:45.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:03:45.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.100 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519662952999994, 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:03:45.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:03:45.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:45.106 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519609536999994, 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:45.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519484247999998, 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:03:45.112 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:03:45.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519444105000005, 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:03:45.118 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:03:45.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:03:45.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:03:45.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519391721999995, 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.124 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.519207324000007, 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:03:45.130 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:03:45.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:03:45.135 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:03:45.137 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:45.138 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:45.136+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:45.178 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:03:45.251 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:45.252+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:45.271 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:45.271 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:45.271 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:45.273 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:45.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:45.340 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:45.341+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:45.441 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:45.440+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:45.460 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:45.460 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:45.460 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:45.460 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:45.460 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:45.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:45.567 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:45.568+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:45.641 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:45.641 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:45.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.471639973999999, 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:45.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:45.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:45.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.470106289, 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.136055976999998, 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.893932871999993, 2024-05-10T14:03:45.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:45.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:45.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:45.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.890678113000007, 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:45.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:45.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:45.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.665 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.931730428999998, 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:45.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:45.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:45.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.913891243000002, 2024-05-10T14:03:45.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:45.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.877433041000003, 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:45.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:45.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.863588411000002, 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:45.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.688 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.834362400000003, 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:45.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:45.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.816935258000001, 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.695 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:45.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:45.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.701 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.762776789999997, 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.549885856000003, 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.708 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:45.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.545497873999999, 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:45.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:45.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:45.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.371993002000004, 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:45.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:45.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.319218216000003, 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.726 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:45.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.731 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.314458633000001, 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.732 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:45.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:45.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.737 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.134106328000001, 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.130302530999998, 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:45.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:45.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.770837723, 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:45.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:45.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:45.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:45.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:45.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:45.754 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:45.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:45.756 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:45.756+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:45.857 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:45.853+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:45.925 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:45.925 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:45.925 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:45.925 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:45.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:45.959 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:45.957+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:46.060 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:46.057+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:46.096 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:46.096 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:46.096 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:46.097 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:46.097 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:46.114 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:46.160 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:46.157+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:46.261 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:46.261+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.608974797000002, 2024-05-10T14:03:46.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.562905744000005, 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:46.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:46.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:46.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.557395397999997, 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:46.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.447136569999998, 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.570910487000006, 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.313 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:46.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:46.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.548347604, 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:46.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:46.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.324 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.522019575000002, 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:46.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:46.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:46.330 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.504423016999993, 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:46.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:46.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.472084440000003, 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:46.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:46.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:46.341 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.438007776000006, 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:46.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.347 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.427451366, 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:46.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:46.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.146488601000001, 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:46.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.142199422000004, 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:46.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:46.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.100752313000001, 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:46.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:46.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 64.002511494000004, 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:46.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.981046636999999, 2024-05-10T14:03:46.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:46.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:46.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:46.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.916512951000001, 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:46.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:46.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.649198407999997, 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:46.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:46.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.987767870000001, 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:03:46.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:03:46.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.987639576999999, 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.411 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:03:46.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:03:46.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:46.416 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:46.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:46.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:46.420 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:46.420+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:46.519 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:46.517+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:46.599 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:46.599 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:46.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:46.620 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:46.617+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:46.622 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:46.622 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:46.655 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:46.686 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:46.686 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:46.718 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:46.720 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:46.720+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:46.751 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:46.752 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:46.752 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:46.785 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:46.790 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:46.790 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:46.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:46.819 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:46.820 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:46.822 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:46.820+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:46.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:46.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:46.922 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:46.924+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:46.930 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:46.930 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:46.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:47.024 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:47.021+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:47.102 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.102 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:47.124 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:47.121+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:47.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:03:47.225 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:47.225+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:47.234 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.234 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.254 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:47.339 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:47.340+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:47.428 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:47.425+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:47.459 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.459 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:47.528 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:47.525+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:47.604 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.604 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:47.629 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:47.628+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:47.730 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:47.728+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:47.786 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.786 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:47.831 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:47.832+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:47.922 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:47.922 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:47.932 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:47.932+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:47.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:48.033 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:48.032+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:48.058 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.058 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:48.133 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:48.132+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:48.196 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.196 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:03:48.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:48.257 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:48.257+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:48.334 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.334 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.335 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:48.336+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:48.348 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:48.436 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:48.433+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:48.514 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.514 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.528 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:48.574 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:48.573+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:48.638 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:48.640+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:48.697 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.697 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.712 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:48.740 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:48.740+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:48.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:48.836 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:48.836 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:48.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:48.871 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:48.872+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:48.942 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:48.940+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:49.011 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:49.011 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:49.027 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:49.027 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:49.042 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:49.042 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:49.042 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:49.042 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:49.043 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:49.044+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:49.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:49.089 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:49.123 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:49.124 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:49.143 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:49.141+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:49.158 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:49.158 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:49.192 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:49.192 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:49.196 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:49.196 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:49.244 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:49.244+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:49.261 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:49.261 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:49.261 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:49.262 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:49.262 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:49.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:49.371 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:49.372+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:49.445 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:49.444+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:49.495 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:49.495 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:49.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:49.495 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.325627126000001, 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:49.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.324093441000002, 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:49.504 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.990043129, 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.747920023999995, 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:49.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:49.514 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.744665264999995, 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:49.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:49.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:49.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:49.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:49.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.785717581, 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:49.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:49.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:49.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.525 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.767878394999997, 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:49.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.731420193000005, 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.531 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:49.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:49.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.717575562999997, 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.688349552000005, 2024-05-10T14:03:49.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.670922410000003, 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.548 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:49.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:49.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.553 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.616763942000006, 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.403873008000005, 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:49.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.399485025999994, 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.225980153999998, 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:49.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:49.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.173205367999998, 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.168445785000003, 2024-05-10T14:03:49.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:49.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.587 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.988093480000003, 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:49.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:49.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.984289683, 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:49.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.624824875000002, 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:49.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:49.606 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:49.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:49.608 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:49.605+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:49.709 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:49.709+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:49.800 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:49.800 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:49.800 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:49.800 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:49.810 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:49.808+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:49.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:49.911 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:49.909+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:50.011 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:50.012+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:50.027 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:50.028 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:50.028 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:50.028 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:50.028 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:50.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:50.135 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:50.136+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:50.213 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:50.212+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:50.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:03:50.264 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.583495733999996, 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.537426680999999, 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.531916335000005, 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.421657507000006, 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.545431424, 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.522868540999994, 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.496540511999996, 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.478943954000002, 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.446605376999997, 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.412528713, 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.401972302999994, 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:50.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:50.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.121009537999996, 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:50.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.116720358999999, 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:50.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.075273249999995, 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.352 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:50.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:50.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:50.358 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.977032430999998, 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:50.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:50.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:50.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.955567574, 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:50.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:50.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.891033887999995, 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.623719344999998, 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:50.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:50.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:50.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.962288807, 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:03:50.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:03:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:50.392 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.962160514000001, 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.393 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:03:50.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:50.399 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:50.400 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:50.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:50.402 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:50.400+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:50.502 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:50.501+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:50.603 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:50.604+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:50.615 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:50.615 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:50.615 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:50.615 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:50.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:50.705 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:50.701+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:50.805 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:50.804+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:50.849 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:50.849 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:50.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:50.907 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:50.905+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:51.008 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:51.009+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:51.083 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:51.083 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:51.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.344574842, 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:51.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.089 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.255599756999999, 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.090 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:51.095 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.242332364000006, 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:51.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:51.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:51.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:51.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.236736922000006, 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:51.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:51.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.918723636999999, 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:51.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:51.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:51.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.914670371, 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:51.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.877045473999999, 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.123 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.745872878, 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:51.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:51.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.741864555000006, 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:51.129 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:51.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:51.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:51.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.688950243999997, 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:51.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.675340568999999, 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:51.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.146 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.671252057000004, 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:51.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:51.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.624915823999999, 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.152 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:51.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.621155173999995, 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:51.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:51.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:51.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:51.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.533860895000004, 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:51.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:51.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:51.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:51.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.530021270000006, 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.174 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.435891273999999, 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.421732160000005, 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.417930862000006, 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:51.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:51.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:51.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:51.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.782437256000001, 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:51.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:51.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:51.198 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:51.196+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:51.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:51.213 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:03:51.299 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:51.300+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:51.400 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:51.397+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:51.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:51.417 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:51.417 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:51.480 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:51.501 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:51.500+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:51.511 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:51.512 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:51.544 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:51.545 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:51.545 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:51.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:51.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:51.587 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:51.587 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:51.602 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:51.604+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:51.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:51.612 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:51.612 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:51.616 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:51.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:51.704 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:51.704+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:51.780 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:51.780 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:51.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:51.843 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:51.844+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:51.906 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:51.905+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:51.931 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:51.931 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:51.945 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:52.006 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:52.004+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:52.107 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:52.108+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:52.114 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.114 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:52.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:52.208 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:52.205+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:52.253 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.253 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:52.267 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:52.310 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:52.309+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:52.410 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:52.409+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:52.435 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.436 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:52.450 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:52.511 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:52.512+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:52.612 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:52.609+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:52.620 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.620 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:52.634 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:52.721 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:52.721+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:52.804 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.804 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:52.813 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:52.812+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:52.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:52.915 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:52.916+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:52.986 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:52.987 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:53.000 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:53.049 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:53.049+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:53.116 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:53.113+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:53.121 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:53.121 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:53.135 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:53.216 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:53.216+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:53.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:03:53.300 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:53.300 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:53.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:53.317 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:53.317+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:53.417 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:53.416+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:53.490 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:53.490 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:53.508 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:53.551 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:53.552+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:53.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:53.619 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:53.617+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:53.721 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:53.717+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:53.722 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:53.722 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:53.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:53.822 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:53.820+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:53.823 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:53.854 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:53.885 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:53.916 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:53.922 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:53.922 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:53.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:53.922 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:53.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.752718857000005, 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.751185172000007, 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:03:53.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:03:53.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.417134860000004, 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.931 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:03:53.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.175011755, 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:03:53.936 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:03:53.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:03:53.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.171756995999999, 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:03:53.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:03:53.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.948 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.212809312000005, 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:53.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:03:53.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.194970126000001, 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:03:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:03:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.158511923999995, 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:03:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.144667294000001, 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:03:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:03:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:03:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.115441282999996, 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:03:53.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:03:53.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.098014140999993, 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:03:53.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:03:53.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.043855672999996, 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:03:53.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.830964738999995, 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:03:53.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:03:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:03:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.826576756999998, 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:03:53.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:53.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:53.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:53.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.653071885000003, 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:03:54.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:03:54.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.600297099000002, 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.595537515999993, 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:03:54.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:03:54.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:03:54.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.415185210999994, 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:03:54.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:03:54.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:03:54.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.411381414000004, 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.051916605999999, 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:03:54.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:03:54.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:03:54.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:54.035 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:53.919+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:54.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:54.036 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:54.037 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:54.037 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:54.037 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:54.037 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:54.037 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:54.038 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:54.039 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:54.039 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:54.079 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:54.079+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:54.141 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:54.137+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:54.228 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:03:54.241 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:54.239+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:54.252 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:54.252 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:54.252 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:54.253 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:54.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:54.355 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:54.355+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:54.443 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:54.443+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:54.480 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:54.481 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:54.481 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:54.481 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:54.481 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:54.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:54.583 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:54.583+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:54.646 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:54.645+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:54.710 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.029822854000003, 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:54.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.983753801000006, 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.978243454999998, 2024-05-10T14:03:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.867984626999998, 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.991758544000007, 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.969195661000001, 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.942867632000002, 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.925271073999994, 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.892932497000004, 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.858855833000007, 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.848299423, 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.567336658000002, 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.563047479000005, 2024-05-10T14:03:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.521600370000002, 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.423359551000004, 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.401894694000006, 2024-05-10T14:03:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.337361008000002, 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.070046465000004, 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.408615927, 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.408487634, 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:54.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:54.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:03:54.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:54.841 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:54.842 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:54.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:54.844 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:54.841+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:54.943 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:54.943+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:55.044 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:55.041+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:55.058 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:55.058 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:55.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:55.163 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:55.163+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:55.246 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:55.245+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:55.288 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:55.289 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:55.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:55.347 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:55.345+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:55.448 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:55.447+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:55.518 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:55.518 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:55.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.779646395, 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.519 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:03:55.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:55.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:03:55.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.690671309999999, 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:55.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:03:55.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:03:55.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.677403917000007, 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:03:55.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:03:55.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.671808475000006, 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:03:55.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:03:55.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:03:55.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.35379519, 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:03:55.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:03:55.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.349741924, 2024-05-10T14:03:55.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.312117026999999, 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.553 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:03:55.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.180944431, 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:03:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.176936108000007, 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:03:55.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.124021796999997, 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:03:55.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:03:55.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.110412122, 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:55.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:03:55.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:03:55.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:03:55.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:55.582 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.106323610000004, 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:03:55.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:03:55.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:55.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.059987376999999, 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:55.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:03:55.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:03:55.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:55.594 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.056226726999995, 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:03:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:03:55.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.968932448000004, 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:03:55.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:03:55.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.965092823000006, 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:03:55.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.870962827, 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:03:55.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:03:55.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.856803713000005, 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:03:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:03:55.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.853002415000006, 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:03:55.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.217508809000002, 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:03:55.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:55.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:55.636 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:55.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:03:55.638 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:55.637+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:55.738 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:55.735+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:55.838 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:55.837+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:55.850 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:55.850 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:55.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:03:55.939 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:55.937+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:56.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:03:56.040 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:56.037+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:56.081 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:56.081 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:56.081 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:56.081 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:56.081 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:56.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:03:56.142 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:56.141+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:56.242 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:56.239+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:56.245 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:56.245 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:56.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:03:56.277 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:56.308 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:56.332 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.588558445999993, 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:03:56.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:03:56.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.588465975000005, 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.618221116000001, 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:03:56.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.575978995, 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.350 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:03:56.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:03:56.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:03:56.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.536679528999997, 2024-05-10T14:03:56.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:03:56.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:03:56.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:03:56.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.529675112999996, 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:03:56.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:03:56.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:03:56.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:03:56.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.522069330999997, 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:03:56.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:03:56.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.464793323999999, 2024-05-10T14:03:56.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:03:56.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.453675747999995, 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.378 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:03:56.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:03:56.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.328836218999996, 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:03:56.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:03:56.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:03:56.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.233181058, 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:56.393 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.229042785999994, 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:03:56.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:03:56.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:03:56.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.196291063000004, 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:03:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:03:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.031608864000006, 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:03:56.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.974402155999996, 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:03:56.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:56.416 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.832225449000006, 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:03:56.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:03:56.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.811539823000004, 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.422 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:03:56.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:03:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.804983683000003, 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.428 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:03:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:03:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:03:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:03:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.720039215, 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:03:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.713116376000002, 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:03:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:03:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:56.444 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:56.445 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:56.446 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:56.447 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:03:56.447 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:56.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:56.449 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:56.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:56.449 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:56.443+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:56.450 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:56.450 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:56.547 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:56.545+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:56.580 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:56.667 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:56.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:03:56.669 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:56.667+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:56.769 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:56.767+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:56.837 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:56.837 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:56.851 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:03:56.870 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:56.871+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:56.969 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:56.970 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:56.971 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:56.971+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:56.982 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:03:57.072 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:57.069+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:57.105 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.106 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:03:57.172 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:57.171+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:57.235 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:03:57.274 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:57.273+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:57.286 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.287 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:03:57.389 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:57.389+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:57.466 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.466 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.475 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:57.475+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:57.480 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:03:57.576 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:57.573+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:57.646 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.647 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.662 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:03:57.678 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:57.675+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:57.779 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:57.779+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:57.830 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.831 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.845 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:03:57.889 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:03:57.889+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:03:57.962 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:57.962 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:57.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:03:58.023 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:58.023+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:58.081 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:58.077+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:58.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:03:58.182 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:58.181+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:58.283 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:58.279+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:58.358 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:58.358 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:58.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:03:58.415 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:58.415+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:58.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:03:58.503 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:58.503+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:58.566 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:03:58.566 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:03:58.585 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:03:58.583+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:03:58.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:03:58.634 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:03:58.634 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:03:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:03:58.652 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:03:58.669 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:03:58.669 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:03:58.685 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:03:58.686 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:03:58.686 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:58.683+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:58.706 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:03:58.706 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:03:58.706 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:03:58.729 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:03:58.729 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:03:58.749 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:03:58.749 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:03:58.754 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:03:58.754 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:03:58.803 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:03:58.803+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:03:58.807 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:58.807 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:58.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:03:58.887 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:58.889+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:58.988 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:58.985+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:59.037 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:59.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:03:59.090 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:03:59.089+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:03:59.190 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:59.191+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:59.230 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.549569093000002, 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:03:59.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:03:59.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:03:59.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.503500040000006, 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.236 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:03:59.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:03:59.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.497989693999997, 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:03:59.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.387730865999998, 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:03:59.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.511504783000007, 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:03:59.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:03:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.4889419, 2024-05-10T14:03:59.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:59.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.462613871000002, 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:03:59.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:03:59.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.445017312999994, 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:03:59.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:03:59.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.412678736000004, 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:03:59.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:03:59.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.281 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.378602072000007, 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:03:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:03:59.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.368045662, 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.289 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:03:59.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:03:59.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.087082897000002, 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:03:59.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.082793718000005, 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:03:59.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:03:59.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:03:59.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.041346609000001, 2024-05-10T14:03:59.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:59.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:03:59.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.313 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.943105790000004, 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:03:59.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:03:59.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:03:59.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.921640933000006, 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:03:59.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:03:59.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.857107247000002, 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:03:59.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:03:59.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.589792704000004, 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:03:59.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:03:59.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:03:59.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.928362165999999, 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:03:59.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:03:59.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:03:59.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.928233873, 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:03:59.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:03:59.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:03:59.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:03:59.351 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:03:59.351 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:59.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:03:59.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:03:59.353 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:59.351+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:59.453 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:59.451+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:59.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-05-10T14:03:59.526 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-05-10T14:03:59.527 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T14:03:59.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T14:03:59.530 INFO:tasks.ceph.osd.5:Started 2024-05-10T14:03:59.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:03:59.553 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:59.551+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:03:59.569 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:59.569 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:59.569 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:03:59.569 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:59.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:03:59.653 INFO:teuthology.orchestra.run.smithi130.stderr:no valid command found; 10 closest matches: 2024-05-10T14:03:59.653 INFO:teuthology.orchestra.run.smithi130.stderr:0 2024-05-10T14:03:59.653 INFO:teuthology.orchestra.run.smithi130.stderr:1 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:2 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:abort 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:assert 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:config diff 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:config diff get 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:config get 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:config help [] 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:config set ... 2024-05-10T14:03:59.654 INFO:teuthology.orchestra.run.smithi130.stderr:admin_socket: invalid command 2024-05-10T14:03:59.655 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:59.653+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:59.656 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-10T14:03:59.656 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-05-10T14:03:59.756 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:03:59.755+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:03:59.802 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:03:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:03:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:03:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:03:59.802 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:03:59.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:03:59.857 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:03:59.857+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:03:59.958 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:03:59.955+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.038 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.299168930999997, 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.039 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:00.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:00.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.210193845999996, 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.045 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:00.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:00.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:00.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:00.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.196926453000003, 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:00.053 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:00.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:00.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:00.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:00.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.191331011000003, 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:00.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:00.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.873317725999996, 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:00.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.869264459999997, 2024-05-10T14:04:00.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.831639562999996, 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.079 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:00.084 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.700466966999997, 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:00.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:00.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:00.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.696458644000003, 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.091 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:00.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.096 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.643544332999994, 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.629934657999996, 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.102 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:00.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:00.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:00.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:00.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.625846146000001, 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:00.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:00.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.579509912999995, 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:00.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:00.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.575749263000006, 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.488454984000001, 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.484615359000003, 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.390485362999996, 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.376326249000002, 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.372524951000003, 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.737031344999998, 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.159 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:00.160 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:00.137+0000 7fa7f98de7c0 -1 Falling back to public interface 2024-05-10T14:04:00.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:00.162 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:00.159+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:00.246 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:00.262 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:00.259+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:00.363 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:00.361+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:00.382 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:00.382 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:00.382 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:00.382 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:00.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:00.464 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:00.463+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:00.513 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:00.513 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:00.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:00.571 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:00.571+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:00.666 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:00.663+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:00.684 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:00.684 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.940538501000006, 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:00.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:00.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.940446030000004, 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.970201170999999, 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.927959049999998, 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.888659583999996, 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.881655167999995, 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.874049385999996, 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.816773378999997, 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.805655802999993, 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.680816273999994, 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.585161112999998, 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.581022841000006, 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.548271118000002, 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.383588919000005, 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.326382210999995, 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.184205504000005, 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.163519878000002, 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.156963738000002, 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.072019269999998, 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 78.065096431000001, 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:00.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:00.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:00.804 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:00.803+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:00.904 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:00.901+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:00.937 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:00.937 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:00.937 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:00.937 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:00.951 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:01.003 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:01.004 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:01.034 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:01.034 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:01.037 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:01.037+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:01.062 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:01.062 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:01.092 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:01.093 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:01.106 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:01.105+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:01.110 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:01.111 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:01.111 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:01.111 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:01.111 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:01.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:01.124 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:04:01.157 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:01.157 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:01.188 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:01.188 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:01.192 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:04:01.192 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:04:01.206 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:01.207+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:01.289 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.289 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:01.308 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:01.307+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:01.409 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:01.407+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:01.425 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.425 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.439 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:01.509 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:01.507+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.562 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.578 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:01.610 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:01.611+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:01.699 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.699 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.711 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:01.711+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:01.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:01.812 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:01.811+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:01.832 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.832 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:01.912 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:01.909+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:01.969 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:01.970 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:01.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:02.013 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:02.011+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:02.114 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:02.111+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:02.148 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:02.148 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:02.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:02.215 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:02.215+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:02.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:04:02.302 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:02.302 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:02.316 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:02.313+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:02.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:02.417 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:02.413+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:02.518 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:02.515+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:02.541 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:02.541 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:02.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:02.647 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:02.647+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:02.720 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:02.717+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:02.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:02.821 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:02.817+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:02.921 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:02.921+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:03.005 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:03.005 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:03.022 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:03.021+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:03.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:03.123 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:03.123+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:03.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:03.196 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:03.196 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:03.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:03.242 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:04:03.242 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:03.239+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:03.325 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:03.321+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:03.356 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:03.356 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:03.372 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:03.372 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:03.389 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:03.389 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:03.405 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.726482806999996, 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.680413754, 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.674903408000006, 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.564644580000007, 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.688418497000001, 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.665855613999994, 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.639527584999996, 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.621931027000002, 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.589592449999998, 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.555515786000001, 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.544959375999994, 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.263996610999996, 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.259707431999999, 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.218260322999996, 2024-05-10T14:04:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.120019503999998, 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.098554647, 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:03.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.034020960999996, 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:03.495 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:03.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:03.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.766706417999998, 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.506 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.105275880000001, 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.105147586999998, 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:03.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:03.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:03.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:03.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:03.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:03.518 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:03.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:03.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:03.520 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:03.520 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-05-10T14:04:03.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:03.521 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:03.521 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T14:04:03.522 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:03.522 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T14:04:03.523 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:03.517+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:03.620 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:03.619+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:03.720 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:03.719+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:03.735 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:03.736 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:03.736 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:03.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:03.843 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:03.843+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:03.922 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:03.923 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:03.923 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:03.921+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:03.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:04.023 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:04.021+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:04.051 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:04.049+0000 7fa7f98de7c0 -1 osd.5 55 log_to_monitors true 2024-05-10T14:04:04.124 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:04.121+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:04.155 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.416207309000001, 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:04.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:04.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.162 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.327232223999999, 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.163 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:04.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:04.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:04.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.171 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.313964831000007, 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.172 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:04.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:04.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:04.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.308369389000006, 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:04.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:04.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.990356104, 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:04.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:04.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:04.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.986302838, 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.191 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:04.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:04.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.196 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.948677941, 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:04.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.817505345000001, 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:04.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.813497022000007, 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:04.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.214 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.760582710999998, 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:04.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:04.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.746973036, 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.220 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.742884524000004, 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:04.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:04.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:04.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.696548290999999, 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:04.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:04.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:04.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.692787640999995, 2024-05-10T14:04:04.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.605493362000004, 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:04.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:04.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:04.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:04.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.601653737000007, 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:04.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.253 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.507523741, 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:04.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.493364627000005, 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:04.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.489563329000006, 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:04.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:04.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:04.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:04.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.854069723000002, 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:04.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:04.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.278 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:04.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:04.280 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:04.279+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:04.322 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:04.321+0000 7fa7ed6bb640 -1 osd.5 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T14:04:04.380 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:04.379+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:04.481 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:04.481+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:04.492 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:04.492 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:04.509 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:04.582 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:04.581+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:04.657 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:04.682 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:04.679+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:04.721 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:04.721 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:04.721 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:04.721 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:04.721 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:04.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:04.783 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:04.783+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:04.790 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:04.790 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:04.790 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:04.790 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:04.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T14:04:04.884 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:04.883+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:04.958 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:04.958 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.212988163999995, 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:04.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:04.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.212895692999993, 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.965 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:04.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:04.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.970 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.242650834000003, 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:04.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:04.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.200408713000002, 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:04.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:04.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:04.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.161109246999999, 2024-05-10T14:04:04.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.154104830999998, 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.988 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.146499048999999, 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:04.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:04.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.089223042, 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.078105465999997, 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.953265936999998, 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.857610776000001, 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.853472503999996, 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.820720781000006, 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.656038581999994, 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.598831873999998, 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.456655166999994, 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.435969541000006, 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.429413401000005, 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.344468933000002, 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 82.337546094000004, 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:05.072 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:05.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:05.074 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:05.071+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:05.174 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:05.173+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:05.210 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:05.210 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:05.211 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:05.211 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:05.225 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:05.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:04:05.278 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:05.275+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:05.375 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:05.373+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:05.391 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:05.391 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:05.391 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:05.391 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:05.391 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:05.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:05.497 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:05.497+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:05.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:05.572 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.882095320999994, 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:05.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:05.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.577 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 86.854257153999995, 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:05.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:05.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.840498431, 2024-05-10T14:04:05.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:05.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:05.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.757594838000003, 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:05.593 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.731257079000002, 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.594 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.599 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.730167027999997, 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.603 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.727279972000005, 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.604 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:05.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:05.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:05.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:05.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.724701569000004, 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.609 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.693422272999996, 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.613 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.641783967999999, 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:05.618 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:05.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:05.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.623 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.557637818000003, 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.553592288000004, 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.629 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:05.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:05.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.634 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.487327307000001, 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:05.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.640 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.450242019000001, 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.443109176999997, 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.646 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:05.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:05.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.651 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.241368111, 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:05.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:05.656 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.085438053000004, 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:05.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:05.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:05.661 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.078407573999996, 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.662 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.667 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 82.980605846000003, 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:05.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:05.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 82.973299452000006, 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:05.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:05.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:05.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:05.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:05.678 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:05.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:05.680 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:05.679+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:05.719 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:05.749 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:05.750 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:05.780 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:05.779+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:05.781 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:05.781 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:05.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:05.811 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:05.844 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:05.844 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:05.848 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:05.848 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:05.849 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:05.849 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:05.862 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:05.876 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:05.876 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-05-10T14:04:05.907 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:05.907 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:05.909 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:05.909+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:05.937 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:05.982 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:05.981+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:05.987 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:05.987 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:06.082 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:06.079+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:06.168 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.168 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.182 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:06.183 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:06.183+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:06.267 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T14:04:06.282 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:04:06.285 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:06.283+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:06.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T14:04:06.322 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.322 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.339 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:06.385 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:06.385+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:06.455 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.455 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.470 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:06.518 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:06.517+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:06.586 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:06.583+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:06.641 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.641 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.656 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:06.705 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:06.705+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:06.775 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.775 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.789 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:06.790 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:06.785+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:06.889 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:06.885+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:06.950 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:06.950 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:06.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:07.006 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:07.005+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:07.091 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:07.089+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:07.123 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:07.123 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:07.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:07.192 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:07.191+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:07.294 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:07.293+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:07.313 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T14:04:07.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:07.348 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T14:04:07.394 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:07.393+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:07.495 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:07.493+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:07.561 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:07.561 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:07.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:07.596 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:07.593+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:07.698 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:07.695+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:07.747 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:07.747 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:07.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:07.799 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:07.797+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:07.899 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:07.899+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:07.918 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:07.918 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:07.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:07.958 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:08.000 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:07.997+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:08.085 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:08.086 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:08.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:08.101 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:08.099+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:08.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:08.175 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:08.202 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:08.201+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:08.205 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:08.206 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.539273027999997, 2024-05-10T14:04:08.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:08.220 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:08.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:08.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:08.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.229 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.493203975, 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:08.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:08.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:08.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:08.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:08.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.487693629000006, 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:08.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.377434801000007, 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:08.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:08.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.501208718000001, 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:08.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.478645834999995, 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.452317805999996, 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:08.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:08.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.434721248000002, 2024-05-10T14:04:08.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:08.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.402382670999998, 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:08.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:08.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:08.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.368306007000001, 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:08.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:08.282 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.357749596999994, 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:08.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:08.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.076786831999996, 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:08.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:08.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:08.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.294 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.072497652999999, 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:08.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.031050543999996, 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:08.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:08.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:08.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.932809724999998, 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:08.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.911344868, 2024-05-10T14:04:08.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:08.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.846811181999996, 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:08.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:08.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.579496638999998, 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:08.322 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:08.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:08.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.918066101000001, 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:08.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.917937807999998, 2024-05-10T14:04:08.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:08.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.339 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:08.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:04:08.341 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:08.337+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:08.341 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:08.342 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:08.342 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:08.342 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:08.343 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:08.343 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:08.343 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:08.344 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:08.344 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:08.344 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T14:04:08.348 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:08.348 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:08.357 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T14:04:08.381 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:08.381 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:08.451 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:08.451+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:08.522 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:08.522 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:08.522 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:08.523 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:08.542 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:08.541+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:08.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:08.642 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:08.641+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:08.743 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:08.743+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:08.766 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:08.766 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:08.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:08.844 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:08.841+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:08.942 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:08.942 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:08.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:08.942 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.202448098000005, 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:08.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:08.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:08.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.113473013000004, 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:08.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:08.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.100205619999997, 2024-05-10T14:04:08.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:08.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:08.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.094610177999996, 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:08.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:08.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:08.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.776596893000004, 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:08.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:08.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:08.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.772543627000005, 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.980 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:08.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.985 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.734918730000004, 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:08.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:08.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.991 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.603746134000005, 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:08.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:08.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:08.997 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.599737810999997, 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:08.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:09.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.546823500000002, 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:09.003 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:09.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.533213825000004, 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:09.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.529125312999994, 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:09.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.482789080000003, 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:09.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:09.026 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.47902843, 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:09.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.031 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.391734150999994, 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:09.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.387894525999997, 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:09.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:09.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.293764530000004, 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.279605415999995, 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:09.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.275804117999996, 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:09.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:09.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.640310511999999, 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:09.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:09.067 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.068 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:09.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:09.070 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:09.069+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:09.171 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:09.171+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:09.199 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:09.200 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:09.200 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:09.200 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:09.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:09.303 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:09.303+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T14:04:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:04:09.372 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:09.371+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:09.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T14:04:09.404 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:09.404 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:09.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:09.511 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:09.511+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:09.575 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:09.573+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:09.635 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:09.635 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.891377788, 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:09.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:09.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.891285316999998, 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:09.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:09.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.921040457999993, 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:09.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:09.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.653 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.878798337000006, 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:09.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:09.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:09.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.839498871000004, 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.660 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:09.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:09.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.832494455000003, 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:09.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:09.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.672 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.672 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:09.672 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.824888673000004, 2024-05-10T14:04:09.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:09.673 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:09.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:09.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.767612666000005, 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:09.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:09.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.685 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.756495090000001, 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:09.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:09.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.631655561000002, 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:09.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.536000400000006, 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:09.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.531862128, 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:09.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.499110404999996, 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:09.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.334428205999998, 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:09.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:09.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:09.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.277221498000003, 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:09.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.135044790999999, 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:09.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:09.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:09.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.114359164999996, 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:09.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.107803024999996, 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:09.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.022858557000006, 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.015935717999994, 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:09.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:09.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:09.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:09.754 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:09.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:09.756 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:09.755+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:09.856 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:09.852+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:09.891 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:09.892 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:09.905 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:09.957 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:09.955+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:10.058 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:10.056+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:10.074 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:10.075 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:10.089 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:10.158 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:10.155+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:10.253 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:10.253 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:10.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:10.253 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.563130459000007, 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:10.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.258 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 91.535292291999994, 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.262 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.521533568999999, 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:10.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:10.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.438629976000001, 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:10.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.412292217000001, 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.276 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.281 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.411202165999995, 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:10.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.408315110000004, 2024-05-10T14:04:10.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:10.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:10.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:10.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:10.292 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.405736707000003, 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.374457410999995, 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.297 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:10.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:10.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.322819105999997, 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.303 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.308 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.238672956000002, 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:10.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:10.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:10.314 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.234627426000003, 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.168362445, 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:10.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:10.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:10.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.131277157, 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.326 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:10.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:10.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.124144314999995, 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.332 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:10.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.922403248999998, 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.338 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:10.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:10.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:10.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:10.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.766473191000003, 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.344 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:10.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.759442711999995, 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:10.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:10.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.661640984000002, 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.356 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:10.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:10.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:10.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.654334590000005, 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.362 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:10.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:10.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:10.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:10.367 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:10.368 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T14:04:10.369 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:10.370 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:10.364+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:10.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T14:04:10.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:10.470 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:10.468+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:10.544 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:10.545 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:10.545 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:10.545 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:10.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:10.602 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:10.600+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:10.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:10.627 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:10.659 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:10.659 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:10.671 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:10.668+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:10.690 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:10.721 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:10.721 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:10.725 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:10.725 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:10.725 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:10.725 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:10.725 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:10.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:10.751 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:10.772 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:10.771+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:10.782 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:10.814 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:10.814 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:10.844 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:10.844 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:10.873 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:10.868+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:10.921 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:10.973 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:10.971+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:11.074 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:11.071+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:11.175 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:11.175+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:11.215 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.215 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:11.276 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:11.275+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:11.348 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.348 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T14:04:11.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:04:11.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T14:04:11.409 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:11.408+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:11.492 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.492 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.495 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:11.495+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:11.507 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:11.578 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:11.575+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:11.671 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.672 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.679 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:11.676+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:11.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:11.781 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:11.779+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:11.855 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.855 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:11.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:11.882 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:11.880+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:11.983 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:11.983+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:11.988 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:11.988 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:12.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:12.084 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:12.080+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:12.185 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:12.183+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:12.197 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:12.197 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:12.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:12.286 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:12.284+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:12.377 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:12.382 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T14:04:12.386 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:12.387+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:12.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-10T14:04:12.432 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:12.433 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:12.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:12.499 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:12.499+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:12.588 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:12.584+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:12.671 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:12.672 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:12.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:12.690 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:12.687+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:12.791 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:12.788+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:12.847 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:12.847 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:12.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:12.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:12.903 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:12.903+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:12.992 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:12.988+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:13.021 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:13.021 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:13.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:13.060 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:13.087 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:13.087 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:13.093 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:13.088+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:13.113 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:13.113 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:13.137 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:13.138 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:13.168 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:13.168 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:13.178 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:13.178 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:13.178 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:13.178 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:13.194 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:13.191+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:13.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:13.200 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:13.200 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:13.233 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:13.234 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:13.264 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:13.331 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:13.331+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:13.358 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:13.358 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:13.359 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:13.359 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:13.359 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:13.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-05-10T14:04:13.419 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T14:04:13.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:04:13.420 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:13.419+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:13.507 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:13.507+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:13.527 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 94.789187638000001, 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.700212553, 2024-05-10T14:04:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:13.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.686945159999993, 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:13.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:13.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.681349718000007, 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.363336433000001, 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:13.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.359283167000001, 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.32165827, 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:13.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:13.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.190485674000001, 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:13.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:13.573 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.186477350999994, 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:13.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.133563039999999, 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:13.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:13.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.119953365000001, 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:13.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:13.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.115864853000005, 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:13.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.06952862, 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:13.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:13.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.065767969999996, 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:13.602 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.978473691000005, 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:13.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:13.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.974634065999993, 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:13.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.880504070000001, 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:13.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.866344956000006, 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:13.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:13.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.862543658000007, 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:13.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:13.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.227050052000003, 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:13.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:13.643 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:13.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:13.645 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:13.643+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:13.746 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:13.744+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:13.803 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:13.803 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:13.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:13.863 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:13.863+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:13.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:04:13.894 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:04:13.910 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-05-10T14:04:13.394263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":752,"num_read_kb":500,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":487,"ondisk_log_size":487,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266624,"kb_used_data":8320,"kb_used_omap":15,"kb_used_meta":258160,"kb_avail":754708096,"statfs":{"total":773094113280,"available":772821090304,"internally_reserved":0,"allocated":8519680,"data_stored":5070702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":264356509},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044395"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555940+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:04:11.555940+0000","last_peered":"2024-05-10T14:04:11.555940+0000","last_clean":"2024-05-10T14:04:11.555940+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:04:11.555940+0000","last_undegraded":"2024-05-10T14:04:11.555940+0000","last_fullsized":"2024-05-10T14:04:11.555940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335013+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:04:08.335013+0000","last_peered":"2024-05-10T14:04:08.335013+0000","last_clean":"2024-05-10T14:04:08.335013+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:04:08.335013+0000","last_undegraded":"2024-05-10T14:04:08.335013+0000","last_fullsized":"2024-05-10T14:04:08.335013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512985+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:04:09.512985+0000","last_peered":"2024-05-10T14:04:09.512985+0000","last_clean":"2024-05-10T14:04:09.512985+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:04:09.512985+0000","last_undegraded":"2024-05-10T14:04:09.512985+0000","last_fullsized":"2024-05-10T14:04:09.512985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555851+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:04:11.555851+0000","last_peered":"2024-05-10T14:04:11.555851+0000","last_clean":"2024-05-10T14:04:11.555851+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:04:11.555851+0000","last_undegraded":"2024-05-10T14:04:11.555851+0000","last_fullsized":"2024-05-10T14:04:11.555851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965076+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:04:11.965076+0000","last_peered":"2024-05-10T14:04:11.965076+0000","last_clean":"2024-05-10T14:04:11.965076+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:04:11.965076+0000","last_undegraded":"2024-05-10T14:04:11.965076+0000","last_fullsized":"2024-05-10T14:04:11.965076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371950+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:04:11.371950+0000","last_peered":"2024-05-10T14:04:11.371950+0000","last_clean":"2024-05-10T14:04:11.371950+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:04:11.371950+0000","last_undegraded":"2024-05-10T14:04:11.371950+0000","last_fullsized":"2024-05-10T14:04:11.371950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335108+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:04:08.335108+0000","last_peered":"2024-05-10T14:04:08.335108+0000","last_clean":"2024-05-10T14:04:08.335108+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:04:08.335108+0000","last_undegraded":"2024-05-10T14:04:08.335108+0000","last_fullsized":"2024-05-10T14:04:08.335108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966370+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:04:11.966370+0000","last_peered":"2024-05-10T14:04:11.966370+0000","last_clean":"2024-05-10T14:04:11.966370+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:04:11.966370+0000","last_undegraded":"2024-05-10T14:04:11.966370+0000","last_fullsized":"2024-05-10T14:04:11.966370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556082+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:04:11.556082+0000","last_peered":"2024-05-10T14:04:11.556082+0000","last_clean":"2024-05-10T14:04:11.556082+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:04:11.556082+0000","last_undegraded":"2024-05-10T14:04:11.556082+0000","last_fullsized":"2024-05-10T14:04:11.556082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961083+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:04:11.961083+0000","last_peered":"2024-05-10T14:04:11.961083+0000","last_clean":"2024-05-10T14:04:11.961083+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:04:11.961083+0000","last_undegraded":"2024-05-10T14:04:11.961083+0000","last_fullsized":"2024-05-10T14:04:11.961083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334970+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:04:08.334970+0000","last_peered":"2024-05-10T14:04:08.334970+0000","last_clean":"2024-05-10T14:04:08.334970+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:04:08.334970+0000","last_undegraded":"2024-05-10T14:04:08.334970+0000","last_fullsized":"2024-05-10T14:04:08.334970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372684+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:04:11.372684+0000","last_peered":"2024-05-10T14:04:11.372684+0000","last_clean":"2024-05-10T14:04:11.372684+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:04:11.372684+0000","last_undegraded":"2024-05-10T14:04:11.372684+0000","last_fullsized":"2024-05-10T14:04:11.372684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556592+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:04:11.556592+0000","last_peered":"2024-05-10T14:04:11.556592+0000","last_clean":"2024-05-10T14:04:11.556592+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:04:11.556592+0000","last_undegraded":"2024-05-10T14:04:11.556592+0000","last_fullsized":"2024-05-10T14:04:11.556592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335658+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:04:08.335658+0000","last_peered":"2024-05-10T14:04:08.335658+0000","last_clean":"2024-05-10T14:04:08.335658+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:04:08.335658+0000","last_undegraded":"2024-05-10T14:04:08.335658+0000","last_fullsized":"2024-05-10T14:04:08.335658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379851+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:04:11.379851+0000","last_peered":"2024-05-10T14:04:11.379851+0000","last_clean":"2024-05-10T14:04:11.379851+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:04:11.379851+0000","last_undegraded":"2024-05-10T14:04:11.379851+0000","last_fullsized":"2024-05-10T14:04:11.379851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.376344+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:04:11.376344+0000","last_peered":"2024-05-10T14:04:11.376344+0000","last_clean":"2024-05-10T14:04:11.376344+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:04:11.376344+0000","last_undegraded":"2024-05-10T14:04:11.376344+0000","last_fullsized":"2024-05-10T14:04:11.376344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371299+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:04:11.371299+0000","last_peered":"2024-05-10T14:04:11.371299+0000","last_clean":"2024-05-10T14:04:11.371299+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:04:11.371299+0000","last_undegraded":"2024-05-10T14:04:11.371299+0000","last_fullsized":"2024-05-10T14:04:11.371299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556056+0000","last_change":"2024-05-10T14:04:06.324566+0000","last_active":"2024-05-10T14:04:11.556056+0000","last_peered":"2024-05-10T14:04:11.556056+0000","last_clean":"2024-05-10T14:04:11.556056+0000","last_became_active":"2024-05-10T14:04:06.324028+0000","last_became_peered":"2024-05-10T14:04:06.324028+0000","last_unstale":"2024-05-10T14:04:11.556056+0000","last_undegraded":"2024-05-10T14:04:11.556056+0000","last_fullsized":"2024-05-10T14:04:11.556056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:15.231846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556527+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:04:11.556527+0000","last_peered":"2024-05-10T14:04:11.556527+0000","last_clean":"2024-05-10T14:04:11.556527+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:04:11.556527+0000","last_undegraded":"2024-05-10T14:04:11.556527+0000","last_fullsized":"2024-05-10T14:04:11.556527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961499+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:04:11.961499+0000","last_peered":"2024-05-10T14:04:11.961499+0000","last_clean":"2024-05-10T14:04:11.961499+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:04:11.961499+0000","last_undegraded":"2024-05-10T14:04:11.961499+0000","last_fullsized":"2024-05-10T14:04:11.961499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337127+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:04:08.337127+0000","last_peered":"2024-05-10T14:04:08.337127+0000","last_clean":"2024-05-10T14:04:08.337127+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:04:08.337127+0000","last_undegraded":"2024-05-10T14:04:08.337127+0000","last_fullsized":"2024-05-10T14:04:08.337127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.963565+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:04:11.963565+0000","last_peered":"2024-05-10T14:04:11.963565+0000","last_clean":"2024-05-10T14:04:11.963565+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:04:11.963565+0000","last_undegraded":"2024-05-10T14:04:11.963565+0000","last_fullsized":"2024-05-10T14:04:11.963565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372242+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:04:11.372242+0000","last_peered":"2024-05-10T14:04:11.372242+0000","last_clean":"2024-05-10T14:04:11.372242+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:04:11.372242+0000","last_undegraded":"2024-05-10T14:04:11.372242+0000","last_fullsized":"2024-05-10T14:04:11.372242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372090+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:04:11.372090+0000","last_peered":"2024-05-10T14:04:11.372090+0000","last_clean":"2024-05-10T14:04:11.372090+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:04:11.372090+0000","last_undegraded":"2024-05-10T14:04:11.372090+0000","last_fullsized":"2024-05-10T14:04:11.372090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372582+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:04:11.372582+0000","last_peered":"2024-05-10T14:04:11.372582+0000","last_clean":"2024-05-10T14:04:11.372582+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:04:11.372582+0000","last_undegraded":"2024-05-10T14:04:11.372582+0000","last_fullsized":"2024-05-10T14:04:11.372582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379127+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:04:11.379127+0000","last_peered":"2024-05-10T14:04:11.379127+0000","last_clean":"2024-05-10T14:04:11.379127+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:04:11.379127+0000","last_undegraded":"2024-05-10T14:04:11.379127+0000","last_fullsized":"2024-05-10T14:04:11.379127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372684+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:04:11.372684+0000","last_peered":"2024-05-10T14:04:11.372684+0000","last_clean":"2024-05-10T14:04:11.372684+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:04:11.372684+0000","last_undegraded":"2024-05-10T14:04:11.372684+0000","last_fullsized":"2024-05-10T14:04:11.372684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961549+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:04:11.961549+0000","last_peered":"2024-05-10T14:04:11.961549+0000","last_clean":"2024-05-10T14:04:11.961549+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:04:11.961549+0000","last_undegraded":"2024-05-10T14:04:11.961549+0000","last_fullsized":"2024-05-10T14:04:11.961549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371117+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:04:11.371117+0000","last_peered":"2024-05-10T14:04:11.371117+0000","last_clean":"2024-05-10T14:04:11.371117+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:04:11.371117+0000","last_undegraded":"2024-05-10T14:04:11.371117+0000","last_fullsized":"2024-05-10T14:04:11.371117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381291+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:04:11.381291+0000","last_peered":"2024-05-10T14:04:11.381291+0000","last_clean":"2024-05-10T14:04:11.381291+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:04:11.381291+0000","last_undegraded":"2024-05-10T14:04:11.381291+0000","last_fullsized":"2024-05-10T14:04:11.381291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556425+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:04:11.556425+0000","last_peered":"2024-05-10T14:04:11.556425+0000","last_clean":"2024-05-10T14:04:11.556425+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:04:11.556425+0000","last_undegraded":"2024-05-10T14:04:11.556425+0000","last_fullsized":"2024-05-10T14:04:11.556425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337251+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:04:08.337251+0000","last_peered":"2024-05-10T14:04:08.337251+0000","last_clean":"2024-05-10T14:04:08.337251+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:04:08.337251+0000","last_undegraded":"2024-05-10T14:04:08.337251+0000","last_fullsized":"2024-05-10T14:04:08.337251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965084+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:04:11.965084+0000","last_peered":"2024-05-10T14:04:11.965084+0000","last_clean":"2024-05-10T14:04:11.965084+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:04:11.965084+0000","last_undegraded":"2024-05-10T14:04:11.965084+0000","last_fullsized":"2024-05-10T14:04:11.965084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":103,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555656+0000","last_change":"2024-05-10T14:04:06.319936+0000","last_active":"2024-05-10T14:04:11.555656+0000","last_peered":"2024-05-10T14:04:11.555656+0000","last_clean":"2024-05-10T14:04:11.555656+0000","last_became_active":"2024-05-10T14:04:06.319377+0000","last_became_peered":"2024-05-10T14:04:06.319377+0000","last_unstale":"2024-05-10T14:04:11.555656+0000","last_undegraded":"2024-05-10T14:04:11.555656+0000","last_fullsized":"2024-05-10T14:04:11.555656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:20.196086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334137+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:04:08.334137+0000","last_peered":"2024-05-10T14:04:08.334137+0000","last_clean":"2024-05-10T14:04:08.334137+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:04:08.334137+0000","last_undegraded":"2024-05-10T14:04:08.334137+0000","last_fullsized":"2024-05-10T14:04:08.334137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336297+0000","last_change":"2024-05-10T14:04:06.325837+0000","last_active":"2024-05-10T14:04:08.336297+0000","last_peered":"2024-05-10T14:04:08.336297+0000","last_clean":"2024-05-10T14:04:08.336297+0000","last_became_active":"2024-05-10T14:04:06.318191+0000","last_became_peered":"2024-05-10T14:04:06.318191+0000","last_unstale":"2024-05-10T14:04:08.336297+0000","last_undegraded":"2024-05-10T14:04:08.336297+0000","last_fullsized":"2024-05-10T14:04:08.336297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.345120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510891+0000","last_change":"2024-05-10T14:03:12.136197+0000","last_active":"2024-05-10T14:04:09.510891+0000","last_peered":"2024-05-10T14:04:09.510891+0000","last_clean":"2024-05-10T14:04:09.510891+0000","last_became_active":"2024-05-10T14:03:12.135656+0000","last_became_peered":"2024-05-10T14:03:12.135656+0000","last_unstale":"2024-05-10T14:04:09.510891+0000","last_undegraded":"2024-05-10T14:04:09.510891+0000","last_fullsized":"2024-05-10T14:04:09.510891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:18.168652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381152+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:04:11.381152+0000","last_peered":"2024-05-10T14:04:11.381152+0000","last_clean":"2024-05-10T14:04:11.381152+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:04:11.381152+0000","last_undegraded":"2024-05-10T14:04:11.381152+0000","last_fullsized":"2024-05-10T14:04:11.381152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373290+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:04:11.373290+0000","last_peered":"2024-05-10T14:04:11.373290+0000","last_clean":"2024-05-10T14:04:11.373290+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:04:11.373290+0000","last_undegraded":"2024-05-10T14:04:11.373290+0000","last_fullsized":"2024-05-10T14:04:11.373290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372683+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:04:11.372683+0000","last_peered":"2024-05-10T14:04:11.372683+0000","last_clean":"2024-05-10T14:04:11.372683+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:04:11.372683+0000","last_undegraded":"2024-05-10T14:04:11.372683+0000","last_fullsized":"2024-05-10T14:04:11.372683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961297+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:04:11.961297+0000","last_peered":"2024-05-10T14:04:11.961297+0000","last_clean":"2024-05-10T14:04:11.961297+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:04:11.961297+0000","last_undegraded":"2024-05-10T14:04:11.961297+0000","last_fullsized":"2024-05-10T14:04:11.961297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.969101+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:04:11.969101+0000","last_peered":"2024-05-10T14:04:11.969101+0000","last_clean":"2024-05-10T14:04:11.969101+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:04:11.969101+0000","last_undegraded":"2024-05-10T14:04:11.969101+0000","last_fullsized":"2024-05-10T14:04:11.969101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556609+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:04:11.556609+0000","last_peered":"2024-05-10T14:04:11.556609+0000","last_clean":"2024-05-10T14:04:11.556609+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:04:11.556609+0000","last_undegraded":"2024-05-10T14:04:11.556609+0000","last_fullsized":"2024-05-10T14:04:11.556609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381509+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:04:11.381509+0000","last_peered":"2024-05-10T14:04:11.381509+0000","last_clean":"2024-05-10T14:04:11.381509+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:04:11.381509+0000","last_undegraded":"2024-05-10T14:04:11.381509+0000","last_fullsized":"2024-05-10T14:04:11.381509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372319+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:04:11.372319+0000","last_peered":"2024-05-10T14:04:11.372319+0000","last_clean":"2024-05-10T14:04:11.372319+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:04:11.372319+0000","last_undegraded":"2024-05-10T14:04:11.372319+0000","last_fullsized":"2024-05-10T14:04:11.372319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555800+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:04:11.555800+0000","last_peered":"2024-05-10T14:04:11.555800+0000","last_clean":"2024-05-10T14:04:11.555800+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:04:11.555800+0000","last_undegraded":"2024-05-10T14:04:11.555800+0000","last_fullsized":"2024-05-10T14:04:11.555800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371598+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:04:11.371598+0000","last_peered":"2024-05-10T14:04:11.371598+0000","last_clean":"2024-05-10T14:04:11.371598+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:04:11.371598+0000","last_undegraded":"2024-05-10T14:04:11.371598+0000","last_fullsized":"2024-05-10T14:04:11.371598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381100+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:04:11.381100+0000","last_peered":"2024-05-10T14:04:11.381100+0000","last_clean":"2024-05-10T14:04:11.381100+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:04:11.381100+0000","last_undegraded":"2024-05-10T14:04:11.381100+0000","last_fullsized":"2024-05-10T14:04:11.381100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959596+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:04:11.959596+0000","last_peered":"2024-05-10T14:04:11.959596+0000","last_clean":"2024-05-10T14:04:11.959596+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:04:11.959596+0000","last_undegraded":"2024-05-10T14:04:11.959596+0000","last_fullsized":"2024-05-10T14:04:11.959596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335995+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:04:08.335995+0000","last_peered":"2024-05-10T14:04:08.335995+0000","last_clean":"2024-05-10T14:04:08.335995+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:04:08.335995+0000","last_undegraded":"2024-05-10T14:04:08.335995+0000","last_fullsized":"2024-05-10T14:04:08.335995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556091+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:04:11.556091+0000","last_peered":"2024-05-10T14:04:11.556091+0000","last_clean":"2024-05-10T14:04:11.556091+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:04:11.556091+0000","last_undegraded":"2024-05-10T14:04:11.556091+0000","last_fullsized":"2024-05-10T14:04:11.556091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380828+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:04:11.380828+0000","last_peered":"2024-05-10T14:04:11.380828+0000","last_clean":"2024-05-10T14:04:11.380828+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:04:11.380828+0000","last_undegraded":"2024-05-10T14:04:11.380828+0000","last_fullsized":"2024-05-10T14:04:11.380828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334214+0000","last_change":"2024-05-10T14:04:06.315403+0000","last_active":"2024-05-10T14:04:08.334214+0000","last_peered":"2024-05-10T14:04:08.334214+0000","last_clean":"2024-05-10T14:04:08.334214+0000","last_became_active":"2024-05-10T14:04:06.314256+0000","last_became_peered":"2024-05-10T14:04:06.314256+0000","last_unstale":"2024-05-10T14:04:08.334214+0000","last_undegraded":"2024-05-10T14:04:08.334214+0000","last_fullsized":"2024-05-10T14:04:08.334214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:27:55.856155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556541+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:04:11.556541+0000","last_peered":"2024-05-10T14:04:11.556541+0000","last_clean":"2024-05-10T14:04:11.556541+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:04:11.556541+0000","last_undegraded":"2024-05-10T14:04:11.556541+0000","last_fullsized":"2024-05-10T14:04:11.556541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555430+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:04:11.555430+0000","last_peered":"2024-05-10T14:04:11.555430+0000","last_clean":"2024-05-10T14:04:11.555430+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:04:11.555430+0000","last_undegraded":"2024-05-10T14:04:11.555430+0000","last_fullsized":"2024-05-10T14:04:11.555430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":66,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335602+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:04:08.335602+0000","last_peered":"2024-05-10T14:04:08.335602+0000","last_clean":"2024-05-10T14:04:08.335602+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:04:08.335602+0000","last_undegraded":"2024-05-10T14:04:08.335602+0000","last_fullsized":"2024-05-10T14:04:08.335602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511608+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:04:09.511608+0000","last_peered":"2024-05-10T14:04:09.511608+0000","last_clean":"2024-05-10T14:04:09.511608+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:04:09.511608+0000","last_undegraded":"2024-05-10T14:04:09.511608+0000","last_fullsized":"2024-05-10T14:04:09.511608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336388+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:04:08.336388+0000","last_peered":"2024-05-10T14:04:08.336388+0000","last_clean":"2024-05-10T14:04:08.336388+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:04:08.336388+0000","last_undegraded":"2024-05-10T14:04:08.336388+0000","last_fullsized":"2024-05-10T14:04:08.336388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371388+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:04:11.371388+0000","last_peered":"2024-05-10T14:04:11.371388+0000","last_clean":"2024-05-10T14:04:11.371388+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:04:11.371388+0000","last_undegraded":"2024-05-10T14:04:11.371388+0000","last_fullsized":"2024-05-10T14:04:11.371388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556749+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:04:11.556749+0000","last_peered":"2024-05-10T14:04:11.556749+0000","last_clean":"2024-05-10T14:04:11.556749+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:04:11.556749+0000","last_undegraded":"2024-05-10T14:04:11.556749+0000","last_fullsized":"2024-05-10T14:04:11.556749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375686+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:04:11.375686+0000","last_peered":"2024-05-10T14:04:11.375686+0000","last_clean":"2024-05-10T14:04:11.375686+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:04:11.375686+0000","last_undegraded":"2024-05-10T14:04:11.375686+0000","last_fullsized":"2024-05-10T14:04:11.375686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379468+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:04:11.379468+0000","last_peered":"2024-05-10T14:04:11.379468+0000","last_clean":"2024-05-10T14:04:11.379468+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:04:11.379468+0000","last_undegraded":"2024-05-10T14:04:11.379468+0000","last_fullsized":"2024-05-10T14:04:11.379468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378745+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:04:11.378745+0000","last_peered":"2024-05-10T14:04:11.378745+0000","last_clean":"2024-05-10T14:04:11.378745+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:04:11.378745+0000","last_undegraded":"2024-05-10T14:04:11.378745+0000","last_fullsized":"2024-05-10T14:04:11.378745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961049+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:04:11.961049+0000","last_peered":"2024-05-10T14:04:11.961049+0000","last_clean":"2024-05-10T14:04:11.961049+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:04:11.961049+0000","last_undegraded":"2024-05-10T14:04:11.961049+0000","last_fullsized":"2024-05-10T14:04:11.961049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960198+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:04:11.960198+0000","last_peered":"2024-05-10T14:04:11.960198+0000","last_clean":"2024-05-10T14:04:11.960198+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:04:11.960198+0000","last_undegraded":"2024-05-10T14:04:11.960198+0000","last_fullsized":"2024-05-10T14:04:11.960198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556680+0000","last_change":"2024-05-10T14:04:06.325610+0000","last_active":"2024-05-10T14:04:11.556680+0000","last_peered":"2024-05-10T14:04:11.556680+0000","last_clean":"2024-05-10T14:04:11.556680+0000","last_became_active":"2024-05-10T14:04:06.324971+0000","last_became_peered":"2024-05-10T14:04:06.324971+0000","last_unstale":"2024-05-10T14:04:11.556680+0000","last_undegraded":"2024-05-10T14:04:11.556680+0000","last_fullsized":"2024-05-10T14:04:11.556680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:22.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371800+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:04:11.371800+0000","last_peered":"2024-05-10T14:04:11.371800+0000","last_clean":"2024-05-10T14:04:11.371800+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:04:11.371800+0000","last_undegraded":"2024-05-10T14:04:11.371800+0000","last_fullsized":"2024-05-10T14:04:11.371800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555207+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:04:11.555207+0000","last_peered":"2024-05-10T14:04:11.555207+0000","last_clean":"2024-05-10T14:04:11.555207+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:04:11.555207+0000","last_undegraded":"2024-05-10T14:04:11.555207+0000","last_fullsized":"2024-05-10T14:04:11.555207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960562+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:04:11.960562+0000","last_peered":"2024-05-10T14:04:11.960562+0000","last_clean":"2024-05-10T14:04:11.960562+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:04:11.960562+0000","last_undegraded":"2024-05-10T14:04:11.960562+0000","last_fullsized":"2024-05-10T14:04:11.960562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965238+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:04:11.965238+0000","last_peered":"2024-05-10T14:04:11.965238+0000","last_clean":"2024-05-10T14:04:11.965238+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:04:11.965238+0000","last_undegraded":"2024-05-10T14:04:11.965238+0000","last_fullsized":"2024-05-10T14:04:11.965238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.967267+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:04:11.967267+0000","last_peered":"2024-05-10T14:04:11.967267+0000","last_clean":"2024-05-10T14:04:11.967267+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:04:11.967267+0000","last_undegraded":"2024-05-10T14:04:11.967267+0000","last_fullsized":"2024-05-10T14:04:11.967267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335440+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:04:08.335440+0000","last_peered":"2024-05-10T14:04:08.335440+0000","last_clean":"2024-05-10T14:04:08.335440+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:04:08.335440+0000","last_undegraded":"2024-05-10T14:04:08.335440+0000","last_fullsized":"2024-05-10T14:04:08.335440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.377845+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:04:11.377845+0000","last_peered":"2024-05-10T14:04:11.377845+0000","last_clean":"2024-05-10T14:04:11.377845+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:04:11.377845+0000","last_undegraded":"2024-05-10T14:04:11.377845+0000","last_fullsized":"2024-05-10T14:04:11.377845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960859+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:04:11.960859+0000","last_peered":"2024-05-10T14:04:11.960859+0000","last_clean":"2024-05-10T14:04:11.960859+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:04:11.960859+0000","last_undegraded":"2024-05-10T14:04:11.960859+0000","last_fullsized":"2024-05-10T14:04:11.960859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375802+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:04:11.375802+0000","last_peered":"2024-05-10T14:04:11.375802+0000","last_clean":"2024-05-10T14:04:11.375802+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:04:11.375802+0000","last_undegraded":"2024-05-10T14:04:11.375802+0000","last_fullsized":"2024-05-10T14:04:11.375802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512745+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:04:09.512745+0000","last_peered":"2024-05-10T14:04:09.512745+0000","last_clean":"2024-05-10T14:04:09.512745+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:04:09.512745+0000","last_undegraded":"2024-05-10T14:04:09.512745+0000","last_fullsized":"2024-05-10T14:04:09.512745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372678+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:04:11.372678+0000","last_peered":"2024-05-10T14:04:11.372678+0000","last_clean":"2024-05-10T14:04:11.372678+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:04:11.372678+0000","last_undegraded":"2024-05-10T14:04:11.372678+0000","last_fullsized":"2024-05-10T14:04:11.372678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378836+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:04:11.378836+0000","last_peered":"2024-05-10T14:04:11.378836+0000","last_clean":"2024-05-10T14:04:11.378836+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:04:11.378836+0000","last_undegraded":"2024-05-10T14:04:11.378836+0000","last_fullsized":"2024-05-10T14:04:11.378836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375054+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:04:11.375054+0000","last_peered":"2024-05-10T14:04:11.375054+0000","last_clean":"2024-05-10T14:04:11.375054+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:04:11.375054+0000","last_undegraded":"2024-05-10T14:04:11.375054+0000","last_fullsized":"2024-05-10T14:04:11.375054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372817+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:04:11.372817+0000","last_peered":"2024-05-10T14:04:11.372817+0000","last_clean":"2024-05-10T14:04:11.372817+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:04:11.372817+0000","last_undegraded":"2024-05-10T14:04:11.372817+0000","last_fullsized":"2024-05-10T14:04:11.372817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968296+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:04:11.968296+0000","last_peered":"2024-05-10T14:04:11.968296+0000","last_clean":"2024-05-10T14:04:11.968296+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:04:11.968296+0000","last_undegraded":"2024-05-10T14:04:11.968296+0000","last_fullsized":"2024-05-10T14:04:11.968296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":101,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379243+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:04:11.379243+0000","last_peered":"2024-05-10T14:04:11.379243+0000","last_clean":"2024-05-10T14:04:11.379243+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:04:11.379243+0000","last_undegraded":"2024-05-10T14:04:11.379243+0000","last_fullsized":"2024-05-10T14:04:11.379243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372812+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:04:11.372812+0000","last_peered":"2024-05-10T14:04:11.372812+0000","last_clean":"2024-05-10T14:04:11.372812+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:04:11.372812+0000","last_undegraded":"2024-05-10T14:04:11.372812+0000","last_fullsized":"2024-05-10T14:04:11.372812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960321+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:04:11.960321+0000","last_peered":"2024-05-10T14:04:11.960321+0000","last_clean":"2024-05-10T14:04:11.960321+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:04:11.960321+0000","last_undegraded":"2024-05-10T14:04:11.960321+0000","last_fullsized":"2024-05-10T14:04:11.960321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":101,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511715+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:04:09.511715+0000","last_peered":"2024-05-10T14:04:09.511715+0000","last_clean":"2024-05-10T14:04:09.511715+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:04:09.511715+0000","last_undegraded":"2024-05-10T14:04:09.511715+0000","last_fullsized":"2024-05-10T14:04:09.511715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372260+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:04:11.372260+0000","last_peered":"2024-05-10T14:04:11.372260+0000","last_clean":"2024-05-10T14:04:11.372260+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:04:11.372260+0000","last_undegraded":"2024-05-10T14:04:11.372260+0000","last_fullsized":"2024-05-10T14:04:11.372260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"74'4","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373194+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:04:11.373194+0000","last_peered":"2024-05-10T14:04:11.373194+0000","last_clean":"2024-05-10T14:04:11.373194+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:04:11.373194+0000","last_undegraded":"2024-05-10T14:04:11.373194+0000","last_fullsized":"2024-05-10T14:04:11.373194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510500+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:04:09.510500+0000","last_peered":"2024-05-10T14:04:09.510500+0000","last_clean":"2024-05-10T14:04:09.510500+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:04:09.510500+0000","last_undegraded":"2024-05-10T14:04:09.510500+0000","last_fullsized":"2024-05-10T14:04:09.510500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373472+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:04:11.373472+0000","last_peered":"2024-05-10T14:04:11.373472+0000","last_clean":"2024-05-10T14:04:11.373472+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:04:11.373472+0000","last_undegraded":"2024-05-10T14:04:11.373472+0000","last_fullsized":"2024-05-10T14:04:11.373472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372049+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:04:11.372049+0000","last_peered":"2024-05-10T14:04:11.372049+0000","last_clean":"2024-05-10T14:04:11.372049+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:04:11.372049+0000","last_undegraded":"2024-05-10T14:04:11.372049+0000","last_fullsized":"2024-05-10T14:04:11.372049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337357+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:04:08.337357+0000","last_peered":"2024-05-10T14:04:08.337357+0000","last_clean":"2024-05-10T14:04:08.337357+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:04:08.337357+0000","last_undegraded":"2024-05-10T14:04:08.337357+0000","last_fullsized":"2024-05-10T14:04:08.337357+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380928+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:04:11.380928+0000","last_peered":"2024-05-10T14:04:11.380928+0000","last_clean":"2024-05-10T14:04:11.380928+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:04:11.380928+0000","last_undegraded":"2024-05-10T14:04:11.380928+0000","last_fullsized":"2024-05-10T14:04:11.380928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.962357+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:04:11.962357+0000","last_peered":"2024-05-10T14:04:11.962357+0000","last_clean":"2024-05-10T14:04:11.962357+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:04:11.962357+0000","last_undegraded":"2024-05-10T14:04:11.962357+0000","last_fullsized":"2024-05-10T14:04:11.962357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371764+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:04:11.371764+0000","last_peered":"2024-05-10T14:04:11.371764+0000","last_clean":"2024-05-10T14:04:11.371764+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:04:11.371764+0000","last_undegraded":"2024-05-10T14:04:11.371764+0000","last_fullsized":"2024-05-10T14:04:11.371764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512989+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:04:09.512989+0000","last_peered":"2024-05-10T14:04:09.512989+0000","last_clean":"2024-05-10T14:04:09.512989+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:04:09.512989+0000","last_undegraded":"2024-05-10T14:04:09.512989+0000","last_fullsized":"2024-05-10T14:04:09.512989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380006+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:04:11.380006+0000","last_peered":"2024-05-10T14:04:11.380006+0000","last_clean":"2024-05-10T14:04:11.380006+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:04:11.380006+0000","last_undegraded":"2024-05-10T14:04:11.380006+0000","last_fullsized":"2024-05-10T14:04:11.380006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373229+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:04:11.373229+0000","last_peered":"2024-05-10T14:04:11.373229+0000","last_clean":"2024-05-10T14:04:11.373229+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:04:11.373229+0000","last_undegraded":"2024-05-10T14:04:11.373229+0000","last_fullsized":"2024-05-10T14:04:11.373229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337477+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:04:08.337477+0000","last_peered":"2024-05-10T14:04:08.337477+0000","last_clean":"2024-05-10T14:04:08.337477+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:04:08.337477+0000","last_undegraded":"2024-05-10T14:04:08.337477+0000","last_fullsized":"2024-05-10T14:04:08.337477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960691+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:04:11.960691+0000","last_peered":"2024-05-10T14:04:11.960691+0000","last_clean":"2024-05-10T14:04:11.960691+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:04:11.960691+0000","last_undegraded":"2024-05-10T14:04:11.960691+0000","last_fullsized":"2024-05-10T14:04:11.960691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.509779+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:04:09.509779+0000","last_peered":"2024-05-10T14:04:09.509779+0000","last_clean":"2024-05-10T14:04:09.509779+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:04:09.509779+0000","last_undegraded":"2024-05-10T14:04:09.509779+0000","last_fullsized":"2024-05-10T14:04:09.509779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.963181+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:04:11.963181+0000","last_peered":"2024-05-10T14:04:11.963181+0000","last_clean":"2024-05-10T14:04:11.963181+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:04:11.963181+0000","last_undegraded":"2024-05-10T14:04:11.963181+0000","last_fullsized":"2024-05-10T14:04:11.963181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":214,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555256+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:04:11.555256+0000","last_peered":"2024-05-10T14:04:11.555256+0000","last_clean":"2024-05-10T14:04:11.555256+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:04:11.555256+0000","last_undegraded":"2024-05-10T14:04:11.555256+0000","last_fullsized":"2024-05-10T14:04:11.555256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334737+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:04:08.334737+0000","last_peered":"2024-05-10T14:04:08.334737+0000","last_clean":"2024-05-10T14:04:08.334737+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:04:08.334737+0000","last_undegraded":"2024-05-10T14:04:08.334737+0000","last_fullsized":"2024-05-10T14:04:08.334737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379144+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:04:11.379144+0000","last_peered":"2024-05-10T14:04:11.379144+0000","last_clean":"2024-05-10T14:04:11.379144+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:04:11.379144+0000","last_undegraded":"2024-05-10T14:04:11.379144+0000","last_fullsized":"2024-05-10T14:04:11.379144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554795+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:04:11.554795+0000","last_peered":"2024-05-10T14:04:11.554795+0000","last_clean":"2024-05-10T14:04:11.554795+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:04:11.554795+0000","last_undegraded":"2024-05-10T14:04:11.554795+0000","last_fullsized":"2024-05-10T14:04:11.554795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":62,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336606+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:04:08.336606+0000","last_peered":"2024-05-10T14:04:08.336606+0000","last_clean":"2024-05-10T14:04:08.336606+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:04:08.336606+0000","last_undegraded":"2024-05-10T14:04:08.336606+0000","last_fullsized":"2024-05-10T14:04:08.336606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965323+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:04:11.965323+0000","last_peered":"2024-05-10T14:04:11.965323+0000","last_clean":"2024-05-10T14:04:11.965323+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:04:11.965323+0000","last_undegraded":"2024-05-10T14:04:11.965323+0000","last_fullsized":"2024-05-10T14:04:11.965323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959407+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:04:11.959407+0000","last_peered":"2024-05-10T14:04:11.959407+0000","last_clean":"2024-05-10T14:04:11.959407+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:04:11.959407+0000","last_undegraded":"2024-05-10T14:04:11.959407+0000","last_fullsized":"2024-05-10T14:04:11.959407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968966+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:04:11.968966+0000","last_peered":"2024-05-10T14:04:11.968966+0000","last_clean":"2024-05-10T14:04:11.968966+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:04:11.968966+0000","last_undegraded":"2024-05-10T14:04:11.968966+0000","last_fullsized":"2024-05-10T14:04:11.968966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555163+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:04:11.555163+0000","last_peered":"2024-05-10T14:04:11.555163+0000","last_clean":"2024-05-10T14:04:11.555163+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:04:11.555163+0000","last_undegraded":"2024-05-10T14:04:11.555163+0000","last_fullsized":"2024-05-10T14:04:11.555163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961000+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:04:11.961000+0000","last_peered":"2024-05-10T14:04:11.961000+0000","last_clean":"2024-05-10T14:04:11.961000+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:04:11.961000+0000","last_undegraded":"2024-05-10T14:04:11.961000+0000","last_fullsized":"2024-05-10T14:04:11.961000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337000+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:04:08.337000+0000","last_peered":"2024-05-10T14:04:08.337000+0000","last_clean":"2024-05-10T14:04:08.337000+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:04:08.337000+0000","last_undegraded":"2024-05-10T14:04:08.337000+0000","last_fullsized":"2024-05-10T14:04:08.337000+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"74'25","reported_seq":166,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511714+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:04:09.511714+0000","last_peered":"2024-05-10T14:04:09.511714+0000","last_clean":"2024-05-10T14:04:09.511714+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:04:09.511714+0000","last_undegraded":"2024-05-10T14:04:09.511714+0000","last_fullsized":"2024-05-10T14:04:09.511714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555877+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:04:11.555877+0000","last_peered":"2024-05-10T14:04:11.555877+0000","last_clean":"2024-05-10T14:04:11.555877+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:04:11.555877+0000","last_undegraded":"2024-05-10T14:04:11.555877+0000","last_fullsized":"2024-05-10T14:04:11.555877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510969+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:04:09.510969+0000","last_peered":"2024-05-10T14:04:09.510969+0000","last_clean":"2024-05-10T14:04:09.510969+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:04:09.510969+0000","last_undegraded":"2024-05-10T14:04:09.510969+0000","last_fullsized":"2024-05-10T14:04:09.510969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":112,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.513075+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:04:09.513075+0000","last_peered":"2024-05-10T14:04:09.513075+0000","last_clean":"2024-05-10T14:04:09.513075+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:04:09.513075+0000","last_undegraded":"2024-05-10T14:04:09.513075+0000","last_fullsized":"2024-05-10T14:04:09.513075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373819+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:04:11.373819+0000","last_peered":"2024-05-10T14:04:11.373819+0000","last_clean":"2024-05-10T14:04:11.373819+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:04:11.373819+0000","last_undegraded":"2024-05-10T14:04:11.373819+0000","last_fullsized":"2024-05-10T14:04:11.373819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.509990+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:04:09.509990+0000","last_peered":"2024-05-10T14:04:09.509990+0000","last_clean":"2024-05-10T14:04:09.509990+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:04:09.509990+0000","last_undegraded":"2024-05-10T14:04:09.509990+0000","last_fullsized":"2024-05-10T14:04:09.509990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373390+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:04:11.373390+0000","last_peered":"2024-05-10T14:04:11.373390+0000","last_clean":"2024-05-10T14:04:11.373390+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:04:11.373390+0000","last_undegraded":"2024-05-10T14:04:11.373390+0000","last_fullsized":"2024-05-10T14:04:11.373390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556376+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:04:11.556376+0000","last_peered":"2024-05-10T14:04:11.556376+0000","last_clean":"2024-05-10T14:04:11.556376+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:04:11.556376+0000","last_undegraded":"2024-05-10T14:04:11.556376+0000","last_fullsized":"2024-05-10T14:04:11.556376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964721+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:04:11.964721+0000","last_peered":"2024-05-10T14:04:11.964721+0000","last_clean":"2024-05-10T14:04:11.964721+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:04:11.964721+0000","last_undegraded":"2024-05-10T14:04:11.964721+0000","last_fullsized":"2024-05-10T14:04:11.964721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379299+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:04:11.379299+0000","last_peered":"2024-05-10T14:04:11.379299+0000","last_clean":"2024-05-10T14:04:11.379299+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:04:11.379299+0000","last_undegraded":"2024-05-10T14:04:11.379299+0000","last_fullsized":"2024-05-10T14:04:11.379299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511884+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:04:09.511884+0000","last_peered":"2024-05-10T14:04:09.511884+0000","last_clean":"2024-05-10T14:04:09.511884+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:04:09.511884+0000","last_undegraded":"2024-05-10T14:04:09.511884+0000","last_fullsized":"2024-05-10T14:04:09.511884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334340+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:04:08.334340+0000","last_peered":"2024-05-10T14:04:08.334340+0000","last_clean":"2024-05-10T14:04:08.334340+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:04:08.334340+0000","last_undegraded":"2024-05-10T14:04:08.334340+0000","last_fullsized":"2024-05-10T14:04:08.334340+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372001+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:04:11.372001+0000","last_peered":"2024-05-10T14:04:11.372001+0000","last_clean":"2024-05-10T14:04:11.372001+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:04:11.372001+0000","last_undegraded":"2024-05-10T14:04:11.372001+0000","last_fullsized":"2024-05-10T14:04:11.372001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964934+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:04:11.964934+0000","last_peered":"2024-05-10T14:04:11.964934+0000","last_clean":"2024-05-10T14:04:11.964934+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:04:11.964934+0000","last_undegraded":"2024-05-10T14:04:11.964934+0000","last_fullsized":"2024-05-10T14:04:11.964934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380513+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:04:11.380513+0000","last_peered":"2024-05-10T14:04:11.380513+0000","last_clean":"2024-05-10T14:04:11.380513+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:04:11.380513+0000","last_undegraded":"2024-05-10T14:04:11.380513+0000","last_fullsized":"2024-05-10T14:04:11.380513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961385+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:04:11.961385+0000","last_peered":"2024-05-10T14:04:11.961385+0000","last_clean":"2024-05-10T14:04:11.961385+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:04:11.961385+0000","last_undegraded":"2024-05-10T14:04:11.961385+0000","last_fullsized":"2024-05-10T14:04:11.961385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335842+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:04:08.335842+0000","last_peered":"2024-05-10T14:04:08.335842+0000","last_clean":"2024-05-10T14:04:08.335842+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:04:08.335842+0000","last_undegraded":"2024-05-10T14:04:08.335842+0000","last_fullsized":"2024-05-10T14:04:08.335842+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":112,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511276+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:04:09.511276+0000","last_peered":"2024-05-10T14:04:09.511276+0000","last_clean":"2024-05-10T14:04:09.511276+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:04:09.511276+0000","last_undegraded":"2024-05-10T14:04:09.511276+0000","last_fullsized":"2024-05-10T14:04:09.511276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375188+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:04:11.375188+0000","last_peered":"2024-05-10T14:04:11.375188+0000","last_clean":"2024-05-10T14:04:11.375188+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:04:11.375188+0000","last_undegraded":"2024-05-10T14:04:11.375188+0000","last_fullsized":"2024-05-10T14:04:11.375188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512032+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:04:09.512032+0000","last_peered":"2024-05-10T14:04:09.512032+0000","last_clean":"2024-05-10T14:04:09.512032+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:04:09.512032+0000","last_undegraded":"2024-05-10T14:04:09.512032+0000","last_fullsized":"2024-05-10T14:04:09.512032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966547+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:04:11.966547+0000","last_peered":"2024-05-10T14:04:11.966547+0000","last_clean":"2024-05-10T14:04:11.966547+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:04:11.966547+0000","last_undegraded":"2024-05-10T14:04:11.966547+0000","last_fullsized":"2024-05-10T14:04:11.966547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960150+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:04:11.960150+0000","last_peered":"2024-05-10T14:04:11.960150+0000","last_clean":"2024-05-10T14:04:11.960150+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:04:11.960150+0000","last_undegraded":"2024-05-10T14:04:11.960150+0000","last_fullsized":"2024-05-10T14:04:11.960150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371227+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:04:11.371227+0000","last_peered":"2024-05-10T14:04:11.371227+0000","last_clean":"2024-05-10T14:04:11.371227+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:04:11.371227+0000","last_undegraded":"2024-05-10T14:04:11.371227+0000","last_fullsized":"2024-05-10T14:04:11.371227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964937+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:04:11.964937+0000","last_peered":"2024-05-10T14:04:11.964937+0000","last_clean":"2024-05-10T14:04:11.964937+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:04:11.964937+0000","last_undegraded":"2024-05-10T14:04:11.964937+0000","last_fullsized":"2024-05-10T14:04:11.964937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.967180+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:04:11.967180+0000","last_peered":"2024-05-10T14:04:11.967180+0000","last_clean":"2024-05-10T14:04:11.967180+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:04:11.967180+0000","last_undegraded":"2024-05-10T14:04:11.967180+0000","last_fullsized":"2024-05-10T14:04:11.967180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511947+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:04:09.511947+0000","last_peered":"2024-05-10T14:04:09.511947+0000","last_clean":"2024-05-10T14:04:09.511947+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:04:09.511947+0000","last_undegraded":"2024-05-10T14:04:09.511947+0000","last_fullsized":"2024-05-10T14:04:09.511947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556783+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:04:11.556783+0000","last_peered":"2024-05-10T14:04:11.556783+0000","last_clean":"2024-05-10T14:04:11.556783+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:04:11.556783+0000","last_undegraded":"2024-05-10T14:04:11.556783+0000","last_fullsized":"2024-05-10T14:04:11.556783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959970+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:04:11.959970+0000","last_peered":"2024-05-10T14:04:11.959970+0000","last_clean":"2024-05-10T14:04:11.959970+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:04:11.959970+0000","last_undegraded":"2024-05-10T14:04:11.959970+0000","last_fullsized":"2024-05-10T14:04:11.959970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510211+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:04:09.510211+0000","last_peered":"2024-05-10T14:04:09.510211+0000","last_clean":"2024-05-10T14:04:09.510211+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:04:09.510211+0000","last_undegraded":"2024-05-10T14:04:09.510211+0000","last_fullsized":"2024-05-10T14:04:09.510211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"57'3","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335334+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:04:08.335334+0000","last_peered":"2024-05-10T14:04:08.335334+0000","last_clean":"2024-05-10T14:04:08.335334+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:04:08.335334+0000","last_undegraded":"2024-05-10T14:04:08.335334+0000","last_fullsized":"2024-05-10T14:04:08.335334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381230+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:04:11.381230+0000","last_peered":"2024-05-10T14:04:11.381230+0000","last_clean":"2024-05-10T14:04:11.381230+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:04:11.381230+0000","last_undegraded":"2024-05-10T14:04:11.381230+0000","last_fullsized":"2024-05-10T14:04:11.381230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379647+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:04:11.379647+0000","last_peered":"2024-05-10T14:04:11.379647+0000","last_clean":"2024-05-10T14:04:11.379647+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:04:11.379647+0000","last_undegraded":"2024-05-10T14:04:11.379647+0000","last_fullsized":"2024-05-10T14:04:11.379647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380351+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:04:11.380351+0000","last_peered":"2024-05-10T14:04:11.380351+0000","last_clean":"2024-05-10T14:04:11.380351+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:04:11.380351+0000","last_undegraded":"2024-05-10T14:04:11.380351+0000","last_fullsized":"2024-05-10T14:04:11.380351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.513068+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:04:09.513068+0000","last_peered":"2024-05-10T14:04:09.513068+0000","last_clean":"2024-05-10T14:04:09.513068+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:04:09.513068+0000","last_undegraded":"2024-05-10T14:04:09.513068+0000","last_fullsized":"2024-05-10T14:04:09.513068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371352+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:04:11.371352+0000","last_peered":"2024-05-10T14:04:11.371352+0000","last_clean":"2024-05-10T14:04:11.371352+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:04:11.371352+0000","last_undegraded":"2024-05-10T14:04:11.371352+0000","last_fullsized":"2024-05-10T14:04:11.371352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372023+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:04:11.372023+0000","last_peered":"2024-05-10T14:04:11.372023+0000","last_clean":"2024-05-10T14:04:11.372023+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:04:11.372023+0000","last_undegraded":"2024-05-10T14:04:11.372023+0000","last_fullsized":"2024-05-10T14:04:11.372023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379884+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:04:11.379884+0000","last_peered":"2024-05-10T14:04:11.379884+0000","last_clean":"2024-05-10T14:04:11.379884+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:04:11.379884+0000","last_undegraded":"2024-05-10T14:04:11.379884+0000","last_fullsized":"2024-05-10T14:04:11.379884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964727+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:04:11.964727+0000","last_peered":"2024-05-10T14:04:11.964727+0000","last_clean":"2024-05-10T14:04:11.964727+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:04:11.964727+0000","last_undegraded":"2024-05-10T14:04:11.964727+0000","last_fullsized":"2024-05-10T14:04:11.964727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371597+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:04:11.371597+0000","last_peered":"2024-05-10T14:04:11.371597+0000","last_clean":"2024-05-10T14:04:11.371597+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:04:11.371597+0000","last_undegraded":"2024-05-10T14:04:11.371597+0000","last_fullsized":"2024-05-10T14:04:11.371597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.969191+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:04:11.969191+0000","last_peered":"2024-05-10T14:04:11.969191+0000","last_clean":"2024-05-10T14:04:11.969191+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:04:11.969191+0000","last_undegraded":"2024-05-10T14:04:11.969191+0000","last_fullsized":"2024-05-10T14:04:11.969191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961952+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:04:11.961952+0000","last_peered":"2024-05-10T14:04:11.961952+0000","last_clean":"2024-05-10T14:04:11.961952+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:04:11.961952+0000","last_undegraded":"2024-05-10T14:04:11.961952+0000","last_fullsized":"2024-05-10T14:04:11.961952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379517+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:04:11.379517+0000","last_peered":"2024-05-10T14:04:11.379517+0000","last_clean":"2024-05-10T14:04:11.379517+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:04:11.379517+0000","last_undegraded":"2024-05-10T14:04:11.379517+0000","last_fullsized":"2024-05-10T14:04:11.379517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555240+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:04:11.555240+0000","last_peered":"2024-05-10T14:04:11.555240+0000","last_clean":"2024-05-10T14:04:11.555240+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:04:11.555240+0000","last_undegraded":"2024-05-10T14:04:11.555240+0000","last_fullsized":"2024-05-10T14:04:11.555240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378840+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:04:11.378840+0000","last_peered":"2024-05-10T14:04:11.378840+0000","last_clean":"2024-05-10T14:04:11.378840+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:04:11.378840+0000","last_undegraded":"2024-05-10T14:04:11.378840+0000","last_fullsized":"2024-05-10T14:04:11.378840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337100+0000","last_change":"2024-05-10T14:04:06.313038+0000","last_active":"2024-05-10T14:04:08.337100+0000","last_peered":"2024-05-10T14:04:08.337100+0000","last_clean":"2024-05-10T14:04:08.337100+0000","last_became_active":"2024-05-10T14:04:06.312376+0000","last_became_peered":"2024-05-10T14:04:06.312376+0000","last_unstale":"2024-05-10T14:04:08.337100+0000","last_undegraded":"2024-05-10T14:04:08.337100+0000","last_fullsized":"2024-05-10T14:04:08.337100+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:12.027586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968139+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:04:11.968139+0000","last_peered":"2024-05-10T14:04:11.968139+0000","last_clean":"2024-05-10T14:04:11.968139+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:04:11.968139+0000","last_undegraded":"2024-05-10T14:04:11.968139+0000","last_fullsized":"2024-05-10T14:04:11.968139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371761+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:04:11.371761+0000","last_peered":"2024-05-10T14:04:11.371761+0000","last_clean":"2024-05-10T14:04:11.371761+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:04:11.371761+0000","last_undegraded":"2024-05-10T14:04:11.371761+0000","last_fullsized":"2024-05-10T14:04:11.371761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371822+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:04:11.371822+0000","last_peered":"2024-05-10T14:04:11.371822+0000","last_clean":"2024-05-10T14:04:11.371822+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:04:11.371822+0000","last_undegraded":"2024-05-10T14:04:11.371822+0000","last_fullsized":"2024-05-10T14:04:11.371822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":108,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511352+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:04:09.511352+0000","last_peered":"2024-05-10T14:04:09.511352+0000","last_clean":"2024-05-10T14:04:09.511352+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:04:09.511352+0000","last_undegraded":"2024-05-10T14:04:09.511352+0000","last_fullsized":"2024-05-10T14:04:09.511352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378558+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:04:11.378558+0000","last_peered":"2024-05-10T14:04:11.378558+0000","last_clean":"2024-05-10T14:04:11.378558+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:04:11.378558+0000","last_undegraded":"2024-05-10T14:04:11.378558+0000","last_fullsized":"2024-05-10T14:04:11.378558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379334+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:04:11.379334+0000","last_peered":"2024-05-10T14:04:11.379334+0000","last_clean":"2024-05-10T14:04:11.379334+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:04:11.379334+0000","last_undegraded":"2024-05-10T14:04:11.379334+0000","last_fullsized":"2024-05-10T14:04:11.379334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380292+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:04:11.380292+0000","last_peered":"2024-05-10T14:04:11.380292+0000","last_clean":"2024-05-10T14:04:11.380292+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:04:11.380292+0000","last_undegraded":"2024-05-10T14:04:11.380292+0000","last_fullsized":"2024-05-10T14:04:11.380292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511192+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:04:09.511192+0000","last_peered":"2024-05-10T14:04:09.511192+0000","last_clean":"2024-05-10T14:04:09.511192+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:04:09.511192+0000","last_undegraded":"2024-05-10T14:04:09.511192+0000","last_fullsized":"2024-05-10T14:04:09.511192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556602+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:04:11.556602+0000","last_peered":"2024-05-10T14:04:11.556602+0000","last_clean":"2024-05-10T14:04:11.556602+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:04:11.556602+0000","last_undegraded":"2024-05-10T14:04:11.556602+0000","last_fullsized":"2024-05-10T14:04:11.556602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379216+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:04:11.379216+0000","last_peered":"2024-05-10T14:04:11.379216+0000","last_clean":"2024-05-10T14:04:11.379216+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:04:11.379216+0000","last_undegraded":"2024-05-10T14:04:11.379216+0000","last_fullsized":"2024-05-10T14:04:11.379216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960006+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:04:11.960006+0000","last_peered":"2024-05-10T14:04:11.960006+0000","last_clean":"2024-05-10T14:04:11.960006+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:04:11.960006+0000","last_undegraded":"2024-05-10T14:04:11.960006+0000","last_fullsized":"2024-05-10T14:04:11.960006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555675+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:04:11.555675+0000","last_peered":"2024-05-10T14:04:11.555675+0000","last_clean":"2024-05-10T14:04:11.555675+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:04:11.555675+0000","last_undegraded":"2024-05-10T14:04:11.555675+0000","last_fullsized":"2024-05-10T14:04:11.555675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964834+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:04:11.964834+0000","last_peered":"2024-05-10T14:04:11.964834+0000","last_clean":"2024-05-10T14:04:11.964834+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:04:11.964834+0000","last_undegraded":"2024-05-10T14:04:11.964834+0000","last_fullsized":"2024-05-10T14:04:11.964834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372971+0000","last_change":"2024-05-10T14:03:12.135289+0000","last_active":"2024-05-10T14:04:11.372971+0000","last_peered":"2024-05-10T14:04:11.372971+0000","last_clean":"2024-05-10T14:04:11.372971+0000","last_became_active":"2024-05-10T14:03:12.134860+0000","last_became_peered":"2024-05-10T14:03:12.134860+0000","last_unstale":"2024-05-10T14:04:11.372971+0000","last_undegraded":"2024-05-10T14:04:11.372971+0000","last_fullsized":"2024-05-10T14:04:11.372971+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:35.203379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334950+0000","last_change":"2024-05-10T14:04:06.317808+0000","last_active":"2024-05-10T14:04:08.334950+0000","last_peered":"2024-05-10T14:04:08.334950+0000","last_clean":"2024-05-10T14:04:08.334950+0000","last_became_active":"2024-05-10T14:04:06.316735+0000","last_became_peered":"2024-05-10T14:04:06.316735+0000","last_unstale":"2024-05-10T14:04:08.334950+0000","last_undegraded":"2024-05-10T14:04:08.334950+0000","last_fullsized":"2024-05-10T14:04:08.334950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:38:50.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554877+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:04:11.554877+0000","last_peered":"2024-05-10T14:04:11.554877+0000","last_clean":"2024-05-10T14:04:11.554877+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:04:11.554877+0000","last_undegraded":"2024-05-10T14:04:11.554877+0000","last_fullsized":"2024-05-10T14:04:11.554877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378978+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:04:11.378978+0000","last_peered":"2024-05-10T14:04:11.378978+0000","last_clean":"2024-05-10T14:04:11.378978+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:04:11.378978+0000","last_undegraded":"2024-05-10T14:04:11.378978+0000","last_fullsized":"2024-05-10T14:04:11.378978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959908+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:04:11.959908+0000","last_peered":"2024-05-10T14:04:11.959908+0000","last_clean":"2024-05-10T14:04:11.959908+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:04:11.959908+0000","last_undegraded":"2024-05-10T14:04:11.959908+0000","last_fullsized":"2024-05-10T14:04:11.959908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336271+0000","last_change":"2024-05-10T14:04:06.318434+0000","last_active":"2024-05-10T14:04:08.336271+0000","last_peered":"2024-05-10T14:04:08.336271+0000","last_clean":"2024-05-10T14:04:08.336271+0000","last_became_active":"2024-05-10T14:04:06.316104+0000","last_became_peered":"2024-05-10T14:04:06.316104+0000","last_unstale":"2024-05-10T14:04:08.336271+0000","last_undegraded":"2024-05-10T14:04:08.336271+0000","last_fullsized":"2024-05-10T14:04:08.336271+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:24.938320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":122,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379772+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:04:11.379772+0000","last_peered":"2024-05-10T14:04:11.379772+0000","last_clean":"2024-05-10T14:04:11.379772+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:04:11.379772+0000","last_undegraded":"2024-05-10T14:04:11.379772+0000","last_fullsized":"2024-05-10T14:04:11.379772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968641+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:04:11.968641+0000","last_peered":"2024-05-10T14:04:11.968641+0000","last_clean":"2024-05-10T14:04:11.968641+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:04:11.968641+0000","last_undegraded":"2024-05-10T14:04:11.968641+0000","last_fullsized":"2024-05-10T14:04:11.968641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959908+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:04:11.959908+0000","last_peered":"2024-05-10T14:04:11.959908+0000","last_clean":"2024-05-10T14:04:11.959908+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:04:11.959908+0000","last_undegraded":"2024-05-10T14:04:11.959908+0000","last_fullsized":"2024-05-10T14:04:11.959908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555170+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:04:11.555170+0000","last_peered":"2024-05-10T14:04:11.555170+0000","last_clean":"2024-05-10T14:04:11.555170+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:04:11.555170+0000","last_undegraded":"2024-05-10T14:04:11.555170+0000","last_fullsized":"2024-05-10T14:04:11.555170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959763+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:04:11.959763+0000","last_peered":"2024-05-10T14:04:11.959763+0000","last_clean":"2024-05-10T14:04:11.959763+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:04:11.959763+0000","last_undegraded":"2024-05-10T14:04:11.959763+0000","last_fullsized":"2024-05-10T14:04:11.959763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961757+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:04:11.961757+0000","last_peered":"2024-05-10T14:04:11.961757+0000","last_clean":"2024-05-10T14:04:11.961757+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:04:11.961757+0000","last_undegraded":"2024-05-10T14:04:11.961757+0000","last_fullsized":"2024-05-10T14:04:11.961757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379929+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:04:11.379929+0000","last_peered":"2024-05-10T14:04:11.379929+0000","last_clean":"2024-05-10T14:04:11.379929+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:04:11.379929+0000","last_undegraded":"2024-05-10T14:04:11.379929+0000","last_fullsized":"2024-05-10T14:04:11.379929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968740+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:04:11.968740+0000","last_peered":"2024-05-10T14:04:11.968740+0000","last_clean":"2024-05-10T14:04:11.968740+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:04:11.968740+0000","last_undegraded":"2024-05-10T14:04:11.968740+0000","last_fullsized":"2024-05-10T14:04:11.968740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511961+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:04:09.511961+0000","last_peered":"2024-05-10T14:04:09.511961+0000","last_clean":"2024-05-10T14:04:09.511961+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:04:09.511961+0000","last_undegraded":"2024-05-10T14:04:09.511961+0000","last_fullsized":"2024-05-10T14:04:09.511961+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335830+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:04:08.335830+0000","last_peered":"2024-05-10T14:04:08.335830+0000","last_clean":"2024-05-10T14:04:08.335830+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:04:08.335830+0000","last_undegraded":"2024-05-10T14:04:08.335830+0000","last_fullsized":"2024-05-10T14:04:08.335830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378737+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:04:11.378737+0000","last_peered":"2024-05-10T14:04:11.378737+0000","last_clean":"2024-05-10T14:04:11.378737+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:04:11.378737+0000","last_undegraded":"2024-05-10T14:04:11.378737+0000","last_fullsized":"2024-05-10T14:04:11.378737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968884+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:04:11.968884+0000","last_peered":"2024-05-10T14:04:11.968884+0000","last_clean":"2024-05-10T14:04:11.968884+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:04:11.968884+0000","last_undegraded":"2024-05-10T14:04:11.968884+0000","last_fullsized":"2024-05-10T14:04:11.968884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510797+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:04:09.510797+0000","last_peered":"2024-05-10T14:04:09.510797+0000","last_clean":"2024-05-10T14:04:09.510797+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:04:09.510797+0000","last_undegraded":"2024-05-10T14:04:09.510797+0000","last_fullsized":"2024-05-10T14:04:09.510797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961574+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:04:11.961574+0000","last_peered":"2024-05-10T14:04:11.961574+0000","last_clean":"2024-05-10T14:04:11.961574+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:04:11.961574+0000","last_undegraded":"2024-05-10T14:04:11.961574+0000","last_fullsized":"2024-05-10T14:04:11.961574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555289+0000","last_change":"2024-05-10T14:04:06.320142+0000","last_active":"2024-05-10T14:04:11.555289+0000","last_peered":"2024-05-10T14:04:11.555289+0000","last_clean":"2024-05-10T14:04:11.555289+0000","last_became_active":"2024-05-10T14:04:06.319511+0000","last_became_peered":"2024-05-10T14:04:06.319511+0000","last_unstale":"2024-05-10T14:04:11.555289+0000","last_undegraded":"2024-05-10T14:04:11.555289+0000","last_fullsized":"2024-05-10T14:04:11.555289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:48.192016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512155+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:04:09.512155+0000","last_peered":"2024-05-10T14:04:09.512155+0000","last_clean":"2024-05-10T14:04:09.512155+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:04:09.512155+0000","last_undegraded":"2024-05-10T14:04:09.512155+0000","last_fullsized":"2024-05-10T14:04:09.512155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959768+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:04:11.959768+0000","last_peered":"2024-05-10T14:04:11.959768+0000","last_clean":"2024-05-10T14:04:11.959768+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:04:11.959768+0000","last_undegraded":"2024-05-10T14:04:11.959768+0000","last_fullsized":"2024-05-10T14:04:11.959768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381345+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:04:11.381345+0000","last_peered":"2024-05-10T14:04:11.381345+0000","last_clean":"2024-05-10T14:04:11.381345+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:04:11.381345+0000","last_undegraded":"2024-05-10T14:04:11.381345+0000","last_fullsized":"2024-05-10T14:04:11.381345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372381+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:04:11.372381+0000","last_peered":"2024-05-10T14:04:11.372381+0000","last_clean":"2024-05-10T14:04:11.372381+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:04:11.372381+0000","last_undegraded":"2024-05-10T14:04:11.372381+0000","last_fullsized":"2024-05-10T14:04:11.372381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372926+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:04:11.372926+0000","last_peered":"2024-05-10T14:04:11.372926+0000","last_clean":"2024-05-10T14:04:11.372926+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:04:11.372926+0000","last_undegraded":"2024-05-10T14:04:11.372926+0000","last_fullsized":"2024-05-10T14:04:11.372926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381377+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:04:11.381377+0000","last_peered":"2024-05-10T14:04:11.381377+0000","last_clean":"2024-05-10T14:04:11.381377+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:04:11.381377+0000","last_undegraded":"2024-05-10T14:04:11.381377+0000","last_fullsized":"2024-05-10T14:04:11.381377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511839+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:04:09.511839+0000","last_peered":"2024-05-10T14:04:09.511839+0000","last_clean":"2024-05-10T14:04:09.511839+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:04:09.511839+0000","last_undegraded":"2024-05-10T14:04:09.511839+0000","last_fullsized":"2024-05-10T14:04:09.511839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335216+0000","last_change":"2024-05-10T14:04:06.301776+0000","last_active":"2024-05-10T14:04:08.335216+0000","last_peered":"2024-05-10T14:04:08.335216+0000","last_clean":"2024-05-10T14:04:08.335216+0000","last_became_active":"2024-05-10T14:04:06.300995+0000","last_became_peered":"2024-05-10T14:04:06.300995+0000","last_unstale":"2024-05-10T14:04:08.335216+0000","last_undegraded":"2024-05-10T14:04:08.335216+0000","last_fullsized":"2024-05-10T14:04:08.335216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:57.842680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372700+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:04:11.372700+0000","last_peered":"2024-05-10T14:04:11.372700+0000","last_clean":"2024-05-10T14:04:11.372700+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:04:11.372700+0000","last_undegraded":"2024-05-10T14:04:11.372700+0000","last_fullsized":"2024-05-10T14:04:11.372700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966277+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:04:11.966277+0000","last_peered":"2024-05-10T14:04:11.966277+0000","last_clean":"2024-05-10T14:04:11.966277+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:04:11.966277+0000","last_undegraded":"2024-05-10T14:04:11.966277+0000","last_fullsized":"2024-05-10T14:04:11.966277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":101,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512327+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:04:09.512327+0000","last_peered":"2024-05-10T14:04:09.512327+0000","last_clean":"2024-05-10T14:04:09.512327+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:04:09.512327+0000","last_undegraded":"2024-05-10T14:04:09.512327+0000","last_fullsized":"2024-05-10T14:04:09.512327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372994+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:04:11.372994+0000","last_peered":"2024-05-10T14:04:11.372994+0000","last_clean":"2024-05-10T14:04:11.372994+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:04:11.372994+0000","last_undegraded":"2024-05-10T14:04:11.372994+0000","last_fullsized":"2024-05-10T14:04:11.372994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961115+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:04:11.961115+0000","last_peered":"2024-05-10T14:04:11.961115+0000","last_clean":"2024-05-10T14:04:11.961115+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:04:11.961115+0000","last_undegraded":"2024-05-10T14:04:11.961115+0000","last_fullsized":"2024-05-10T14:04:11.961115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554856+0000","last_change":"2024-05-10T14:04:06.307890+0000","last_active":"2024-05-10T14:04:11.554856+0000","last_peered":"2024-05-10T14:04:11.554856+0000","last_clean":"2024-05-10T14:04:11.554856+0000","last_became_active":"2024-05-10T14:04:06.307224+0000","last_became_peered":"2024-05-10T14:04:06.307224+0000","last_unstale":"2024-05-10T14:04:11.554856+0000","last_undegraded":"2024-05-10T14:04:11.554856+0000","last_fullsized":"2024-05-10T14:04:11.554856+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:37.194547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371669+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:04:11.371669+0000","last_peered":"2024-05-10T14:04:11.371669+0000","last_clean":"2024-05-10T14:04:11.371669+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:04:11.371669+0000","last_undegraded":"2024-05-10T14:04:11.371669+0000","last_fullsized":"2024-05-10T14:04:11.371669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334677+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:04:08.334677+0000","last_peered":"2024-05-10T14:04:08.334677+0000","last_clean":"2024-05-10T14:04:08.334677+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:04:08.334677+0000","last_undegraded":"2024-05-10T14:04:08.334677+0000","last_fullsized":"2024-05-10T14:04:08.334677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555367+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:04:11.555367+0000","last_peered":"2024-05-10T14:04:11.555367+0000","last_clean":"2024-05-10T14:04:11.555367+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:04:11.555367+0000","last_undegraded":"2024-05-10T14:04:11.555367+0000","last_fullsized":"2024-05-10T14:04:11.555367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":60,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334821+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:04:08.334821+0000","last_peered":"2024-05-10T14:04:08.334821+0000","last_clean":"2024-05-10T14:04:08.334821+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:04:08.334821+0000","last_undegraded":"2024-05-10T14:04:08.334821+0000","last_fullsized":"2024-05-10T14:04:08.334821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959631+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:04:11.959631+0000","last_peered":"2024-05-10T14:04:11.959631+0000","last_clean":"2024-05-10T14:04:11.959631+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:04:11.959631+0000","last_undegraded":"2024-05-10T14:04:11.959631+0000","last_fullsized":"2024-05-10T14:04:11.959631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556787+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:04:11.556787+0000","last_peered":"2024-05-10T14:04:11.556787+0000","last_clean":"2024-05-10T14:04:11.556787+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:04:11.556787+0000","last_undegraded":"2024-05-10T14:04:11.556787+0000","last_fullsized":"2024-05-10T14:04:11.556787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372079+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:04:11.372079+0000","last_peered":"2024-05-10T14:04:11.372079+0000","last_clean":"2024-05-10T14:04:11.372079+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:04:11.372079+0000","last_undegraded":"2024-05-10T14:04:11.372079+0000","last_fullsized":"2024-05-10T14:04:11.372079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336262+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:04:08.336262+0000","last_peered":"2024-05-10T14:04:08.336262+0000","last_clean":"2024-05-10T14:04:08.336262+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:04:08.336262+0000","last_undegraded":"2024-05-10T14:04:08.336262+0000","last_fullsized":"2024-05-10T14:04:08.336262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334791+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:04:08.334791+0000","last_peered":"2024-05-10T14:04:08.334791+0000","last_clean":"2024-05-10T14:04:08.334791+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:04:08.334791+0000","last_undegraded":"2024-05-10T14:04:08.334791+0000","last_fullsized":"2024-05-10T14:04:08.334791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959750+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:04:11.959750+0000","last_peered":"2024-05-10T14:04:11.959750+0000","last_clean":"2024-05-10T14:04:11.959750+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:04:11.959750+0000","last_undegraded":"2024-05-10T14:04:11.959750+0000","last_fullsized":"2024-05-10T14:04:11.959750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959638+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:04:11.959638+0000","last_peered":"2024-05-10T14:04:11.959638+0000","last_clean":"2024-05-10T14:04:11.959638+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:04:11.959638+0000","last_undegraded":"2024-05-10T14:04:11.959638+0000","last_fullsized":"2024-05-10T14:04:11.959638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380382+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:04:11.380382+0000","last_peered":"2024-05-10T14:04:11.380382+0000","last_clean":"2024-05-10T14:04:11.380382+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:04:11.380382+0000","last_undegraded":"2024-05-10T14:04:11.380382+0000","last_fullsized":"2024-05-10T14:04:11.380382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379146+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:04:11.379146+0000","last_peered":"2024-05-10T14:04:11.379146+0000","last_clean":"2024-05-10T14:04:11.379146+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:04:11.379146+0000","last_undegraded":"2024-05-10T14:04:11.379146+0000","last_fullsized":"2024-05-10T14:04:11.379146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380739+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:04:11.380739+0000","last_peered":"2024-05-10T14:04:11.380739+0000","last_clean":"2024-05-10T14:04:11.380739+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:04:11.380739+0000","last_undegraded":"2024-05-10T14:04:11.380739+0000","last_fullsized":"2024-05-10T14:04:11.380739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371098+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:04:11.371098+0000","last_peered":"2024-05-10T14:04:11.371098+0000","last_clean":"2024-05-10T14:04:11.371098+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:04:11.371098+0000","last_undegraded":"2024-05-10T14:04:11.371098+0000","last_fullsized":"2024-05-10T14:04:11.371098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379702+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:04:11.379702+0000","last_peered":"2024-05-10T14:04:11.379702+0000","last_clean":"2024-05-10T14:04:11.379702+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:04:11.379702+0000","last_undegraded":"2024-05-10T14:04:11.379702+0000","last_fullsized":"2024-05-10T14:04:11.379702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371423+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:04:11.371423+0000","last_peered":"2024-05-10T14:04:11.371423+0000","last_clean":"2024-05-10T14:04:11.371423+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:04:11.371423+0000","last_undegraded":"2024-05-10T14:04:11.371423+0000","last_fullsized":"2024-05-10T14:04:11.371423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556106+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:04:11.556106+0000","last_peered":"2024-05-10T14:04:11.556106+0000","last_clean":"2024-05-10T14:04:11.556106+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:04:11.556106+0000","last_undegraded":"2024-05-10T14:04:11.556106+0000","last_fullsized":"2024-05-10T14:04:11.556106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371361+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:04:11.371361+0000","last_peered":"2024-05-10T14:04:11.371361+0000","last_clean":"2024-05-10T14:04:11.371361+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:04:11.371361+0000","last_undegraded":"2024-05-10T14:04:11.371361+0000","last_fullsized":"2024-05-10T14:04:11.371361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968556+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:04:11.968556+0000","last_peered":"2024-05-10T14:04:11.968556+0000","last_clean":"2024-05-10T14:04:11.968556+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:04:11.968556+0000","last_undegraded":"2024-05-10T14:04:11.968556+0000","last_fullsized":"2024-05-10T14:04:11.968556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510308+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:04:09.510308+0000","last_peered":"2024-05-10T14:04:09.510308+0000","last_clean":"2024-05-10T14:04:09.510308+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:04:09.510308+0000","last_undegraded":"2024-05-10T14:04:09.510308+0000","last_fullsized":"2024-05-10T14:04:09.510308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371599+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:04:11.371599+0000","last_peered":"2024-05-10T14:04:11.371599+0000","last_clean":"2024-05-10T14:04:11.371599+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:04:11.371599+0000","last_undegraded":"2024-05-10T14:04:11.371599+0000","last_fullsized":"2024-05-10T14:04:11.371599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959631+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:04:11.959631+0000","last_peered":"2024-05-10T14:04:11.959631+0000","last_clean":"2024-05-10T14:04:11.959631+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:04:11.959631+0000","last_undegraded":"2024-05-10T14:04:11.959631+0000","last_fullsized":"2024-05-10T14:04:11.959631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372990+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:04:11.372990+0000","last_peered":"2024-05-10T14:04:11.372990+0000","last_clean":"2024-05-10T14:04:11.372990+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:04:11.372990+0000","last_undegraded":"2024-05-10T14:04:11.372990+0000","last_fullsized":"2024-05-10T14:04:11.372990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512900+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:04:09.512900+0000","last_peered":"2024-05-10T14:04:09.512900+0000","last_clean":"2024-05-10T14:04:09.512900+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:04:09.512900+0000","last_undegraded":"2024-05-10T14:04:09.512900+0000","last_fullsized":"2024-05-10T14:04:09.512900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959535+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:04:11.959535+0000","last_peered":"2024-05-10T14:04:11.959535+0000","last_clean":"2024-05-10T14:04:11.959535+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:04:11.959535+0000","last_undegraded":"2024-05-10T14:04:11.959535+0000","last_fullsized":"2024-05-10T14:04:11.959535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512853+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:04:09.512853+0000","last_peered":"2024-05-10T14:04:09.512853+0000","last_clean":"2024-05-10T14:04:09.512853+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:04:09.512853+0000","last_undegraded":"2024-05-10T14:04:09.512853+0000","last_fullsized":"2024-05-10T14:04:09.512853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373700+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:04:11.373700+0000","last_peered":"2024-05-10T14:04:11.373700+0000","last_clean":"2024-05-10T14:04:11.373700+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:04:11.373700+0000","last_undegraded":"2024-05-10T14:04:11.373700+0000","last_fullsized":"2024-05-10T14:04:11.373700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336683+0000","last_change":"2024-05-10T14:04:06.323058+0000","last_active":"2024-05-10T14:04:08.336683+0000","last_peered":"2024-05-10T14:04:08.336683+0000","last_clean":"2024-05-10T14:04:08.336683+0000","last_became_active":"2024-05-10T14:04:06.318770+0000","last_became_peered":"2024-05-10T14:04:06.318770+0000","last_unstale":"2024-05-10T14:04:08.336683+0000","last_undegraded":"2024-05-10T14:04:08.336683+0000","last_fullsized":"2024-05-10T14:04:08.336683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:29:58.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334358+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:04:08.334358+0000","last_peered":"2024-05-10T14:04:08.334358+0000","last_clean":"2024-05-10T14:04:08.334358+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:04:08.334358+0000","last_undegraded":"2024-05-10T14:04:08.334358+0000","last_fullsized":"2024-05-10T14:04:08.334358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511976+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:04:09.511976+0000","last_peered":"2024-05-10T14:04:09.511976+0000","last_clean":"2024-05-10T14:04:09.511976+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:04:09.511976+0000","last_undegraded":"2024-05-10T14:04:09.511976+0000","last_fullsized":"2024-05-10T14:04:09.511976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966457+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:04:11.966457+0000","last_peered":"2024-05-10T14:04:11.966457+0000","last_clean":"2024-05-10T14:04:11.966457+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:04:11.966457+0000","last_undegraded":"2024-05-10T14:04:11.966457+0000","last_fullsized":"2024-05-10T14:04:11.966457+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379386+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:04:11.379386+0000","last_peered":"2024-05-10T14:04:11.379386+0000","last_clean":"2024-05-10T14:04:11.379386+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:04:11.379386+0000","last_undegraded":"2024-05-10T14:04:11.379386+0000","last_fullsized":"2024-05-10T14:04:11.379386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381514+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:04:11.381514+0000","last_peered":"2024-05-10T14:04:11.381514+0000","last_clean":"2024-05-10T14:04:11.381514+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:04:11.381514+0000","last_undegraded":"2024-05-10T14:04:11.381514+0000","last_fullsized":"2024-05-10T14:04:11.381514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372260+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:04:11.372260+0000","last_peered":"2024-05-10T14:04:11.372260+0000","last_clean":"2024-05-10T14:04:11.372260+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:04:11.372260+0000","last_undegraded":"2024-05-10T14:04:11.372260+0000","last_fullsized":"2024-05-10T14:04:11.372260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512544+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:04:09.512544+0000","last_peered":"2024-05-10T14:04:09.512544+0000","last_clean":"2024-05-10T14:04:09.512544+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:04:09.512544+0000","last_undegraded":"2024-05-10T14:04:09.512544+0000","last_fullsized":"2024-05-10T14:04:09.512544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379016+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:04:11.379016+0000","last_peered":"2024-05-10T14:04:11.379016+0000","last_clean":"2024-05-10T14:04:11.379016+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:04:11.379016+0000","last_undegraded":"2024-05-10T14:04:11.379016+0000","last_fullsized":"2024-05-10T14:04:11.379016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961850+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:04:11.961850+0000","last_peered":"2024-05-10T14:04:11.961850+0000","last_clean":"2024-05-10T14:04:11.961850+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:04:11.961850+0000","last_undegraded":"2024-05-10T14:04:11.961850+0000","last_fullsized":"2024-05-10T14:04:11.961850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959384+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:04:11.959384+0000","last_peered":"2024-05-10T14:04:11.959384+0000","last_clean":"2024-05-10T14:04:11.959384+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:04:11.959384+0000","last_undegraded":"2024-05-10T14:04:11.959384+0000","last_fullsized":"2024-05-10T14:04:11.959384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381189+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:04:11.381189+0000","last_peered":"2024-05-10T14:04:11.381189+0000","last_clean":"2024-05-10T14:04:11.381189+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:04:11.381189+0000","last_undegraded":"2024-05-10T14:04:11.381189+0000","last_fullsized":"2024-05-10T14:04:11.381189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968471+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:04:11.968471+0000","last_peered":"2024-05-10T14:04:11.968471+0000","last_clean":"2024-05-10T14:04:11.968471+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:04:11.968471+0000","last_undegraded":"2024-05-10T14:04:11.968471+0000","last_fullsized":"2024-05-10T14:04:11.968471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.333854+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:04:08.333854+0000","last_peered":"2024-05-10T14:04:08.333854+0000","last_clean":"2024-05-10T14:04:08.333854+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:04:08.333854+0000","last_undegraded":"2024-05-10T14:04:08.333854+0000","last_fullsized":"2024-05-10T14:04:08.333854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373351+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:04:11.373351+0000","last_peered":"2024-05-10T14:04:11.373351+0000","last_clean":"2024-05-10T14:04:11.373351+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:04:11.373351+0000","last_undegraded":"2024-05-10T14:04:11.373351+0000","last_fullsized":"2024-05-10T14:04:11.373351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379228+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:04:11.379228+0000","last_peered":"2024-05-10T14:04:11.379228+0000","last_clean":"2024-05-10T14:04:11.379228+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:04:11.379228+0000","last_undegraded":"2024-05-10T14:04:11.379228+0000","last_fullsized":"2024-05-10T14:04:11.379228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375435+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:04:11.375435+0000","last_peered":"2024-05-10T14:04:11.375435+0000","last_clean":"2024-05-10T14:04:11.375435+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:04:11.375435+0000","last_undegraded":"2024-05-10T14:04:11.375435+0000","last_fullsized":"2024-05-10T14:04:11.375435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373218+0000","last_change":"2024-05-10T14:03:12.136220+0000","last_active":"2024-05-10T14:04:11.373218+0000","last_peered":"2024-05-10T14:04:11.373218+0000","last_clean":"2024-05-10T14:04:11.373218+0000","last_became_active":"2024-05-10T14:03:12.135794+0000","last_became_peered":"2024-05-10T14:03:12.135794+0000","last_unstale":"2024-05-10T14:04:11.373218+0000","last_undegraded":"2024-05-10T14:04:11.373218+0000","last_fullsized":"2024-05-10T14:04:11.373218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:28.642294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372658+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:04:11.372658+0000","last_peered":"2024-05-10T14:04:11.372658+0000","last_clean":"2024-05-10T14:04:11.372658+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:04:11.372658+0000","last_undegraded":"2024-05-10T14:04:11.372658+0000","last_fullsized":"2024-05-10T14:04:11.372658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966643+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:04:11.966643+0000","last_peered":"2024-05-10T14:04:11.966643+0000","last_clean":"2024-05-10T14:04:11.966643+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:04:11.966643+0000","last_undegraded":"2024-05-10T14:04:11.966643+0000","last_fullsized":"2024-05-10T14:04:11.966643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555815+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:04:11.555815+0000","last_peered":"2024-05-10T14:04:11.555815+0000","last_clean":"2024-05-10T14:04:11.555815+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:04:11.555815+0000","last_undegraded":"2024-05-10T14:04:11.555815+0000","last_fullsized":"2024-05-10T14:04:11.555815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961241+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:04:11.961241+0000","last_peered":"2024-05-10T14:04:11.961241+0000","last_clean":"2024-05-10T14:04:11.961241+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:04:11.961241+0000","last_undegraded":"2024-05-10T14:04:11.961241+0000","last_fullsized":"2024-05-10T14:04:11.961241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961208+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:04:11.961208+0000","last_peered":"2024-05-10T14:04:11.961208+0000","last_clean":"2024-05-10T14:04:11.961208+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:04:11.961208+0000","last_undegraded":"2024-05-10T14:04:11.961208+0000","last_fullsized":"2024-05-10T14:04:11.961208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556760+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:04:11.556760+0000","last_peered":"2024-05-10T14:04:11.556760+0000","last_clean":"2024-05-10T14:04:11.556760+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:04:11.556760+0000","last_undegraded":"2024-05-10T14:04:11.556760+0000","last_fullsized":"2024-05-10T14:04:11.556760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378929+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:04:11.378929+0000","last_peered":"2024-05-10T14:04:11.378929+0000","last_clean":"2024-05-10T14:04:11.378929+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:04:11.378929+0000","last_undegraded":"2024-05-10T14:04:11.378929+0000","last_fullsized":"2024-05-10T14:04:11.378929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.376100+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:04:11.376100+0000","last_peered":"2024-05-10T14:04:11.376100+0000","last_clean":"2024-05-10T14:04:11.376100+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:04:11.376100+0000","last_undegraded":"2024-05-10T14:04:11.376100+0000","last_fullsized":"2024-05-10T14:04:11.376100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555064+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:04:11.555064+0000","last_peered":"2024-05-10T14:04:11.555064+0000","last_clean":"2024-05-10T14:04:11.555064+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:04:11.555064+0000","last_undegraded":"2024-05-10T14:04:11.555064+0000","last_fullsized":"2024-05-10T14:04:11.555064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336151+0000","last_change":"2024-05-10T14:04:06.322414+0000","last_active":"2024-05-10T14:04:08.336151+0000","last_peered":"2024-05-10T14:04:08.336151+0000","last_clean":"2024-05-10T14:04:08.336151+0000","last_became_active":"2024-05-10T14:04:06.321836+0000","last_became_peered":"2024-05-10T14:04:06.321836+0000","last_unstale":"2024-05-10T14:04:08.336151+0000","last_undegraded":"2024-05-10T14:04:08.336151+0000","last_fullsized":"2024-05-10T14:04:08.336151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:57:29.756774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334141+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:04:08.334141+0000","last_peered":"2024-05-10T14:04:08.334141+0000","last_clean":"2024-05-10T14:04:08.334141+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:04:08.334141+0000","last_undegraded":"2024-05-10T14:04:08.334141+0000","last_fullsized":"2024-05-10T14:04:08.334141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968383+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:04:11.968383+0000","last_peered":"2024-05-10T14:04:11.968383+0000","last_clean":"2024-05-10T14:04:11.968383+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:04:11.968383+0000","last_undegraded":"2024-05-10T14:04:11.968383+0000","last_fullsized":"2024-05-10T14:04:11.968383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510674+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:04:09.510674+0000","last_peered":"2024-05-10T14:04:09.510674+0000","last_clean":"2024-05-10T14:04:09.510674+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:04:09.510674+0000","last_undegraded":"2024-05-10T14:04:09.510674+0000","last_fullsized":"2024-05-10T14:04:09.510674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336660+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:04:08.336660+0000","last_peered":"2024-05-10T14:04:08.336660+0000","last_clean":"2024-05-10T14:04:08.336660+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:04:08.336660+0000","last_undegraded":"2024-05-10T14:04:08.336660+0000","last_fullsized":"2024-05-10T14:04:08.336660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":685,"num_read_kb":444,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":390,"ondisk_log_size":390,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1082621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":492029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710722,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":925696,"data_stored":469966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":492084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335588,"statfs":{"total":96636764160,"available":96599642112,"internally_reserved":0,"allocated":929792,"data_stored":491989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":901120,"data_stored":491155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1503232,"data_stored":1074647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":905216,"data_stored":476211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:04:13.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:04:13.951 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:13.951+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:13.956 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:13.956 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:13.956 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:13.957 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:13.957 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:13.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:14.063 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:14.063+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:14.150 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:14.148+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.440795949999995, 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.440703479000007, 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.470458620000002, 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.428216499000001, 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.388917032999998, 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.381912616999998, 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.374306834999999, 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.317030828, 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.305913251999996, 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.181073722999997, 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.085418562000001, 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.081280289999995, 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.048528567000005, 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.883846367999993, 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.826639659999998, 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.684462952999993, 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.663777327000005, 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.657221187000005, 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.572276719000001, 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.565353880000004, 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:14.297 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:14.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:14.299 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:14.296+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:14.351 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:04:14.357 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:04:14.371 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-05-10T14:04:14.135759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":752,"num_read_kb":500,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":487,"ondisk_log_size":487,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266624,"kb_used_data":8320,"kb_used_omap":15,"kb_used_meta":258160,"kb_avail":754708096,"statfs":{"total":773094113280,"available":772821090304,"internally_reserved":0,"allocated":8519680,"data_stored":5070702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":264356509},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001321"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555940+0000","last_change":"2024-05-10T14:02:30.676868+0000","last_active":"2024-05-10T14:04:11.555940+0000","last_peered":"2024-05-10T14:04:11.555940+0000","last_clean":"2024-05-10T14:04:11.555940+0000","last_became_active":"2024-05-10T14:02:30.676029+0000","last_became_peered":"2024-05-10T14:02:30.676029+0000","last_unstale":"2024-05-10T14:04:11.555940+0000","last_undegraded":"2024-05-10T14:04:11.555940+0000","last_fullsized":"2024-05-10T14:04:11.555940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:46.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335013+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:04:08.335013+0000","last_peered":"2024-05-10T14:04:08.335013+0000","last_clean":"2024-05-10T14:04:08.335013+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:04:08.335013+0000","last_undegraded":"2024-05-10T14:04:08.335013+0000","last_fullsized":"2024-05-10T14:04:08.335013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512985+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:04:09.512985+0000","last_peered":"2024-05-10T14:04:09.512985+0000","last_clean":"2024-05-10T14:04:09.512985+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:04:09.512985+0000","last_undegraded":"2024-05-10T14:04:09.512985+0000","last_fullsized":"2024-05-10T14:04:09.512985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555851+0000","last_change":"2024-05-10T14:02:32.693060+0000","last_active":"2024-05-10T14:04:11.555851+0000","last_peered":"2024-05-10T14:04:11.555851+0000","last_clean":"2024-05-10T14:04:11.555851+0000","last_became_active":"2024-05-10T14:02:32.692461+0000","last_became_peered":"2024-05-10T14:02:32.692461+0000","last_unstale":"2024-05-10T14:04:11.555851+0000","last_undegraded":"2024-05-10T14:04:11.555851+0000","last_fullsized":"2024-05-10T14:04:11.555851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965076+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:04:11.965076+0000","last_peered":"2024-05-10T14:04:11.965076+0000","last_clean":"2024-05-10T14:04:11.965076+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:04:11.965076+0000","last_undegraded":"2024-05-10T14:04:11.965076+0000","last_fullsized":"2024-05-10T14:04:11.965076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371950+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:04:11.371950+0000","last_peered":"2024-05-10T14:04:11.371950+0000","last_clean":"2024-05-10T14:04:11.371950+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:04:11.371950+0000","last_undegraded":"2024-05-10T14:04:11.371950+0000","last_fullsized":"2024-05-10T14:04:11.371950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335108+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:04:08.335108+0000","last_peered":"2024-05-10T14:04:08.335108+0000","last_clean":"2024-05-10T14:04:08.335108+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:04:08.335108+0000","last_undegraded":"2024-05-10T14:04:08.335108+0000","last_fullsized":"2024-05-10T14:04:08.335108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966370+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:04:11.966370+0000","last_peered":"2024-05-10T14:04:11.966370+0000","last_clean":"2024-05-10T14:04:11.966370+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:04:11.966370+0000","last_undegraded":"2024-05-10T14:04:11.966370+0000","last_fullsized":"2024-05-10T14:04:11.966370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556082+0000","last_change":"2024-05-10T14:02:30.656257+0000","last_active":"2024-05-10T14:04:11.556082+0000","last_peered":"2024-05-10T14:04:11.556082+0000","last_clean":"2024-05-10T14:04:11.556082+0000","last_became_active":"2024-05-10T14:02:30.650465+0000","last_became_peered":"2024-05-10T14:02:30.650465+0000","last_unstale":"2024-05-10T14:04:11.556082+0000","last_undegraded":"2024-05-10T14:04:11.556082+0000","last_fullsized":"2024-05-10T14:04:11.556082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961083+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:04:11.961083+0000","last_peered":"2024-05-10T14:04:11.961083+0000","last_clean":"2024-05-10T14:04:11.961083+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:04:11.961083+0000","last_undegraded":"2024-05-10T14:04:11.961083+0000","last_fullsized":"2024-05-10T14:04:11.961083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334970+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:04:08.334970+0000","last_peered":"2024-05-10T14:04:08.334970+0000","last_clean":"2024-05-10T14:04:08.334970+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:04:08.334970+0000","last_undegraded":"2024-05-10T14:04:08.334970+0000","last_fullsized":"2024-05-10T14:04:08.334970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372684+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:04:11.372684+0000","last_peered":"2024-05-10T14:04:11.372684+0000","last_clean":"2024-05-10T14:04:11.372684+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:04:11.372684+0000","last_undegraded":"2024-05-10T14:04:11.372684+0000","last_fullsized":"2024-05-10T14:04:11.372684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556592+0000","last_change":"2024-05-10T14:02:30.656306+0000","last_active":"2024-05-10T14:04:11.556592+0000","last_peered":"2024-05-10T14:04:11.556592+0000","last_clean":"2024-05-10T14:04:11.556592+0000","last_became_active":"2024-05-10T14:02:30.651045+0000","last_became_peered":"2024-05-10T14:02:30.651045+0000","last_unstale":"2024-05-10T14:04:11.556592+0000","last_undegraded":"2024-05-10T14:04:11.556592+0000","last_fullsized":"2024-05-10T14:04:11.556592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335658+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:04:08.335658+0000","last_peered":"2024-05-10T14:04:08.335658+0000","last_clean":"2024-05-10T14:04:08.335658+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:04:08.335658+0000","last_undegraded":"2024-05-10T14:04:08.335658+0000","last_fullsized":"2024-05-10T14:04:08.335658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379851+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:04:11.379851+0000","last_peered":"2024-05-10T14:04:11.379851+0000","last_clean":"2024-05-10T14:04:11.379851+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:04:11.379851+0000","last_undegraded":"2024-05-10T14:04:11.379851+0000","last_fullsized":"2024-05-10T14:04:11.379851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.376344+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:04:11.376344+0000","last_peered":"2024-05-10T14:04:11.376344+0000","last_clean":"2024-05-10T14:04:11.376344+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:04:11.376344+0000","last_undegraded":"2024-05-10T14:04:11.376344+0000","last_fullsized":"2024-05-10T14:04:11.376344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371299+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:04:11.371299+0000","last_peered":"2024-05-10T14:04:11.371299+0000","last_clean":"2024-05-10T14:04:11.371299+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:04:11.371299+0000","last_undegraded":"2024-05-10T14:04:11.371299+0000","last_fullsized":"2024-05-10T14:04:11.371299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556056+0000","last_change":"2024-05-10T14:04:06.324566+0000","last_active":"2024-05-10T14:04:11.556056+0000","last_peered":"2024-05-10T14:04:11.556056+0000","last_clean":"2024-05-10T14:04:11.556056+0000","last_became_active":"2024-05-10T14:04:06.324028+0000","last_became_peered":"2024-05-10T14:04:06.324028+0000","last_unstale":"2024-05-10T14:04:11.556056+0000","last_undegraded":"2024-05-10T14:04:11.556056+0000","last_fullsized":"2024-05-10T14:04:11.556056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:15.231846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556527+0000","last_change":"2024-05-10T14:02:32.694708+0000","last_active":"2024-05-10T14:04:11.556527+0000","last_peered":"2024-05-10T14:04:11.556527+0000","last_clean":"2024-05-10T14:04:11.556527+0000","last_became_active":"2024-05-10T14:02:32.693930+0000","last_became_peered":"2024-05-10T14:02:32.693930+0000","last_unstale":"2024-05-10T14:04:11.556527+0000","last_undegraded":"2024-05-10T14:04:11.556527+0000","last_fullsized":"2024-05-10T14:04:11.556527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961499+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:04:11.961499+0000","last_peered":"2024-05-10T14:04:11.961499+0000","last_clean":"2024-05-10T14:04:11.961499+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:04:11.961499+0000","last_undegraded":"2024-05-10T14:04:11.961499+0000","last_fullsized":"2024-05-10T14:04:11.961499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337127+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:04:08.337127+0000","last_peered":"2024-05-10T14:04:08.337127+0000","last_clean":"2024-05-10T14:04:08.337127+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:04:08.337127+0000","last_undegraded":"2024-05-10T14:04:08.337127+0000","last_fullsized":"2024-05-10T14:04:08.337127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.963565+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:04:11.963565+0000","last_peered":"2024-05-10T14:04:11.963565+0000","last_clean":"2024-05-10T14:04:11.963565+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:04:11.963565+0000","last_undegraded":"2024-05-10T14:04:11.963565+0000","last_fullsized":"2024-05-10T14:04:11.963565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372242+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:04:11.372242+0000","last_peered":"2024-05-10T14:04:11.372242+0000","last_clean":"2024-05-10T14:04:11.372242+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:04:11.372242+0000","last_undegraded":"2024-05-10T14:04:11.372242+0000","last_fullsized":"2024-05-10T14:04:11.372242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372090+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:04:11.372090+0000","last_peered":"2024-05-10T14:04:11.372090+0000","last_clean":"2024-05-10T14:04:11.372090+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:04:11.372090+0000","last_undegraded":"2024-05-10T14:04:11.372090+0000","last_fullsized":"2024-05-10T14:04:11.372090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372582+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:04:11.372582+0000","last_peered":"2024-05-10T14:04:11.372582+0000","last_clean":"2024-05-10T14:04:11.372582+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:04:11.372582+0000","last_undegraded":"2024-05-10T14:04:11.372582+0000","last_fullsized":"2024-05-10T14:04:11.372582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379127+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:04:11.379127+0000","last_peered":"2024-05-10T14:04:11.379127+0000","last_clean":"2024-05-10T14:04:11.379127+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:04:11.379127+0000","last_undegraded":"2024-05-10T14:04:11.379127+0000","last_fullsized":"2024-05-10T14:04:11.379127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372684+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:04:11.372684+0000","last_peered":"2024-05-10T14:04:11.372684+0000","last_clean":"2024-05-10T14:04:11.372684+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:04:11.372684+0000","last_undegraded":"2024-05-10T14:04:11.372684+0000","last_fullsized":"2024-05-10T14:04:11.372684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961549+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:04:11.961549+0000","last_peered":"2024-05-10T14:04:11.961549+0000","last_clean":"2024-05-10T14:04:11.961549+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:04:11.961549+0000","last_undegraded":"2024-05-10T14:04:11.961549+0000","last_fullsized":"2024-05-10T14:04:11.961549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371117+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:04:11.371117+0000","last_peered":"2024-05-10T14:04:11.371117+0000","last_clean":"2024-05-10T14:04:11.371117+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:04:11.371117+0000","last_undegraded":"2024-05-10T14:04:11.371117+0000","last_fullsized":"2024-05-10T14:04:11.371117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381291+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:04:11.381291+0000","last_peered":"2024-05-10T14:04:11.381291+0000","last_clean":"2024-05-10T14:04:11.381291+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:04:11.381291+0000","last_undegraded":"2024-05-10T14:04:11.381291+0000","last_fullsized":"2024-05-10T14:04:11.381291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556425+0000","last_change":"2024-05-10T14:02:30.668590+0000","last_active":"2024-05-10T14:04:11.556425+0000","last_peered":"2024-05-10T14:04:11.556425+0000","last_clean":"2024-05-10T14:04:11.556425+0000","last_became_active":"2024-05-10T14:02:30.667866+0000","last_became_peered":"2024-05-10T14:02:30.667866+0000","last_unstale":"2024-05-10T14:04:11.556425+0000","last_undegraded":"2024-05-10T14:04:11.556425+0000","last_fullsized":"2024-05-10T14:04:11.556425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:51.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337251+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:04:08.337251+0000","last_peered":"2024-05-10T14:04:08.337251+0000","last_clean":"2024-05-10T14:04:08.337251+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:04:08.337251+0000","last_undegraded":"2024-05-10T14:04:08.337251+0000","last_fullsized":"2024-05-10T14:04:08.337251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965084+0000","last_change":"2024-05-10T14:02:36.693151+0000","last_active":"2024-05-10T14:04:11.965084+0000","last_peered":"2024-05-10T14:04:11.965084+0000","last_clean":"2024-05-10T14:04:11.965084+0000","last_became_active":"2024-05-10T14:02:36.692261+0000","last_became_peered":"2024-05-10T14:02:36.692261+0000","last_unstale":"2024-05-10T14:04:11.965084+0000","last_undegraded":"2024-05-10T14:04:11.965084+0000","last_fullsized":"2024-05-10T14:04:11.965084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":103,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555656+0000","last_change":"2024-05-10T14:04:06.319936+0000","last_active":"2024-05-10T14:04:11.555656+0000","last_peered":"2024-05-10T14:04:11.555656+0000","last_clean":"2024-05-10T14:04:11.555656+0000","last_became_active":"2024-05-10T14:04:06.319377+0000","last_became_peered":"2024-05-10T14:04:06.319377+0000","last_unstale":"2024-05-10T14:04:11.555656+0000","last_undegraded":"2024-05-10T14:04:11.555656+0000","last_fullsized":"2024-05-10T14:04:11.555656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:20.196086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334137+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:04:08.334137+0000","last_peered":"2024-05-10T14:04:08.334137+0000","last_clean":"2024-05-10T14:04:08.334137+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:04:08.334137+0000","last_undegraded":"2024-05-10T14:04:08.334137+0000","last_fullsized":"2024-05-10T14:04:08.334137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336297+0000","last_change":"2024-05-10T14:04:06.325837+0000","last_active":"2024-05-10T14:04:08.336297+0000","last_peered":"2024-05-10T14:04:08.336297+0000","last_clean":"2024-05-10T14:04:08.336297+0000","last_became_active":"2024-05-10T14:04:06.318191+0000","last_became_peered":"2024-05-10T14:04:06.318191+0000","last_unstale":"2024-05-10T14:04:08.336297+0000","last_undegraded":"2024-05-10T14:04:08.336297+0000","last_fullsized":"2024-05-10T14:04:08.336297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:00.345120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510891+0000","last_change":"2024-05-10T14:03:12.136197+0000","last_active":"2024-05-10T14:04:09.510891+0000","last_peered":"2024-05-10T14:04:09.510891+0000","last_clean":"2024-05-10T14:04:09.510891+0000","last_became_active":"2024-05-10T14:03:12.135656+0000","last_became_peered":"2024-05-10T14:03:12.135656+0000","last_unstale":"2024-05-10T14:04:09.510891+0000","last_undegraded":"2024-05-10T14:04:09.510891+0000","last_fullsized":"2024-05-10T14:04:09.510891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:18.168652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381152+0000","last_change":"2024-05-10T14:02:34.689880+0000","last_active":"2024-05-10T14:04:11.381152+0000","last_peered":"2024-05-10T14:04:11.381152+0000","last_clean":"2024-05-10T14:04:11.381152+0000","last_became_active":"2024-05-10T14:02:34.689508+0000","last_became_peered":"2024-05-10T14:02:34.689508+0000","last_unstale":"2024-05-10T14:04:11.381152+0000","last_undegraded":"2024-05-10T14:04:11.381152+0000","last_fullsized":"2024-05-10T14:04:11.381152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373290+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:04:11.373290+0000","last_peered":"2024-05-10T14:04:11.373290+0000","last_clean":"2024-05-10T14:04:11.373290+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:04:11.373290+0000","last_undegraded":"2024-05-10T14:04:11.373290+0000","last_fullsized":"2024-05-10T14:04:11.373290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372683+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:04:11.372683+0000","last_peered":"2024-05-10T14:04:11.372683+0000","last_clean":"2024-05-10T14:04:11.372683+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:04:11.372683+0000","last_undegraded":"2024-05-10T14:04:11.372683+0000","last_fullsized":"2024-05-10T14:04:11.372683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961297+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:04:11.961297+0000","last_peered":"2024-05-10T14:04:11.961297+0000","last_clean":"2024-05-10T14:04:11.961297+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:04:11.961297+0000","last_undegraded":"2024-05-10T14:04:11.961297+0000","last_fullsized":"2024-05-10T14:04:11.961297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.969101+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:04:11.969101+0000","last_peered":"2024-05-10T14:04:11.969101+0000","last_clean":"2024-05-10T14:04:11.969101+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:04:11.969101+0000","last_undegraded":"2024-05-10T14:04:11.969101+0000","last_fullsized":"2024-05-10T14:04:11.969101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556609+0000","last_change":"2024-05-10T14:02:30.658424+0000","last_active":"2024-05-10T14:04:11.556609+0000","last_peered":"2024-05-10T14:04:11.556609+0000","last_clean":"2024-05-10T14:04:11.556609+0000","last_became_active":"2024-05-10T14:02:30.651349+0000","last_became_peered":"2024-05-10T14:02:30.651349+0000","last_unstale":"2024-05-10T14:04:11.556609+0000","last_undegraded":"2024-05-10T14:04:11.556609+0000","last_fullsized":"2024-05-10T14:04:11.556609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381509+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:04:11.381509+0000","last_peered":"2024-05-10T14:04:11.381509+0000","last_clean":"2024-05-10T14:04:11.381509+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:04:11.381509+0000","last_undegraded":"2024-05-10T14:04:11.381509+0000","last_fullsized":"2024-05-10T14:04:11.381509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372319+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:04:11.372319+0000","last_peered":"2024-05-10T14:04:11.372319+0000","last_clean":"2024-05-10T14:04:11.372319+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:04:11.372319+0000","last_undegraded":"2024-05-10T14:04:11.372319+0000","last_fullsized":"2024-05-10T14:04:11.372319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555800+0000","last_change":"2024-05-10T14:02:38.725468+0000","last_active":"2024-05-10T14:04:11.555800+0000","last_peered":"2024-05-10T14:04:11.555800+0000","last_clean":"2024-05-10T14:04:11.555800+0000","last_became_active":"2024-05-10T14:02:38.724682+0000","last_became_peered":"2024-05-10T14:02:38.724682+0000","last_unstale":"2024-05-10T14:04:11.555800+0000","last_undegraded":"2024-05-10T14:04:11.555800+0000","last_fullsized":"2024-05-10T14:04:11.555800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:03.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371598+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:04:11.371598+0000","last_peered":"2024-05-10T14:04:11.371598+0000","last_clean":"2024-05-10T14:04:11.371598+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:04:11.371598+0000","last_undegraded":"2024-05-10T14:04:11.371598+0000","last_fullsized":"2024-05-10T14:04:11.371598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381100+0000","last_change":"2024-05-10T14:02:32.678011+0000","last_active":"2024-05-10T14:04:11.381100+0000","last_peered":"2024-05-10T14:04:11.381100+0000","last_clean":"2024-05-10T14:04:11.381100+0000","last_became_active":"2024-05-10T14:02:32.677334+0000","last_became_peered":"2024-05-10T14:02:32.677334+0000","last_unstale":"2024-05-10T14:04:11.381100+0000","last_undegraded":"2024-05-10T14:04:11.381100+0000","last_fullsized":"2024-05-10T14:04:11.381100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959596+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:04:11.959596+0000","last_peered":"2024-05-10T14:04:11.959596+0000","last_clean":"2024-05-10T14:04:11.959596+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:04:11.959596+0000","last_undegraded":"2024-05-10T14:04:11.959596+0000","last_fullsized":"2024-05-10T14:04:11.959596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335995+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:04:08.335995+0000","last_peered":"2024-05-10T14:04:08.335995+0000","last_clean":"2024-05-10T14:04:08.335995+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:04:08.335995+0000","last_undegraded":"2024-05-10T14:04:08.335995+0000","last_fullsized":"2024-05-10T14:04:08.335995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556091+0000","last_change":"2024-05-10T14:02:36.764331+0000","last_active":"2024-05-10T14:04:11.556091+0000","last_peered":"2024-05-10T14:04:11.556091+0000","last_clean":"2024-05-10T14:04:11.556091+0000","last_became_active":"2024-05-10T14:02:36.763497+0000","last_became_peered":"2024-05-10T14:02:36.763497+0000","last_unstale":"2024-05-10T14:04:11.556091+0000","last_undegraded":"2024-05-10T14:04:11.556091+0000","last_fullsized":"2024-05-10T14:04:11.556091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380828+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:04:11.380828+0000","last_peered":"2024-05-10T14:04:11.380828+0000","last_clean":"2024-05-10T14:04:11.380828+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:04:11.380828+0000","last_undegraded":"2024-05-10T14:04:11.380828+0000","last_fullsized":"2024-05-10T14:04:11.380828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334214+0000","last_change":"2024-05-10T14:04:06.315403+0000","last_active":"2024-05-10T14:04:08.334214+0000","last_peered":"2024-05-10T14:04:08.334214+0000","last_clean":"2024-05-10T14:04:08.334214+0000","last_became_active":"2024-05-10T14:04:06.314256+0000","last_became_peered":"2024-05-10T14:04:06.314256+0000","last_unstale":"2024-05-10T14:04:08.334214+0000","last_undegraded":"2024-05-10T14:04:08.334214+0000","last_fullsized":"2024-05-10T14:04:08.334214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:27:55.856155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556541+0000","last_change":"2024-05-10T14:02:30.671539+0000","last_active":"2024-05-10T14:04:11.556541+0000","last_peered":"2024-05-10T14:04:11.556541+0000","last_clean":"2024-05-10T14:04:11.556541+0000","last_became_active":"2024-05-10T14:02:30.667280+0000","last_became_peered":"2024-05-10T14:02:30.667280+0000","last_unstale":"2024-05-10T14:04:11.556541+0000","last_undegraded":"2024-05-10T14:04:11.556541+0000","last_fullsized":"2024-05-10T14:04:11.556541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:23.469805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555430+0000","last_change":"2024-05-10T14:02:34.696732+0000","last_active":"2024-05-10T14:04:11.555430+0000","last_peered":"2024-05-10T14:04:11.555430+0000","last_clean":"2024-05-10T14:04:11.555430+0000","last_became_active":"2024-05-10T14:02:34.695834+0000","last_became_peered":"2024-05-10T14:02:34.695834+0000","last_unstale":"2024-05-10T14:04:11.555430+0000","last_undegraded":"2024-05-10T14:04:11.555430+0000","last_fullsized":"2024-05-10T14:04:11.555430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:55.418547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":66,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335602+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:04:08.335602+0000","last_peered":"2024-05-10T14:04:08.335602+0000","last_clean":"2024-05-10T14:04:08.335602+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:04:08.335602+0000","last_undegraded":"2024-05-10T14:04:08.335602+0000","last_fullsized":"2024-05-10T14:04:08.335602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511608+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:04:09.511608+0000","last_peered":"2024-05-10T14:04:09.511608+0000","last_clean":"2024-05-10T14:04:09.511608+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:04:09.511608+0000","last_undegraded":"2024-05-10T14:04:09.511608+0000","last_fullsized":"2024-05-10T14:04:09.511608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336388+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:04:08.336388+0000","last_peered":"2024-05-10T14:04:08.336388+0000","last_clean":"2024-05-10T14:04:08.336388+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:04:08.336388+0000","last_undegraded":"2024-05-10T14:04:08.336388+0000","last_fullsized":"2024-05-10T14:04:08.336388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371388+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:04:11.371388+0000","last_peered":"2024-05-10T14:04:11.371388+0000","last_clean":"2024-05-10T14:04:11.371388+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:04:11.371388+0000","last_undegraded":"2024-05-10T14:04:11.371388+0000","last_fullsized":"2024-05-10T14:04:11.371388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556749+0000","last_change":"2024-05-10T14:02:30.666615+0000","last_active":"2024-05-10T14:04:11.556749+0000","last_peered":"2024-05-10T14:04:11.556749+0000","last_clean":"2024-05-10T14:04:11.556749+0000","last_became_active":"2024-05-10T14:02:30.665826+0000","last_became_peered":"2024-05-10T14:02:30.665826+0000","last_unstale":"2024-05-10T14:04:11.556749+0000","last_undegraded":"2024-05-10T14:04:11.556749+0000","last_fullsized":"2024-05-10T14:04:11.556749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:22.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375686+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:04:11.375686+0000","last_peered":"2024-05-10T14:04:11.375686+0000","last_clean":"2024-05-10T14:04:11.375686+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:04:11.375686+0000","last_undegraded":"2024-05-10T14:04:11.375686+0000","last_fullsized":"2024-05-10T14:04:11.375686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379468+0000","last_change":"2024-05-10T14:02:36.705359+0000","last_active":"2024-05-10T14:04:11.379468+0000","last_peered":"2024-05-10T14:04:11.379468+0000","last_clean":"2024-05-10T14:04:11.379468+0000","last_became_active":"2024-05-10T14:02:36.704432+0000","last_became_peered":"2024-05-10T14:02:36.704432+0000","last_unstale":"2024-05-10T14:04:11.379468+0000","last_undegraded":"2024-05-10T14:04:11.379468+0000","last_fullsized":"2024-05-10T14:04:11.379468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:01.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378745+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:04:11.378745+0000","last_peered":"2024-05-10T14:04:11.378745+0000","last_clean":"2024-05-10T14:04:11.378745+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:04:11.378745+0000","last_undegraded":"2024-05-10T14:04:11.378745+0000","last_fullsized":"2024-05-10T14:04:11.378745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961049+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:04:11.961049+0000","last_peered":"2024-05-10T14:04:11.961049+0000","last_clean":"2024-05-10T14:04:11.961049+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:04:11.961049+0000","last_undegraded":"2024-05-10T14:04:11.961049+0000","last_fullsized":"2024-05-10T14:04:11.961049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960198+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:04:11.960198+0000","last_peered":"2024-05-10T14:04:11.960198+0000","last_clean":"2024-05-10T14:04:11.960198+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:04:11.960198+0000","last_undegraded":"2024-05-10T14:04:11.960198+0000","last_fullsized":"2024-05-10T14:04:11.960198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556680+0000","last_change":"2024-05-10T14:04:06.325610+0000","last_active":"2024-05-10T14:04:11.556680+0000","last_peered":"2024-05-10T14:04:11.556680+0000","last_clean":"2024-05-10T14:04:11.556680+0000","last_became_active":"2024-05-10T14:04:06.324971+0000","last_became_peered":"2024-05-10T14:04:06.324971+0000","last_unstale":"2024-05-10T14:04:11.556680+0000","last_undegraded":"2024-05-10T14:04:11.556680+0000","last_fullsized":"2024-05-10T14:04:11.556680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:22.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371800+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:04:11.371800+0000","last_peered":"2024-05-10T14:04:11.371800+0000","last_clean":"2024-05-10T14:04:11.371800+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:04:11.371800+0000","last_undegraded":"2024-05-10T14:04:11.371800+0000","last_fullsized":"2024-05-10T14:04:11.371800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555207+0000","last_change":"2024-05-10T14:02:36.697333+0000","last_active":"2024-05-10T14:04:11.555207+0000","last_peered":"2024-05-10T14:04:11.555207+0000","last_clean":"2024-05-10T14:04:11.555207+0000","last_became_active":"2024-05-10T14:02:36.696435+0000","last_became_peered":"2024-05-10T14:02:36.696435+0000","last_unstale":"2024-05-10T14:04:11.555207+0000","last_undegraded":"2024-05-10T14:04:11.555207+0000","last_fullsized":"2024-05-10T14:04:11.555207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:49.590201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960562+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:04:11.960562+0000","last_peered":"2024-05-10T14:04:11.960562+0000","last_clean":"2024-05-10T14:04:11.960562+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:04:11.960562+0000","last_undegraded":"2024-05-10T14:04:11.960562+0000","last_fullsized":"2024-05-10T14:04:11.960562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965238+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:04:11.965238+0000","last_peered":"2024-05-10T14:04:11.965238+0000","last_clean":"2024-05-10T14:04:11.965238+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:04:11.965238+0000","last_undegraded":"2024-05-10T14:04:11.965238+0000","last_fullsized":"2024-05-10T14:04:11.965238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.967267+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:04:11.967267+0000","last_peered":"2024-05-10T14:04:11.967267+0000","last_clean":"2024-05-10T14:04:11.967267+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:04:11.967267+0000","last_undegraded":"2024-05-10T14:04:11.967267+0000","last_fullsized":"2024-05-10T14:04:11.967267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335440+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:04:08.335440+0000","last_peered":"2024-05-10T14:04:08.335440+0000","last_clean":"2024-05-10T14:04:08.335440+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:04:08.335440+0000","last_undegraded":"2024-05-10T14:04:08.335440+0000","last_fullsized":"2024-05-10T14:04:08.335440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.377845+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:04:11.377845+0000","last_peered":"2024-05-10T14:04:11.377845+0000","last_clean":"2024-05-10T14:04:11.377845+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:04:11.377845+0000","last_undegraded":"2024-05-10T14:04:11.377845+0000","last_fullsized":"2024-05-10T14:04:11.377845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960859+0000","last_change":"2024-05-10T14:02:36.695386+0000","last_active":"2024-05-10T14:04:11.960859+0000","last_peered":"2024-05-10T14:04:11.960859+0000","last_clean":"2024-05-10T14:04:11.960859+0000","last_became_active":"2024-05-10T14:02:36.694539+0000","last_became_peered":"2024-05-10T14:02:36.694539+0000","last_unstale":"2024-05-10T14:04:11.960859+0000","last_undegraded":"2024-05-10T14:04:11.960859+0000","last_fullsized":"2024-05-10T14:04:11.960859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375802+0000","last_change":"2024-05-10T14:02:38.720117+0000","last_active":"2024-05-10T14:04:11.375802+0000","last_peered":"2024-05-10T14:04:11.375802+0000","last_clean":"2024-05-10T14:04:11.375802+0000","last_became_active":"2024-05-10T14:02:38.719249+0000","last_became_peered":"2024-05-10T14:02:38.719249+0000","last_unstale":"2024-05-10T14:04:11.375802+0000","last_undegraded":"2024-05-10T14:04:11.375802+0000","last_fullsized":"2024-05-10T14:04:11.375802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:06.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512745+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:04:09.512745+0000","last_peered":"2024-05-10T14:04:09.512745+0000","last_clean":"2024-05-10T14:04:09.512745+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:04:09.512745+0000","last_undegraded":"2024-05-10T14:04:09.512745+0000","last_fullsized":"2024-05-10T14:04:09.512745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372678+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:04:11.372678+0000","last_peered":"2024-05-10T14:04:11.372678+0000","last_clean":"2024-05-10T14:04:11.372678+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:04:11.372678+0000","last_undegraded":"2024-05-10T14:04:11.372678+0000","last_fullsized":"2024-05-10T14:04:11.372678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378836+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:04:11.378836+0000","last_peered":"2024-05-10T14:04:11.378836+0000","last_clean":"2024-05-10T14:04:11.378836+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:04:11.378836+0000","last_undegraded":"2024-05-10T14:04:11.378836+0000","last_fullsized":"2024-05-10T14:04:11.378836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375054+0000","last_change":"2024-05-10T14:02:34.691307+0000","last_active":"2024-05-10T14:04:11.375054+0000","last_peered":"2024-05-10T14:04:11.375054+0000","last_clean":"2024-05-10T14:04:11.375054+0000","last_became_active":"2024-05-10T14:02:34.690951+0000","last_became_peered":"2024-05-10T14:02:34.690951+0000","last_unstale":"2024-05-10T14:04:11.375054+0000","last_undegraded":"2024-05-10T14:04:11.375054+0000","last_fullsized":"2024-05-10T14:04:11.375054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:15.214881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372817+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:04:11.372817+0000","last_peered":"2024-05-10T14:04:11.372817+0000","last_clean":"2024-05-10T14:04:11.372817+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:04:11.372817+0000","last_undegraded":"2024-05-10T14:04:11.372817+0000","last_fullsized":"2024-05-10T14:04:11.372817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968296+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:04:11.968296+0000","last_peered":"2024-05-10T14:04:11.968296+0000","last_clean":"2024-05-10T14:04:11.968296+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:04:11.968296+0000","last_undegraded":"2024-05-10T14:04:11.968296+0000","last_fullsized":"2024-05-10T14:04:11.968296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":101,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379243+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:04:11.379243+0000","last_peered":"2024-05-10T14:04:11.379243+0000","last_clean":"2024-05-10T14:04:11.379243+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:04:11.379243+0000","last_undegraded":"2024-05-10T14:04:11.379243+0000","last_fullsized":"2024-05-10T14:04:11.379243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372812+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:04:11.372812+0000","last_peered":"2024-05-10T14:04:11.372812+0000","last_clean":"2024-05-10T14:04:11.372812+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:04:11.372812+0000","last_undegraded":"2024-05-10T14:04:11.372812+0000","last_fullsized":"2024-05-10T14:04:11.372812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960321+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:04:11.960321+0000","last_peered":"2024-05-10T14:04:11.960321+0000","last_clean":"2024-05-10T14:04:11.960321+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:04:11.960321+0000","last_undegraded":"2024-05-10T14:04:11.960321+0000","last_fullsized":"2024-05-10T14:04:11.960321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":101,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511715+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:04:09.511715+0000","last_peered":"2024-05-10T14:04:09.511715+0000","last_clean":"2024-05-10T14:04:09.511715+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:04:09.511715+0000","last_undegraded":"2024-05-10T14:04:09.511715+0000","last_fullsized":"2024-05-10T14:04:09.511715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372260+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:04:11.372260+0000","last_peered":"2024-05-10T14:04:11.372260+0000","last_clean":"2024-05-10T14:04:11.372260+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:04:11.372260+0000","last_undegraded":"2024-05-10T14:04:11.372260+0000","last_fullsized":"2024-05-10T14:04:11.372260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"74'4","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373194+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:04:11.373194+0000","last_peered":"2024-05-10T14:04:11.373194+0000","last_clean":"2024-05-10T14:04:11.373194+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:04:11.373194+0000","last_undegraded":"2024-05-10T14:04:11.373194+0000","last_fullsized":"2024-05-10T14:04:11.373194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510500+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:04:09.510500+0000","last_peered":"2024-05-10T14:04:09.510500+0000","last_clean":"2024-05-10T14:04:09.510500+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:04:09.510500+0000","last_undegraded":"2024-05-10T14:04:09.510500+0000","last_fullsized":"2024-05-10T14:04:09.510500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373472+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:04:11.373472+0000","last_peered":"2024-05-10T14:04:11.373472+0000","last_clean":"2024-05-10T14:04:11.373472+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:04:11.373472+0000","last_undegraded":"2024-05-10T14:04:11.373472+0000","last_fullsized":"2024-05-10T14:04:11.373472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372049+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:04:11.372049+0000","last_peered":"2024-05-10T14:04:11.372049+0000","last_clean":"2024-05-10T14:04:11.372049+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:04:11.372049+0000","last_undegraded":"2024-05-10T14:04:11.372049+0000","last_fullsized":"2024-05-10T14:04:11.372049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337357+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:04:08.337357+0000","last_peered":"2024-05-10T14:04:08.337357+0000","last_clean":"2024-05-10T14:04:08.337357+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:04:08.337357+0000","last_undegraded":"2024-05-10T14:04:08.337357+0000","last_fullsized":"2024-05-10T14:04:08.337357+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380928+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:04:11.380928+0000","last_peered":"2024-05-10T14:04:11.380928+0000","last_clean":"2024-05-10T14:04:11.380928+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:04:11.380928+0000","last_undegraded":"2024-05-10T14:04:11.380928+0000","last_fullsized":"2024-05-10T14:04:11.380928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.962357+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:04:11.962357+0000","last_peered":"2024-05-10T14:04:11.962357+0000","last_clean":"2024-05-10T14:04:11.962357+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:04:11.962357+0000","last_undegraded":"2024-05-10T14:04:11.962357+0000","last_fullsized":"2024-05-10T14:04:11.962357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371764+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:04:11.371764+0000","last_peered":"2024-05-10T14:04:11.371764+0000","last_clean":"2024-05-10T14:04:11.371764+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:04:11.371764+0000","last_undegraded":"2024-05-10T14:04:11.371764+0000","last_fullsized":"2024-05-10T14:04:11.371764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512989+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:04:09.512989+0000","last_peered":"2024-05-10T14:04:09.512989+0000","last_clean":"2024-05-10T14:04:09.512989+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:04:09.512989+0000","last_undegraded":"2024-05-10T14:04:09.512989+0000","last_fullsized":"2024-05-10T14:04:09.512989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380006+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:04:11.380006+0000","last_peered":"2024-05-10T14:04:11.380006+0000","last_clean":"2024-05-10T14:04:11.380006+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:04:11.380006+0000","last_undegraded":"2024-05-10T14:04:11.380006+0000","last_fullsized":"2024-05-10T14:04:11.380006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373229+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:04:11.373229+0000","last_peered":"2024-05-10T14:04:11.373229+0000","last_clean":"2024-05-10T14:04:11.373229+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:04:11.373229+0000","last_undegraded":"2024-05-10T14:04:11.373229+0000","last_fullsized":"2024-05-10T14:04:11.373229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337477+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:04:08.337477+0000","last_peered":"2024-05-10T14:04:08.337477+0000","last_clean":"2024-05-10T14:04:08.337477+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:04:08.337477+0000","last_undegraded":"2024-05-10T14:04:08.337477+0000","last_fullsized":"2024-05-10T14:04:08.337477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960691+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:04:11.960691+0000","last_peered":"2024-05-10T14:04:11.960691+0000","last_clean":"2024-05-10T14:04:11.960691+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:04:11.960691+0000","last_undegraded":"2024-05-10T14:04:11.960691+0000","last_fullsized":"2024-05-10T14:04:11.960691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.509779+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:04:09.509779+0000","last_peered":"2024-05-10T14:04:09.509779+0000","last_clean":"2024-05-10T14:04:09.509779+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:04:09.509779+0000","last_undegraded":"2024-05-10T14:04:09.509779+0000","last_fullsized":"2024-05-10T14:04:09.509779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.963181+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:04:11.963181+0000","last_peered":"2024-05-10T14:04:11.963181+0000","last_clean":"2024-05-10T14:04:11.963181+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:04:11.963181+0000","last_undegraded":"2024-05-10T14:04:11.963181+0000","last_fullsized":"2024-05-10T14:04:11.963181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":214,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555256+0000","last_change":"2024-05-10T14:02:20.127451+0000","last_active":"2024-05-10T14:04:11.555256+0000","last_peered":"2024-05-10T14:04:11.555256+0000","last_clean":"2024-05-10T14:04:11.555256+0000","last_became_active":"2024-05-10T14:02:20.125462+0000","last_became_peered":"2024-05-10T14:02:20.125462+0000","last_unstale":"2024-05-10T14:04:11.555256+0000","last_undegraded":"2024-05-10T14:04:11.555256+0000","last_fullsized":"2024-05-10T14:04:11.555256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:54.208412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334737+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:04:08.334737+0000","last_peered":"2024-05-10T14:04:08.334737+0000","last_clean":"2024-05-10T14:04:08.334737+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:04:08.334737+0000","last_undegraded":"2024-05-10T14:04:08.334737+0000","last_fullsized":"2024-05-10T14:04:08.334737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379144+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:04:11.379144+0000","last_peered":"2024-05-10T14:04:11.379144+0000","last_clean":"2024-05-10T14:04:11.379144+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:04:11.379144+0000","last_undegraded":"2024-05-10T14:04:11.379144+0000","last_fullsized":"2024-05-10T14:04:11.379144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554795+0000","last_change":"2024-05-10T14:02:34.698873+0000","last_active":"2024-05-10T14:04:11.554795+0000","last_peered":"2024-05-10T14:04:11.554795+0000","last_clean":"2024-05-10T14:04:11.554795+0000","last_became_active":"2024-05-10T14:02:34.698230+0000","last_became_peered":"2024-05-10T14:02:34.698230+0000","last_unstale":"2024-05-10T14:04:11.554795+0000","last_undegraded":"2024-05-10T14:04:11.554795+0000","last_fullsized":"2024-05-10T14:04:11.554795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":62,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336606+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:04:08.336606+0000","last_peered":"2024-05-10T14:04:08.336606+0000","last_clean":"2024-05-10T14:04:08.336606+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:04:08.336606+0000","last_undegraded":"2024-05-10T14:04:08.336606+0000","last_fullsized":"2024-05-10T14:04:08.336606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.965323+0000","last_change":"2024-05-10T14:02:38.724050+0000","last_active":"2024-05-10T14:04:11.965323+0000","last_peered":"2024-05-10T14:04:11.965323+0000","last_clean":"2024-05-10T14:04:11.965323+0000","last_became_active":"2024-05-10T14:02:38.723348+0000","last_became_peered":"2024-05-10T14:02:38.723348+0000","last_unstale":"2024-05-10T14:04:11.965323+0000","last_undegraded":"2024-05-10T14:04:11.965323+0000","last_fullsized":"2024-05-10T14:04:11.965323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:52.580927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959407+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:04:11.959407+0000","last_peered":"2024-05-10T14:04:11.959407+0000","last_clean":"2024-05-10T14:04:11.959407+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:04:11.959407+0000","last_undegraded":"2024-05-10T14:04:11.959407+0000","last_fullsized":"2024-05-10T14:04:11.959407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968966+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:04:11.968966+0000","last_peered":"2024-05-10T14:04:11.968966+0000","last_clean":"2024-05-10T14:04:11.968966+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:04:11.968966+0000","last_undegraded":"2024-05-10T14:04:11.968966+0000","last_fullsized":"2024-05-10T14:04:11.968966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555163+0000","last_change":"2024-05-10T14:02:24.592328+0000","last_active":"2024-05-10T14:04:11.555163+0000","last_peered":"2024-05-10T14:04:11.555163+0000","last_clean":"2024-05-10T14:04:11.555163+0000","last_became_active":"2024-05-10T14:02:24.591448+0000","last_became_peered":"2024-05-10T14:02:24.591448+0000","last_unstale":"2024-05-10T14:04:11.555163+0000","last_undegraded":"2024-05-10T14:04:11.555163+0000","last_fullsized":"2024-05-10T14:04:11.555163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:09.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961000+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:04:11.961000+0000","last_peered":"2024-05-10T14:04:11.961000+0000","last_clean":"2024-05-10T14:04:11.961000+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:04:11.961000+0000","last_undegraded":"2024-05-10T14:04:11.961000+0000","last_fullsized":"2024-05-10T14:04:11.961000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337000+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:04:08.337000+0000","last_peered":"2024-05-10T14:04:08.337000+0000","last_clean":"2024-05-10T14:04:08.337000+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:04:08.337000+0000","last_undegraded":"2024-05-10T14:04:08.337000+0000","last_fullsized":"2024-05-10T14:04:08.337000+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"74'25","reported_seq":166,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511714+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:04:09.511714+0000","last_peered":"2024-05-10T14:04:09.511714+0000","last_clean":"2024-05-10T14:04:09.511714+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:04:09.511714+0000","last_undegraded":"2024-05-10T14:04:09.511714+0000","last_fullsized":"2024-05-10T14:04:09.511714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555877+0000","last_change":"2024-05-10T14:02:38.724901+0000","last_active":"2024-05-10T14:04:11.555877+0000","last_peered":"2024-05-10T14:04:11.555877+0000","last_clean":"2024-05-10T14:04:11.555877+0000","last_became_active":"2024-05-10T14:02:38.723559+0000","last_became_peered":"2024-05-10T14:02:38.723559+0000","last_unstale":"2024-05-10T14:04:11.555877+0000","last_undegraded":"2024-05-10T14:04:11.555877+0000","last_fullsized":"2024-05-10T14:04:11.555877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:37.191446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510969+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:04:09.510969+0000","last_peered":"2024-05-10T14:04:09.510969+0000","last_clean":"2024-05-10T14:04:09.510969+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:04:09.510969+0000","last_undegraded":"2024-05-10T14:04:09.510969+0000","last_fullsized":"2024-05-10T14:04:09.510969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":112,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.513075+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:04:09.513075+0000","last_peered":"2024-05-10T14:04:09.513075+0000","last_clean":"2024-05-10T14:04:09.513075+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:04:09.513075+0000","last_undegraded":"2024-05-10T14:04:09.513075+0000","last_fullsized":"2024-05-10T14:04:09.513075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373819+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:04:11.373819+0000","last_peered":"2024-05-10T14:04:11.373819+0000","last_clean":"2024-05-10T14:04:11.373819+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:04:11.373819+0000","last_undegraded":"2024-05-10T14:04:11.373819+0000","last_fullsized":"2024-05-10T14:04:11.373819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.509990+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:04:09.509990+0000","last_peered":"2024-05-10T14:04:09.509990+0000","last_clean":"2024-05-10T14:04:09.509990+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:04:09.509990+0000","last_undegraded":"2024-05-10T14:04:09.509990+0000","last_fullsized":"2024-05-10T14:04:09.509990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373390+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:04:11.373390+0000","last_peered":"2024-05-10T14:04:11.373390+0000","last_clean":"2024-05-10T14:04:11.373390+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:04:11.373390+0000","last_undegraded":"2024-05-10T14:04:11.373390+0000","last_fullsized":"2024-05-10T14:04:11.373390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556376+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:04:11.556376+0000","last_peered":"2024-05-10T14:04:11.556376+0000","last_clean":"2024-05-10T14:04:11.556376+0000","last_became_active":"2024-05-10T14:02:36.759841+0000","last_became_peered":"2024-05-10T14:02:36.759841+0000","last_unstale":"2024-05-10T14:04:11.556376+0000","last_undegraded":"2024-05-10T14:04:11.556376+0000","last_fullsized":"2024-05-10T14:04:11.556376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:11.127288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964721+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:04:11.964721+0000","last_peered":"2024-05-10T14:04:11.964721+0000","last_clean":"2024-05-10T14:04:11.964721+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:04:11.964721+0000","last_undegraded":"2024-05-10T14:04:11.964721+0000","last_fullsized":"2024-05-10T14:04:11.964721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379299+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:04:11.379299+0000","last_peered":"2024-05-10T14:04:11.379299+0000","last_clean":"2024-05-10T14:04:11.379299+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:04:11.379299+0000","last_undegraded":"2024-05-10T14:04:11.379299+0000","last_fullsized":"2024-05-10T14:04:11.379299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511884+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:04:09.511884+0000","last_peered":"2024-05-10T14:04:09.511884+0000","last_clean":"2024-05-10T14:04:09.511884+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:04:09.511884+0000","last_undegraded":"2024-05-10T14:04:09.511884+0000","last_fullsized":"2024-05-10T14:04:09.511884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334340+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:04:08.334340+0000","last_peered":"2024-05-10T14:04:08.334340+0000","last_clean":"2024-05-10T14:04:08.334340+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:04:08.334340+0000","last_undegraded":"2024-05-10T14:04:08.334340+0000","last_fullsized":"2024-05-10T14:04:08.334340+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372001+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:04:11.372001+0000","last_peered":"2024-05-10T14:04:11.372001+0000","last_clean":"2024-05-10T14:04:11.372001+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:04:11.372001+0000","last_undegraded":"2024-05-10T14:04:11.372001+0000","last_fullsized":"2024-05-10T14:04:11.372001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964934+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:04:11.964934+0000","last_peered":"2024-05-10T14:04:11.964934+0000","last_clean":"2024-05-10T14:04:11.964934+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:04:11.964934+0000","last_undegraded":"2024-05-10T14:04:11.964934+0000","last_fullsized":"2024-05-10T14:04:11.964934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380513+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:04:11.380513+0000","last_peered":"2024-05-10T14:04:11.380513+0000","last_clean":"2024-05-10T14:04:11.380513+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:04:11.380513+0000","last_undegraded":"2024-05-10T14:04:11.380513+0000","last_fullsized":"2024-05-10T14:04:11.380513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961385+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:04:11.961385+0000","last_peered":"2024-05-10T14:04:11.961385+0000","last_clean":"2024-05-10T14:04:11.961385+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:04:11.961385+0000","last_undegraded":"2024-05-10T14:04:11.961385+0000","last_fullsized":"2024-05-10T14:04:11.961385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335842+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:04:08.335842+0000","last_peered":"2024-05-10T14:04:08.335842+0000","last_clean":"2024-05-10T14:04:08.335842+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:04:08.335842+0000","last_undegraded":"2024-05-10T14:04:08.335842+0000","last_fullsized":"2024-05-10T14:04:08.335842+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":112,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511276+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:04:09.511276+0000","last_peered":"2024-05-10T14:04:09.511276+0000","last_clean":"2024-05-10T14:04:09.511276+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:04:09.511276+0000","last_undegraded":"2024-05-10T14:04:09.511276+0000","last_fullsized":"2024-05-10T14:04:09.511276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375188+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:04:11.375188+0000","last_peered":"2024-05-10T14:04:11.375188+0000","last_clean":"2024-05-10T14:04:11.375188+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:04:11.375188+0000","last_undegraded":"2024-05-10T14:04:11.375188+0000","last_fullsized":"2024-05-10T14:04:11.375188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512032+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:04:09.512032+0000","last_peered":"2024-05-10T14:04:09.512032+0000","last_clean":"2024-05-10T14:04:09.512032+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:04:09.512032+0000","last_undegraded":"2024-05-10T14:04:09.512032+0000","last_fullsized":"2024-05-10T14:04:09.512032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966547+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:04:11.966547+0000","last_peered":"2024-05-10T14:04:11.966547+0000","last_clean":"2024-05-10T14:04:11.966547+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:04:11.966547+0000","last_undegraded":"2024-05-10T14:04:11.966547+0000","last_fullsized":"2024-05-10T14:04:11.966547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960150+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:04:11.960150+0000","last_peered":"2024-05-10T14:04:11.960150+0000","last_clean":"2024-05-10T14:04:11.960150+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:04:11.960150+0000","last_undegraded":"2024-05-10T14:04:11.960150+0000","last_fullsized":"2024-05-10T14:04:11.960150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371227+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:04:11.371227+0000","last_peered":"2024-05-10T14:04:11.371227+0000","last_clean":"2024-05-10T14:04:11.371227+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:04:11.371227+0000","last_undegraded":"2024-05-10T14:04:11.371227+0000","last_fullsized":"2024-05-10T14:04:11.371227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964937+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:04:11.964937+0000","last_peered":"2024-05-10T14:04:11.964937+0000","last_clean":"2024-05-10T14:04:11.964937+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:04:11.964937+0000","last_undegraded":"2024-05-10T14:04:11.964937+0000","last_fullsized":"2024-05-10T14:04:11.964937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.967180+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:04:11.967180+0000","last_peered":"2024-05-10T14:04:11.967180+0000","last_clean":"2024-05-10T14:04:11.967180+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:04:11.967180+0000","last_undegraded":"2024-05-10T14:04:11.967180+0000","last_fullsized":"2024-05-10T14:04:11.967180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511947+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:04:09.511947+0000","last_peered":"2024-05-10T14:04:09.511947+0000","last_clean":"2024-05-10T14:04:09.511947+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:04:09.511947+0000","last_undegraded":"2024-05-10T14:04:09.511947+0000","last_fullsized":"2024-05-10T14:04:09.511947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556783+0000","last_change":"2024-05-10T14:02:24.797499+0000","last_active":"2024-05-10T14:04:11.556783+0000","last_peered":"2024-05-10T14:04:11.556783+0000","last_clean":"2024-05-10T14:04:11.556783+0000","last_became_active":"2024-05-10T14:02:24.796736+0000","last_became_peered":"2024-05-10T14:02:24.796736+0000","last_unstale":"2024-05-10T14:04:11.556783+0000","last_undegraded":"2024-05-10T14:04:11.556783+0000","last_fullsized":"2024-05-10T14:04:11.556783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:30.791547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959970+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:04:11.959970+0000","last_peered":"2024-05-10T14:04:11.959970+0000","last_clean":"2024-05-10T14:04:11.959970+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:04:11.959970+0000","last_undegraded":"2024-05-10T14:04:11.959970+0000","last_fullsized":"2024-05-10T14:04:11.959970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510211+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:04:09.510211+0000","last_peered":"2024-05-10T14:04:09.510211+0000","last_clean":"2024-05-10T14:04:09.510211+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:04:09.510211+0000","last_undegraded":"2024-05-10T14:04:09.510211+0000","last_fullsized":"2024-05-10T14:04:09.510211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"57'3","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335334+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:04:08.335334+0000","last_peered":"2024-05-10T14:04:08.335334+0000","last_clean":"2024-05-10T14:04:08.335334+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:04:08.335334+0000","last_undegraded":"2024-05-10T14:04:08.335334+0000","last_fullsized":"2024-05-10T14:04:08.335334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381230+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:04:11.381230+0000","last_peered":"2024-05-10T14:04:11.381230+0000","last_clean":"2024-05-10T14:04:11.381230+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:04:11.381230+0000","last_undegraded":"2024-05-10T14:04:11.381230+0000","last_fullsized":"2024-05-10T14:04:11.381230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379647+0000","last_change":"2024-05-10T14:02:32.681865+0000","last_active":"2024-05-10T14:04:11.379647+0000","last_peered":"2024-05-10T14:04:11.379647+0000","last_clean":"2024-05-10T14:04:11.379647+0000","last_became_active":"2024-05-10T14:02:32.677587+0000","last_became_peered":"2024-05-10T14:02:32.677587+0000","last_unstale":"2024-05-10T14:04:11.379647+0000","last_undegraded":"2024-05-10T14:04:11.379647+0000","last_fullsized":"2024-05-10T14:04:11.379647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380351+0000","last_change":"2024-05-10T14:02:30.651295+0000","last_active":"2024-05-10T14:04:11.380351+0000","last_peered":"2024-05-10T14:04:11.380351+0000","last_clean":"2024-05-10T14:04:11.380351+0000","last_became_active":"2024-05-10T14:02:30.650761+0000","last_became_peered":"2024-05-10T14:02:30.650761+0000","last_unstale":"2024-05-10T14:04:11.380351+0000","last_undegraded":"2024-05-10T14:04:11.380351+0000","last_fullsized":"2024-05-10T14:04:11.380351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.513068+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:04:09.513068+0000","last_peered":"2024-05-10T14:04:09.513068+0000","last_clean":"2024-05-10T14:04:09.513068+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:04:09.513068+0000","last_undegraded":"2024-05-10T14:04:09.513068+0000","last_fullsized":"2024-05-10T14:04:09.513068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371352+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:04:11.371352+0000","last_peered":"2024-05-10T14:04:11.371352+0000","last_clean":"2024-05-10T14:04:11.371352+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:04:11.371352+0000","last_undegraded":"2024-05-10T14:04:11.371352+0000","last_fullsized":"2024-05-10T14:04:11.371352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372023+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:04:11.372023+0000","last_peered":"2024-05-10T14:04:11.372023+0000","last_clean":"2024-05-10T14:04:11.372023+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:04:11.372023+0000","last_undegraded":"2024-05-10T14:04:11.372023+0000","last_fullsized":"2024-05-10T14:04:11.372023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379884+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:04:11.379884+0000","last_peered":"2024-05-10T14:04:11.379884+0000","last_clean":"2024-05-10T14:04:11.379884+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:04:11.379884+0000","last_undegraded":"2024-05-10T14:04:11.379884+0000","last_fullsized":"2024-05-10T14:04:11.379884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964727+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:04:11.964727+0000","last_peered":"2024-05-10T14:04:11.964727+0000","last_clean":"2024-05-10T14:04:11.964727+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:04:11.964727+0000","last_undegraded":"2024-05-10T14:04:11.964727+0000","last_fullsized":"2024-05-10T14:04:11.964727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371597+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:04:11.371597+0000","last_peered":"2024-05-10T14:04:11.371597+0000","last_clean":"2024-05-10T14:04:11.371597+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:04:11.371597+0000","last_undegraded":"2024-05-10T14:04:11.371597+0000","last_fullsized":"2024-05-10T14:04:11.371597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.969191+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:04:11.969191+0000","last_peered":"2024-05-10T14:04:11.969191+0000","last_clean":"2024-05-10T14:04:11.969191+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:04:11.969191+0000","last_undegraded":"2024-05-10T14:04:11.969191+0000","last_fullsized":"2024-05-10T14:04:11.969191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961952+0000","last_change":"2024-05-10T14:02:24.593887+0000","last_active":"2024-05-10T14:04:11.961952+0000","last_peered":"2024-05-10T14:04:11.961952+0000","last_clean":"2024-05-10T14:04:11.961952+0000","last_became_active":"2024-05-10T14:02:24.592937+0000","last_became_peered":"2024-05-10T14:02:24.592937+0000","last_unstale":"2024-05-10T14:04:11.961952+0000","last_undegraded":"2024-05-10T14:04:11.961952+0000","last_fullsized":"2024-05-10T14:04:11.961952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:13.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379517+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:04:11.379517+0000","last_peered":"2024-05-10T14:04:11.379517+0000","last_clean":"2024-05-10T14:04:11.379517+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:04:11.379517+0000","last_undegraded":"2024-05-10T14:04:11.379517+0000","last_fullsized":"2024-05-10T14:04:11.379517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555240+0000","last_change":"2024-05-10T14:02:36.760640+0000","last_active":"2024-05-10T14:04:11.555240+0000","last_peered":"2024-05-10T14:04:11.555240+0000","last_clean":"2024-05-10T14:04:11.555240+0000","last_became_active":"2024-05-10T14:02:36.759811+0000","last_became_peered":"2024-05-10T14:02:36.759811+0000","last_unstale":"2024-05-10T14:04:11.555240+0000","last_undegraded":"2024-05-10T14:04:11.555240+0000","last_fullsized":"2024-05-10T14:04:11.555240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:17:56.400870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378840+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:04:11.378840+0000","last_peered":"2024-05-10T14:04:11.378840+0000","last_clean":"2024-05-10T14:04:11.378840+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:04:11.378840+0000","last_undegraded":"2024-05-10T14:04:11.378840+0000","last_fullsized":"2024-05-10T14:04:11.378840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.337100+0000","last_change":"2024-05-10T14:04:06.313038+0000","last_active":"2024-05-10T14:04:08.337100+0000","last_peered":"2024-05-10T14:04:08.337100+0000","last_clean":"2024-05-10T14:04:08.337100+0000","last_became_active":"2024-05-10T14:04:06.312376+0000","last_became_peered":"2024-05-10T14:04:06.312376+0000","last_unstale":"2024-05-10T14:04:08.337100+0000","last_undegraded":"2024-05-10T14:04:08.337100+0000","last_fullsized":"2024-05-10T14:04:08.337100+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:12.027586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968139+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:04:11.968139+0000","last_peered":"2024-05-10T14:04:11.968139+0000","last_clean":"2024-05-10T14:04:11.968139+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:04:11.968139+0000","last_undegraded":"2024-05-10T14:04:11.968139+0000","last_fullsized":"2024-05-10T14:04:11.968139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371761+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:04:11.371761+0000","last_peered":"2024-05-10T14:04:11.371761+0000","last_clean":"2024-05-10T14:04:11.371761+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:04:11.371761+0000","last_undegraded":"2024-05-10T14:04:11.371761+0000","last_fullsized":"2024-05-10T14:04:11.371761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371822+0000","last_change":"2024-05-10T14:02:30.652486+0000","last_active":"2024-05-10T14:04:11.371822+0000","last_peered":"2024-05-10T14:04:11.371822+0000","last_clean":"2024-05-10T14:04:11.371822+0000","last_became_active":"2024-05-10T14:02:30.651639+0000","last_became_peered":"2024-05-10T14:02:30.651639+0000","last_unstale":"2024-05-10T14:04:11.371822+0000","last_undegraded":"2024-05-10T14:04:11.371822+0000","last_fullsized":"2024-05-10T14:04:11.371822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:53.243133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":108,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511352+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:04:09.511352+0000","last_peered":"2024-05-10T14:04:09.511352+0000","last_clean":"2024-05-10T14:04:09.511352+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:04:09.511352+0000","last_undegraded":"2024-05-10T14:04:09.511352+0000","last_fullsized":"2024-05-10T14:04:09.511352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378558+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:04:11.378558+0000","last_peered":"2024-05-10T14:04:11.378558+0000","last_clean":"2024-05-10T14:04:11.378558+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:04:11.378558+0000","last_undegraded":"2024-05-10T14:04:11.378558+0000","last_fullsized":"2024-05-10T14:04:11.378558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379334+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:04:11.379334+0000","last_peered":"2024-05-10T14:04:11.379334+0000","last_clean":"2024-05-10T14:04:11.379334+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:04:11.379334+0000","last_undegraded":"2024-05-10T14:04:11.379334+0000","last_fullsized":"2024-05-10T14:04:11.379334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380292+0000","last_change":"2024-05-10T14:02:40.717258+0000","last_active":"2024-05-10T14:04:11.380292+0000","last_peered":"2024-05-10T14:04:11.380292+0000","last_clean":"2024-05-10T14:04:11.380292+0000","last_became_active":"2024-05-10T14:02:40.716512+0000","last_became_peered":"2024-05-10T14:02:40.716512+0000","last_unstale":"2024-05-10T14:04:11.380292+0000","last_undegraded":"2024-05-10T14:04:11.380292+0000","last_fullsized":"2024-05-10T14:04:11.380292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:50.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511192+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:04:09.511192+0000","last_peered":"2024-05-10T14:04:09.511192+0000","last_clean":"2024-05-10T14:04:09.511192+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:04:09.511192+0000","last_undegraded":"2024-05-10T14:04:09.511192+0000","last_fullsized":"2024-05-10T14:04:09.511192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556602+0000","last_change":"2024-05-10T14:02:30.658594+0000","last_active":"2024-05-10T14:04:11.556602+0000","last_peered":"2024-05-10T14:04:11.556602+0000","last_clean":"2024-05-10T14:04:11.556602+0000","last_became_active":"2024-05-10T14:02:30.657831+0000","last_became_peered":"2024-05-10T14:02:30.657831+0000","last_unstale":"2024-05-10T14:04:11.556602+0000","last_undegraded":"2024-05-10T14:04:11.556602+0000","last_fullsized":"2024-05-10T14:04:11.556602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379216+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:04:11.379216+0000","last_peered":"2024-05-10T14:04:11.379216+0000","last_clean":"2024-05-10T14:04:11.379216+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:04:11.379216+0000","last_undegraded":"2024-05-10T14:04:11.379216+0000","last_fullsized":"2024-05-10T14:04:11.379216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.960006+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:04:11.960006+0000","last_peered":"2024-05-10T14:04:11.960006+0000","last_clean":"2024-05-10T14:04:11.960006+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:04:11.960006+0000","last_undegraded":"2024-05-10T14:04:11.960006+0000","last_fullsized":"2024-05-10T14:04:11.960006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555675+0000","last_change":"2024-05-10T14:02:38.720366+0000","last_active":"2024-05-10T14:04:11.555675+0000","last_peered":"2024-05-10T14:04:11.555675+0000","last_clean":"2024-05-10T14:04:11.555675+0000","last_became_active":"2024-05-10T14:02:38.718757+0000","last_became_peered":"2024-05-10T14:02:38.718757+0000","last_unstale":"2024-05-10T14:04:11.555675+0000","last_undegraded":"2024-05-10T14:04:11.555675+0000","last_fullsized":"2024-05-10T14:04:11.555675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:35.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.964834+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:04:11.964834+0000","last_peered":"2024-05-10T14:04:11.964834+0000","last_clean":"2024-05-10T14:04:11.964834+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:04:11.964834+0000","last_undegraded":"2024-05-10T14:04:11.964834+0000","last_fullsized":"2024-05-10T14:04:11.964834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372971+0000","last_change":"2024-05-10T14:03:12.135289+0000","last_active":"2024-05-10T14:04:11.372971+0000","last_peered":"2024-05-10T14:04:11.372971+0000","last_clean":"2024-05-10T14:04:11.372971+0000","last_became_active":"2024-05-10T14:03:12.134860+0000","last_became_peered":"2024-05-10T14:03:12.134860+0000","last_unstale":"2024-05-10T14:04:11.372971+0000","last_undegraded":"2024-05-10T14:04:11.372971+0000","last_fullsized":"2024-05-10T14:04:11.372971+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:35.203379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334950+0000","last_change":"2024-05-10T14:04:06.317808+0000","last_active":"2024-05-10T14:04:08.334950+0000","last_peered":"2024-05-10T14:04:08.334950+0000","last_clean":"2024-05-10T14:04:08.334950+0000","last_became_active":"2024-05-10T14:04:06.316735+0000","last_became_peered":"2024-05-10T14:04:06.316735+0000","last_unstale":"2024-05-10T14:04:08.334950+0000","last_undegraded":"2024-05-10T14:04:08.334950+0000","last_fullsized":"2024-05-10T14:04:08.334950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:38:50.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554877+0000","last_change":"2024-05-10T14:02:34.696377+0000","last_active":"2024-05-10T14:04:11.554877+0000","last_peered":"2024-05-10T14:04:11.554877+0000","last_clean":"2024-05-10T14:04:11.554877+0000","last_became_active":"2024-05-10T14:02:34.689926+0000","last_became_peered":"2024-05-10T14:02:34.689926+0000","last_unstale":"2024-05-10T14:04:11.554877+0000","last_undegraded":"2024-05-10T14:04:11.554877+0000","last_fullsized":"2024-05-10T14:04:11.554877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:51.890848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378978+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:04:11.378978+0000","last_peered":"2024-05-10T14:04:11.378978+0000","last_clean":"2024-05-10T14:04:11.378978+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:04:11.378978+0000","last_undegraded":"2024-05-10T14:04:11.378978+0000","last_fullsized":"2024-05-10T14:04:11.378978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959908+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:04:11.959908+0000","last_peered":"2024-05-10T14:04:11.959908+0000","last_clean":"2024-05-10T14:04:11.959908+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:04:11.959908+0000","last_undegraded":"2024-05-10T14:04:11.959908+0000","last_fullsized":"2024-05-10T14:04:11.959908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336271+0000","last_change":"2024-05-10T14:04:06.318434+0000","last_active":"2024-05-10T14:04:08.336271+0000","last_peered":"2024-05-10T14:04:08.336271+0000","last_clean":"2024-05-10T14:04:08.336271+0000","last_became_active":"2024-05-10T14:04:06.316104+0000","last_became_peered":"2024-05-10T14:04:06.316104+0000","last_unstale":"2024-05-10T14:04:08.336271+0000","last_undegraded":"2024-05-10T14:04:08.336271+0000","last_fullsized":"2024-05-10T14:04:08.336271+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:24.938320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":122,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379772+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:04:11.379772+0000","last_peered":"2024-05-10T14:04:11.379772+0000","last_clean":"2024-05-10T14:04:11.379772+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:04:11.379772+0000","last_undegraded":"2024-05-10T14:04:11.379772+0000","last_fullsized":"2024-05-10T14:04:11.379772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968641+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:04:11.968641+0000","last_peered":"2024-05-10T14:04:11.968641+0000","last_clean":"2024-05-10T14:04:11.968641+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:04:11.968641+0000","last_undegraded":"2024-05-10T14:04:11.968641+0000","last_fullsized":"2024-05-10T14:04:11.968641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959908+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:04:11.959908+0000","last_peered":"2024-05-10T14:04:11.959908+0000","last_clean":"2024-05-10T14:04:11.959908+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:04:11.959908+0000","last_undegraded":"2024-05-10T14:04:11.959908+0000","last_fullsized":"2024-05-10T14:04:11.959908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555170+0000","last_change":"2024-05-10T14:02:36.697566+0000","last_active":"2024-05-10T14:04:11.555170+0000","last_peered":"2024-05-10T14:04:11.555170+0000","last_clean":"2024-05-10T14:04:11.555170+0000","last_became_active":"2024-05-10T14:02:36.696667+0000","last_became_peered":"2024-05-10T14:02:36.696667+0000","last_unstale":"2024-05-10T14:04:11.555170+0000","last_undegraded":"2024-05-10T14:04:11.555170+0000","last_fullsized":"2024-05-10T14:04:11.555170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:01:54.401485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959763+0000","last_change":"2024-05-10T14:02:38.724437+0000","last_active":"2024-05-10T14:04:11.959763+0000","last_peered":"2024-05-10T14:04:11.959763+0000","last_clean":"2024-05-10T14:04:11.959763+0000","last_became_active":"2024-05-10T14:02:38.723564+0000","last_became_peered":"2024-05-10T14:02:38.723564+0000","last_unstale":"2024-05-10T14:04:11.959763+0000","last_undegraded":"2024-05-10T14:04:11.959763+0000","last_fullsized":"2024-05-10T14:04:11.959763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:23.450415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961757+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:04:11.961757+0000","last_peered":"2024-05-10T14:04:11.961757+0000","last_clean":"2024-05-10T14:04:11.961757+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:04:11.961757+0000","last_undegraded":"2024-05-10T14:04:11.961757+0000","last_fullsized":"2024-05-10T14:04:11.961757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379929+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:04:11.379929+0000","last_peered":"2024-05-10T14:04:11.379929+0000","last_clean":"2024-05-10T14:04:11.379929+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:04:11.379929+0000","last_undegraded":"2024-05-10T14:04:11.379929+0000","last_fullsized":"2024-05-10T14:04:11.379929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968740+0000","last_change":"2024-05-10T14:02:34.692857+0000","last_active":"2024-05-10T14:04:11.968740+0000","last_peered":"2024-05-10T14:04:11.968740+0000","last_clean":"2024-05-10T14:04:11.968740+0000","last_became_active":"2024-05-10T14:02:34.691978+0000","last_became_peered":"2024-05-10T14:02:34.691978+0000","last_unstale":"2024-05-10T14:04:11.968740+0000","last_undegraded":"2024-05-10T14:04:11.968740+0000","last_fullsized":"2024-05-10T14:04:11.968740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:35.369058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511961+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:04:09.511961+0000","last_peered":"2024-05-10T14:04:09.511961+0000","last_clean":"2024-05-10T14:04:09.511961+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:04:09.511961+0000","last_undegraded":"2024-05-10T14:04:09.511961+0000","last_fullsized":"2024-05-10T14:04:09.511961+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335830+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:04:08.335830+0000","last_peered":"2024-05-10T14:04:08.335830+0000","last_clean":"2024-05-10T14:04:08.335830+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:04:08.335830+0000","last_undegraded":"2024-05-10T14:04:08.335830+0000","last_fullsized":"2024-05-10T14:04:08.335830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378737+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:04:11.378737+0000","last_peered":"2024-05-10T14:04:11.378737+0000","last_clean":"2024-05-10T14:04:11.378737+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:04:11.378737+0000","last_undegraded":"2024-05-10T14:04:11.378737+0000","last_fullsized":"2024-05-10T14:04:11.378737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968884+0000","last_change":"2024-05-10T14:02:32.679797+0000","last_active":"2024-05-10T14:04:11.968884+0000","last_peered":"2024-05-10T14:04:11.968884+0000","last_clean":"2024-05-10T14:04:11.968884+0000","last_became_active":"2024-05-10T14:02:32.679401+0000","last_became_peered":"2024-05-10T14:02:32.679401+0000","last_unstale":"2024-05-10T14:04:11.968884+0000","last_undegraded":"2024-05-10T14:04:11.968884+0000","last_fullsized":"2024-05-10T14:04:11.968884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510797+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:04:09.510797+0000","last_peered":"2024-05-10T14:04:09.510797+0000","last_clean":"2024-05-10T14:04:09.510797+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:04:09.510797+0000","last_undegraded":"2024-05-10T14:04:09.510797+0000","last_fullsized":"2024-05-10T14:04:09.510797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961574+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:04:11.961574+0000","last_peered":"2024-05-10T14:04:11.961574+0000","last_clean":"2024-05-10T14:04:11.961574+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:04:11.961574+0000","last_undegraded":"2024-05-10T14:04:11.961574+0000","last_fullsized":"2024-05-10T14:04:11.961574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555289+0000","last_change":"2024-05-10T14:04:06.320142+0000","last_active":"2024-05-10T14:04:11.555289+0000","last_peered":"2024-05-10T14:04:11.555289+0000","last_clean":"2024-05-10T14:04:11.555289+0000","last_became_active":"2024-05-10T14:04:06.319511+0000","last_became_peered":"2024-05-10T14:04:06.319511+0000","last_unstale":"2024-05-10T14:04:11.555289+0000","last_undegraded":"2024-05-10T14:04:11.555289+0000","last_fullsized":"2024-05-10T14:04:11.555289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:48.192016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512155+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:04:09.512155+0000","last_peered":"2024-05-10T14:04:09.512155+0000","last_clean":"2024-05-10T14:04:09.512155+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:04:09.512155+0000","last_undegraded":"2024-05-10T14:04:09.512155+0000","last_fullsized":"2024-05-10T14:04:09.512155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959768+0000","last_change":"2024-05-10T14:02:40.717849+0000","last_active":"2024-05-10T14:04:11.959768+0000","last_peered":"2024-05-10T14:04:11.959768+0000","last_clean":"2024-05-10T14:04:11.959768+0000","last_became_active":"2024-05-10T14:02:40.716741+0000","last_became_peered":"2024-05-10T14:02:40.716741+0000","last_unstale":"2024-05-10T14:04:11.959768+0000","last_undegraded":"2024-05-10T14:04:11.959768+0000","last_fullsized":"2024-05-10T14:04:11.959768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:38.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381345+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:04:11.381345+0000","last_peered":"2024-05-10T14:04:11.381345+0000","last_clean":"2024-05-10T14:04:11.381345+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:04:11.381345+0000","last_undegraded":"2024-05-10T14:04:11.381345+0000","last_fullsized":"2024-05-10T14:04:11.381345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372381+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:04:11.372381+0000","last_peered":"2024-05-10T14:04:11.372381+0000","last_clean":"2024-05-10T14:04:11.372381+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:04:11.372381+0000","last_undegraded":"2024-05-10T14:04:11.372381+0000","last_fullsized":"2024-05-10T14:04:11.372381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372926+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:04:11.372926+0000","last_peered":"2024-05-10T14:04:11.372926+0000","last_clean":"2024-05-10T14:04:11.372926+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:04:11.372926+0000","last_undegraded":"2024-05-10T14:04:11.372926+0000","last_fullsized":"2024-05-10T14:04:11.372926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":121,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381377+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:04:11.381377+0000","last_peered":"2024-05-10T14:04:11.381377+0000","last_clean":"2024-05-10T14:04:11.381377+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:04:11.381377+0000","last_undegraded":"2024-05-10T14:04:11.381377+0000","last_fullsized":"2024-05-10T14:04:11.381377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511839+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:04:09.511839+0000","last_peered":"2024-05-10T14:04:09.511839+0000","last_clean":"2024-05-10T14:04:09.511839+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:04:09.511839+0000","last_undegraded":"2024-05-10T14:04:09.511839+0000","last_fullsized":"2024-05-10T14:04:09.511839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.335216+0000","last_change":"2024-05-10T14:04:06.301776+0000","last_active":"2024-05-10T14:04:08.335216+0000","last_peered":"2024-05-10T14:04:08.335216+0000","last_clean":"2024-05-10T14:04:08.335216+0000","last_became_active":"2024-05-10T14:04:06.300995+0000","last_became_peered":"2024-05-10T14:04:06.300995+0000","last_unstale":"2024-05-10T14:04:08.335216+0000","last_undegraded":"2024-05-10T14:04:08.335216+0000","last_fullsized":"2024-05-10T14:04:08.335216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:57.842680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372700+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:04:11.372700+0000","last_peered":"2024-05-10T14:04:11.372700+0000","last_clean":"2024-05-10T14:04:11.372700+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:04:11.372700+0000","last_undegraded":"2024-05-10T14:04:11.372700+0000","last_fullsized":"2024-05-10T14:04:11.372700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966277+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:04:11.966277+0000","last_peered":"2024-05-10T14:04:11.966277+0000","last_clean":"2024-05-10T14:04:11.966277+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:04:11.966277+0000","last_undegraded":"2024-05-10T14:04:11.966277+0000","last_fullsized":"2024-05-10T14:04:11.966277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":101,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512327+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:04:09.512327+0000","last_peered":"2024-05-10T14:04:09.512327+0000","last_clean":"2024-05-10T14:04:09.512327+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:04:09.512327+0000","last_undegraded":"2024-05-10T14:04:09.512327+0000","last_fullsized":"2024-05-10T14:04:09.512327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":116,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372994+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:04:11.372994+0000","last_peered":"2024-05-10T14:04:11.372994+0000","last_clean":"2024-05-10T14:04:11.372994+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:04:11.372994+0000","last_undegraded":"2024-05-10T14:04:11.372994+0000","last_fullsized":"2024-05-10T14:04:11.372994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961115+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:04:11.961115+0000","last_peered":"2024-05-10T14:04:11.961115+0000","last_clean":"2024-05-10T14:04:11.961115+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:04:11.961115+0000","last_undegraded":"2024-05-10T14:04:11.961115+0000","last_fullsized":"2024-05-10T14:04:11.961115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.554856+0000","last_change":"2024-05-10T14:04:06.307890+0000","last_active":"2024-05-10T14:04:11.554856+0000","last_peered":"2024-05-10T14:04:11.554856+0000","last_clean":"2024-05-10T14:04:11.554856+0000","last_became_active":"2024-05-10T14:04:06.307224+0000","last_became_peered":"2024-05-10T14:04:06.307224+0000","last_unstale":"2024-05-10T14:04:11.554856+0000","last_undegraded":"2024-05-10T14:04:11.554856+0000","last_fullsized":"2024-05-10T14:04:11.554856+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:37.194547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371669+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:04:11.371669+0000","last_peered":"2024-05-10T14:04:11.371669+0000","last_clean":"2024-05-10T14:04:11.371669+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:04:11.371669+0000","last_undegraded":"2024-05-10T14:04:11.371669+0000","last_fullsized":"2024-05-10T14:04:11.371669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334677+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:04:08.334677+0000","last_peered":"2024-05-10T14:04:08.334677+0000","last_clean":"2024-05-10T14:04:08.334677+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:04:08.334677+0000","last_undegraded":"2024-05-10T14:04:08.334677+0000","last_fullsized":"2024-05-10T14:04:08.334677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555367+0000","last_change":"2024-05-10T14:02:34.696322+0000","last_active":"2024-05-10T14:04:11.555367+0000","last_peered":"2024-05-10T14:04:11.555367+0000","last_clean":"2024-05-10T14:04:11.555367+0000","last_became_active":"2024-05-10T14:02:34.690005+0000","last_became_peered":"2024-05-10T14:02:34.690005+0000","last_unstale":"2024-05-10T14:04:11.555367+0000","last_undegraded":"2024-05-10T14:04:11.555367+0000","last_fullsized":"2024-05-10T14:04:11.555367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":60,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334821+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:04:08.334821+0000","last_peered":"2024-05-10T14:04:08.334821+0000","last_clean":"2024-05-10T14:04:08.334821+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:04:08.334821+0000","last_undegraded":"2024-05-10T14:04:08.334821+0000","last_fullsized":"2024-05-10T14:04:08.334821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959631+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:04:11.959631+0000","last_peered":"2024-05-10T14:04:11.959631+0000","last_clean":"2024-05-10T14:04:11.959631+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:04:11.959631+0000","last_undegraded":"2024-05-10T14:04:11.959631+0000","last_fullsized":"2024-05-10T14:04:11.959631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556787+0000","last_change":"2024-05-10T14:02:40.709645+0000","last_active":"2024-05-10T14:04:11.556787+0000","last_peered":"2024-05-10T14:04:11.556787+0000","last_clean":"2024-05-10T14:04:11.556787+0000","last_became_active":"2024-05-10T14:02:40.708887+0000","last_became_peered":"2024-05-10T14:02:40.708887+0000","last_unstale":"2024-05-10T14:04:11.556787+0000","last_undegraded":"2024-05-10T14:04:11.556787+0000","last_fullsized":"2024-05-10T14:04:11.556787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:13.057316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372079+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:04:11.372079+0000","last_peered":"2024-05-10T14:04:11.372079+0000","last_clean":"2024-05-10T14:04:11.372079+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:04:11.372079+0000","last_undegraded":"2024-05-10T14:04:11.372079+0000","last_fullsized":"2024-05-10T14:04:11.372079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336262+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:04:08.336262+0000","last_peered":"2024-05-10T14:04:08.336262+0000","last_clean":"2024-05-10T14:04:08.336262+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:04:08.336262+0000","last_undegraded":"2024-05-10T14:04:08.336262+0000","last_fullsized":"2024-05-10T14:04:08.336262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334791+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:04:08.334791+0000","last_peered":"2024-05-10T14:04:08.334791+0000","last_clean":"2024-05-10T14:04:08.334791+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:04:08.334791+0000","last_undegraded":"2024-05-10T14:04:08.334791+0000","last_fullsized":"2024-05-10T14:04:08.334791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959750+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:04:11.959750+0000","last_peered":"2024-05-10T14:04:11.959750+0000","last_clean":"2024-05-10T14:04:11.959750+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:04:11.959750+0000","last_undegraded":"2024-05-10T14:04:11.959750+0000","last_fullsized":"2024-05-10T14:04:11.959750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959638+0000","last_change":"2024-05-10T14:02:38.723402+0000","last_active":"2024-05-10T14:04:11.959638+0000","last_peered":"2024-05-10T14:04:11.959638+0000","last_clean":"2024-05-10T14:04:11.959638+0000","last_became_active":"2024-05-10T14:02:38.722646+0000","last_became_peered":"2024-05-10T14:02:38.722646+0000","last_unstale":"2024-05-10T14:04:11.959638+0000","last_undegraded":"2024-05-10T14:04:11.959638+0000","last_fullsized":"2024-05-10T14:04:11.959638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:07.238482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380382+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:04:11.380382+0000","last_peered":"2024-05-10T14:04:11.380382+0000","last_clean":"2024-05-10T14:04:11.380382+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:04:11.380382+0000","last_undegraded":"2024-05-10T14:04:11.380382+0000","last_fullsized":"2024-05-10T14:04:11.380382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379146+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:04:11.379146+0000","last_peered":"2024-05-10T14:04:11.379146+0000","last_clean":"2024-05-10T14:04:11.379146+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:04:11.379146+0000","last_undegraded":"2024-05-10T14:04:11.379146+0000","last_fullsized":"2024-05-10T14:04:11.379146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.380739+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:04:11.380739+0000","last_peered":"2024-05-10T14:04:11.380739+0000","last_clean":"2024-05-10T14:04:11.380739+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:04:11.380739+0000","last_undegraded":"2024-05-10T14:04:11.380739+0000","last_fullsized":"2024-05-10T14:04:11.380739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371098+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:04:11.371098+0000","last_peered":"2024-05-10T14:04:11.371098+0000","last_clean":"2024-05-10T14:04:11.371098+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:04:11.371098+0000","last_undegraded":"2024-05-10T14:04:11.371098+0000","last_fullsized":"2024-05-10T14:04:11.371098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379702+0000","last_change":"2024-05-10T14:02:36.704879+0000","last_active":"2024-05-10T14:04:11.379702+0000","last_peered":"2024-05-10T14:04:11.379702+0000","last_clean":"2024-05-10T14:04:11.379702+0000","last_became_active":"2024-05-10T14:02:36.702092+0000","last_became_peered":"2024-05-10T14:02:36.702092+0000","last_unstale":"2024-05-10T14:04:11.379702+0000","last_undegraded":"2024-05-10T14:04:11.379702+0000","last_fullsized":"2024-05-10T14:04:11.379702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:35.184821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371423+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:04:11.371423+0000","last_peered":"2024-05-10T14:04:11.371423+0000","last_clean":"2024-05-10T14:04:11.371423+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:04:11.371423+0000","last_undegraded":"2024-05-10T14:04:11.371423+0000","last_fullsized":"2024-05-10T14:04:11.371423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556106+0000","last_change":"2024-05-10T14:02:40.720861+0000","last_active":"2024-05-10T14:04:11.556106+0000","last_peered":"2024-05-10T14:04:11.556106+0000","last_clean":"2024-05-10T14:04:11.556106+0000","last_became_active":"2024-05-10T14:02:40.719228+0000","last_became_peered":"2024-05-10T14:02:40.719228+0000","last_unstale":"2024-05-10T14:04:11.556106+0000","last_undegraded":"2024-05-10T14:04:11.556106+0000","last_fullsized":"2024-05-10T14:04:11.556106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371361+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:04:11.371361+0000","last_peered":"2024-05-10T14:04:11.371361+0000","last_clean":"2024-05-10T14:04:11.371361+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:04:11.371361+0000","last_undegraded":"2024-05-10T14:04:11.371361+0000","last_fullsized":"2024-05-10T14:04:11.371361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968556+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:04:11.968556+0000","last_peered":"2024-05-10T14:04:11.968556+0000","last_clean":"2024-05-10T14:04:11.968556+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:04:11.968556+0000","last_undegraded":"2024-05-10T14:04:11.968556+0000","last_fullsized":"2024-05-10T14:04:11.968556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510308+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:04:09.510308+0000","last_peered":"2024-05-10T14:04:09.510308+0000","last_clean":"2024-05-10T14:04:09.510308+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:04:09.510308+0000","last_undegraded":"2024-05-10T14:04:09.510308+0000","last_fullsized":"2024-05-10T14:04:09.510308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.371599+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:04:11.371599+0000","last_peered":"2024-05-10T14:04:11.371599+0000","last_clean":"2024-05-10T14:04:11.371599+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:04:11.371599+0000","last_undegraded":"2024-05-10T14:04:11.371599+0000","last_fullsized":"2024-05-10T14:04:11.371599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959631+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:04:11.959631+0000","last_peered":"2024-05-10T14:04:11.959631+0000","last_clean":"2024-05-10T14:04:11.959631+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:04:11.959631+0000","last_undegraded":"2024-05-10T14:04:11.959631+0000","last_fullsized":"2024-05-10T14:04:11.959631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372990+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:04:11.372990+0000","last_peered":"2024-05-10T14:04:11.372990+0000","last_clean":"2024-05-10T14:04:11.372990+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:04:11.372990+0000","last_undegraded":"2024-05-10T14:04:11.372990+0000","last_fullsized":"2024-05-10T14:04:11.372990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512900+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:04:09.512900+0000","last_peered":"2024-05-10T14:04:09.512900+0000","last_clean":"2024-05-10T14:04:09.512900+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:04:09.512900+0000","last_undegraded":"2024-05-10T14:04:09.512900+0000","last_fullsized":"2024-05-10T14:04:09.512900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959535+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:04:11.959535+0000","last_peered":"2024-05-10T14:04:11.959535+0000","last_clean":"2024-05-10T14:04:11.959535+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:04:11.959535+0000","last_undegraded":"2024-05-10T14:04:11.959535+0000","last_fullsized":"2024-05-10T14:04:11.959535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512853+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:04:09.512853+0000","last_peered":"2024-05-10T14:04:09.512853+0000","last_clean":"2024-05-10T14:04:09.512853+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:04:09.512853+0000","last_undegraded":"2024-05-10T14:04:09.512853+0000","last_fullsized":"2024-05-10T14:04:09.512853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373700+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:04:11.373700+0000","last_peered":"2024-05-10T14:04:11.373700+0000","last_clean":"2024-05-10T14:04:11.373700+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:04:11.373700+0000","last_undegraded":"2024-05-10T14:04:11.373700+0000","last_fullsized":"2024-05-10T14:04:11.373700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336683+0000","last_change":"2024-05-10T14:04:06.323058+0000","last_active":"2024-05-10T14:04:08.336683+0000","last_peered":"2024-05-10T14:04:08.336683+0000","last_clean":"2024-05-10T14:04:08.336683+0000","last_became_active":"2024-05-10T14:04:06.318770+0000","last_became_peered":"2024-05-10T14:04:06.318770+0000","last_unstale":"2024-05-10T14:04:08.336683+0000","last_undegraded":"2024-05-10T14:04:08.336683+0000","last_fullsized":"2024-05-10T14:04:08.336683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:29:58.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334358+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:04:08.334358+0000","last_peered":"2024-05-10T14:04:08.334358+0000","last_clean":"2024-05-10T14:04:08.334358+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:04:08.334358+0000","last_undegraded":"2024-05-10T14:04:08.334358+0000","last_fullsized":"2024-05-10T14:04:08.334358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.511976+0000","last_change":"2024-05-10T14:02:32.694653+0000","last_active":"2024-05-10T14:04:09.511976+0000","last_peered":"2024-05-10T14:04:09.511976+0000","last_clean":"2024-05-10T14:04:09.511976+0000","last_became_active":"2024-05-10T14:02:32.694331+0000","last_became_peered":"2024-05-10T14:02:32.694331+0000","last_unstale":"2024-05-10T14:04:09.511976+0000","last_undegraded":"2024-05-10T14:04:09.511976+0000","last_fullsized":"2024-05-10T14:04:09.511976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:08.892255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966457+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:04:11.966457+0000","last_peered":"2024-05-10T14:04:11.966457+0000","last_clean":"2024-05-10T14:04:11.966457+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:04:11.966457+0000","last_undegraded":"2024-05-10T14:04:11.966457+0000","last_fullsized":"2024-05-10T14:04:11.966457+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379386+0000","last_change":"2024-05-10T14:02:32.676958+0000","last_active":"2024-05-10T14:04:11.379386+0000","last_peered":"2024-05-10T14:04:11.379386+0000","last_clean":"2024-05-10T14:04:11.379386+0000","last_became_active":"2024-05-10T14:02:32.676652+0000","last_became_peered":"2024-05-10T14:02:32.676652+0000","last_unstale":"2024-05-10T14:04:11.379386+0000","last_undegraded":"2024-05-10T14:04:11.379386+0000","last_fullsized":"2024-05-10T14:04:11.379386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:53.398546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381514+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:04:11.381514+0000","last_peered":"2024-05-10T14:04:11.381514+0000","last_clean":"2024-05-10T14:04:11.381514+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:04:11.381514+0000","last_undegraded":"2024-05-10T14:04:11.381514+0000","last_fullsized":"2024-05-10T14:04:11.381514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372260+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:04:11.372260+0000","last_peered":"2024-05-10T14:04:11.372260+0000","last_clean":"2024-05-10T14:04:11.372260+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:04:11.372260+0000","last_undegraded":"2024-05-10T14:04:11.372260+0000","last_fullsized":"2024-05-10T14:04:11.372260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.512544+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:04:09.512544+0000","last_peered":"2024-05-10T14:04:09.512544+0000","last_clean":"2024-05-10T14:04:09.512544+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:04:09.512544+0000","last_undegraded":"2024-05-10T14:04:09.512544+0000","last_fullsized":"2024-05-10T14:04:09.512544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379016+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:04:11.379016+0000","last_peered":"2024-05-10T14:04:11.379016+0000","last_clean":"2024-05-10T14:04:11.379016+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:04:11.379016+0000","last_undegraded":"2024-05-10T14:04:11.379016+0000","last_fullsized":"2024-05-10T14:04:11.379016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961850+0000","last_change":"2024-05-10T14:02:30.661133+0000","last_active":"2024-05-10T14:04:11.961850+0000","last_peered":"2024-05-10T14:04:11.961850+0000","last_clean":"2024-05-10T14:04:11.961850+0000","last_became_active":"2024-05-10T14:02:30.660134+0000","last_became_peered":"2024-05-10T14:02:30.660134+0000","last_unstale":"2024-05-10T14:04:11.961850+0000","last_undegraded":"2024-05-10T14:04:11.961850+0000","last_fullsized":"2024-05-10T14:04:11.961850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.959384+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:04:11.959384+0000","last_peered":"2024-05-10T14:04:11.959384+0000","last_clean":"2024-05-10T14:04:11.959384+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:04:11.959384+0000","last_undegraded":"2024-05-10T14:04:11.959384+0000","last_fullsized":"2024-05-10T14:04:11.959384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.381189+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:04:11.381189+0000","last_peered":"2024-05-10T14:04:11.381189+0000","last_clean":"2024-05-10T14:04:11.381189+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:04:11.381189+0000","last_undegraded":"2024-05-10T14:04:11.381189+0000","last_fullsized":"2024-05-10T14:04:11.381189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968471+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:04:11.968471+0000","last_peered":"2024-05-10T14:04:11.968471+0000","last_clean":"2024-05-10T14:04:11.968471+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:04:11.968471+0000","last_undegraded":"2024-05-10T14:04:11.968471+0000","last_fullsized":"2024-05-10T14:04:11.968471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.333854+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:04:08.333854+0000","last_peered":"2024-05-10T14:04:08.333854+0000","last_clean":"2024-05-10T14:04:08.333854+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:04:08.333854+0000","last_undegraded":"2024-05-10T14:04:08.333854+0000","last_fullsized":"2024-05-10T14:04:08.333854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373351+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:04:11.373351+0000","last_peered":"2024-05-10T14:04:11.373351+0000","last_clean":"2024-05-10T14:04:11.373351+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:04:11.373351+0000","last_undegraded":"2024-05-10T14:04:11.373351+0000","last_fullsized":"2024-05-10T14:04:11.373351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.379228+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:04:11.379228+0000","last_peered":"2024-05-10T14:04:11.379228+0000","last_clean":"2024-05-10T14:04:11.379228+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:04:11.379228+0000","last_undegraded":"2024-05-10T14:04:11.379228+0000","last_fullsized":"2024-05-10T14:04:11.379228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.375435+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:04:11.375435+0000","last_peered":"2024-05-10T14:04:11.375435+0000","last_clean":"2024-05-10T14:04:11.375435+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:04:11.375435+0000","last_undegraded":"2024-05-10T14:04:11.375435+0000","last_fullsized":"2024-05-10T14:04:11.375435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.373218+0000","last_change":"2024-05-10T14:03:12.136220+0000","last_active":"2024-05-10T14:04:11.373218+0000","last_peered":"2024-05-10T14:04:11.373218+0000","last_clean":"2024-05-10T14:04:11.373218+0000","last_became_active":"2024-05-10T14:03:12.135794+0000","last_became_peered":"2024-05-10T14:03:12.135794+0000","last_unstale":"2024-05-10T14:04:11.373218+0000","last_undegraded":"2024-05-10T14:04:11.373218+0000","last_fullsized":"2024-05-10T14:04:11.373218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:28.642294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.372658+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:04:11.372658+0000","last_peered":"2024-05-10T14:04:11.372658+0000","last_clean":"2024-05-10T14:04:11.372658+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:04:11.372658+0000","last_undegraded":"2024-05-10T14:04:11.372658+0000","last_fullsized":"2024-05-10T14:04:11.372658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":113,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.966643+0000","last_change":"2024-05-10T14:02:30.649699+0000","last_active":"2024-05-10T14:04:11.966643+0000","last_peered":"2024-05-10T14:04:11.966643+0000","last_clean":"2024-05-10T14:04:11.966643+0000","last_became_active":"2024-05-10T14:02:30.649387+0000","last_became_peered":"2024-05-10T14:02:30.649387+0000","last_unstale":"2024-05-10T14:04:11.966643+0000","last_undegraded":"2024-05-10T14:04:11.966643+0000","last_fullsized":"2024-05-10T14:04:11.966643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555815+0000","last_change":"2024-05-10T14:02:32.678800+0000","last_active":"2024-05-10T14:04:11.555815+0000","last_peered":"2024-05-10T14:04:11.555815+0000","last_clean":"2024-05-10T14:04:11.555815+0000","last_became_active":"2024-05-10T14:02:32.678058+0000","last_became_peered":"2024-05-10T14:02:32.678058+0000","last_unstale":"2024-05-10T14:04:11.555815+0000","last_undegraded":"2024-05-10T14:04:11.555815+0000","last_fullsized":"2024-05-10T14:04:11.555815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961241+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:04:11.961241+0000","last_peered":"2024-05-10T14:04:11.961241+0000","last_clean":"2024-05-10T14:04:11.961241+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:04:11.961241+0000","last_undegraded":"2024-05-10T14:04:11.961241+0000","last_fullsized":"2024-05-10T14:04:11.961241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.961208+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:04:11.961208+0000","last_peered":"2024-05-10T14:04:11.961208+0000","last_clean":"2024-05-10T14:04:11.961208+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:04:11.961208+0000","last_undegraded":"2024-05-10T14:04:11.961208+0000","last_fullsized":"2024-05-10T14:04:11.961208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.556760+0000","last_change":"2024-05-10T14:02:30.665729+0000","last_active":"2024-05-10T14:04:11.556760+0000","last_peered":"2024-05-10T14:04:11.556760+0000","last_clean":"2024-05-10T14:04:11.556760+0000","last_became_active":"2024-05-10T14:02:30.665012+0000","last_became_peered":"2024-05-10T14:02:30.665012+0000","last_unstale":"2024-05-10T14:04:11.556760+0000","last_undegraded":"2024-05-10T14:04:11.556760+0000","last_fullsized":"2024-05-10T14:04:11.556760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:40:44.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.378929+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:04:11.378929+0000","last_peered":"2024-05-10T14:04:11.378929+0000","last_clean":"2024-05-10T14:04:11.378929+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:04:11.378929+0000","last_undegraded":"2024-05-10T14:04:11.378929+0000","last_fullsized":"2024-05-10T14:04:11.378929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.376100+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:04:11.376100+0000","last_peered":"2024-05-10T14:04:11.376100+0000","last_clean":"2024-05-10T14:04:11.376100+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:04:11.376100+0000","last_undegraded":"2024-05-10T14:04:11.376100+0000","last_fullsized":"2024-05-10T14:04:11.376100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.555064+0000","last_change":"2024-05-10T14:02:32.688681+0000","last_active":"2024-05-10T14:04:11.555064+0000","last_peered":"2024-05-10T14:04:11.555064+0000","last_clean":"2024-05-10T14:04:11.555064+0000","last_became_active":"2024-05-10T14:02:32.687719+0000","last_became_peered":"2024-05-10T14:02:32.687719+0000","last_unstale":"2024-05-10T14:04:11.555064+0000","last_undegraded":"2024-05-10T14:04:11.555064+0000","last_fullsized":"2024-05-10T14:04:11.555064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336151+0000","last_change":"2024-05-10T14:04:06.322414+0000","last_active":"2024-05-10T14:04:08.336151+0000","last_peered":"2024-05-10T14:04:08.336151+0000","last_clean":"2024-05-10T14:04:08.336151+0000","last_became_active":"2024-05-10T14:04:06.321836+0000","last_became_peered":"2024-05-10T14:04:06.321836+0000","last_unstale":"2024-05-10T14:04:08.336151+0000","last_undegraded":"2024-05-10T14:04:08.336151+0000","last_fullsized":"2024-05-10T14:04:08.336151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:57:29.756774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.334141+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:04:08.334141+0000","last_peered":"2024-05-10T14:04:08.334141+0000","last_clean":"2024-05-10T14:04:08.334141+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:04:08.334141+0000","last_undegraded":"2024-05-10T14:04:08.334141+0000","last_fullsized":"2024-05-10T14:04:08.334141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-05-10T14:04:11.968383+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:04:11.968383+0000","last_peered":"2024-05-10T14:04:11.968383+0000","last_clean":"2024-05-10T14:04:11.968383+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:04:11.968383+0000","last_undegraded":"2024-05-10T14:04:11.968383+0000","last_fullsized":"2024-05-10T14:04:11.968383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T14:04:09.510674+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:04:09.510674+0000","last_peered":"2024-05-10T14:04:09.510674+0000","last_clean":"2024-05-10T14:04:09.510674+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:04:09.510674+0000","last_undegraded":"2024-05-10T14:04:09.510674+0000","last_fullsized":"2024-05-10T14:04:09.510674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-10T14:04:08.336660+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:04:08.336660+0000","last_peered":"2024-05-10T14:04:08.336660+0000","last_clean":"2024-05-10T14:04:08.336660+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:04:08.336660+0000","last_undegraded":"2024-05-10T14:04:08.336660+0000","last_fullsized":"2024-05-10T14:04:08.336660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":685,"num_read_kb":444,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":390,"ondisk_log_size":390,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1082621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":492029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710722,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":925696,"data_stored":469966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":492084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335588,"statfs":{"total":96636764160,"available":96599642112,"internally_reserved":0,"allocated":929792,"data_stored":491989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":901120,"data_stored":491155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1503232,"data_stored":1074647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":905216,"data_stored":476211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:04:14.380 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T14:04:14.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:04:14.400 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:14.396+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:14.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:04:14.431 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:14.431 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:14.431 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:14.431 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:14.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:14.500 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:14.499+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:14.601 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:14.600+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:14.607 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:14.607 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:14.608 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:14.608 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:14.608 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:14.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:14.710 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:14.708+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 98.102437746999996, 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.074599579999997, 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.060840857000002, 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.977937264000005, 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.951599505000004, 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.950509453999999, 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.947622397999993, 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.945043995000006, 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.913764698999998, 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.862126394000001, 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.777980244000005, 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.773934714000006, 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.707669733000003, 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.670584445000003, 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.663451602999999, 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.461710537000002, 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.305780479000006, 2024-05-10T14:04:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.298749999999998, 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.200948272000005, 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.193641877999994, 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:14.907 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:14.909 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:14.910 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:14.904+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:15.009 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:15.008+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:15.083 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:15.083 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:15.083 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:15.084 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:15.097 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:15.111 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:15.111+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:15.211 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:15.208+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:15.270 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:15.271 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:15.271 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:15.271 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:15.271 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:15.285 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:15.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:15.326 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:15.324+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:15.413 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:04:15.413 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:15.411+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:15.434 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:15.452 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:15.453 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.71092458699999, 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:04:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:04:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:04:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.758318845999995, 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:04:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.730874872000001, 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:04:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:04:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:04:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:04:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.717617418000003, 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:04:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.715045501999995, 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.618432910999999, 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.702318086999995, 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:04:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.662976479999998, 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:04:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:04:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.604006515999998, 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.588464883, 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.587958850000007, 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.583739331999993, 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:04:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:04:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.568674333999994, 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:04:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.567288312000002, 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:04:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:04:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.562346848000004, 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:04:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:04:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.561891000000003, 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:04:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:04:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.546871734000007, 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:04:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:04:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:04:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.541805713000002, 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:04:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:04:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 93.447835612999995, 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:04:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.638223878000005, 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:15.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:15.549 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:15.550 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:15.550 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:15.551 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:15.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:15.552 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:15.548+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:15.552 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:15.552 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:15.553 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:15.553 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:15.553 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:15.553 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:15.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:15.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:15.651 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:15.651+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:15.721 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:15.722 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:15.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:15.781 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:15.780+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:15.853 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:15.848+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:15.858 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:15.858 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:15.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:15.953 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:15.951+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:16.039 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.039 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:16.054 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:16.055+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:16.155 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:16.152+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:16.172 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.173 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:16.256 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:16.255+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:16.351 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.351 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.357 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:16.356+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:16.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:16.458 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:16.456+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:16.538 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.538 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:16.599 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:16.599+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:16.660 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:16.656+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:16.679 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.680 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:16.761 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:16.756+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:16.862 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:16.859+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:16.867 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:16.867 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:16.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:16.963 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:16.960+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:17.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:17.064 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:17.060+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:17.165 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:17.164+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:17.181 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:17.181 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:17.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:17.266 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:17.264+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:17.315 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:17.315 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:17.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:17.367 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:17.364+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:17.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:04:17.465 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:17.465 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:17.467 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:17.467+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:17.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:17.568 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:17.564+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:17.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:17.635 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:17.635 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:17.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:17.669 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:17.668+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:17.732 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:17.732 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:17.761 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:17.761 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:17.770 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:17.768+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:17.780 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:17.780 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:17.798 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:17.798 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:17.813 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:04:17.818 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:17.819 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:17.825 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:17.825 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:17.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:17.845 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:17.846 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:17.866 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:17.866 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:17.870 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:17.871+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:17.902 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:17.902 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 99.230321468, 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.141346382999998, 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.128078990000006, 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.122483548000005, 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.804470262999999, 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.800416996999999, 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.762792099999999, 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.631619504, 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.627611181000006, 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.574696869999997, 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.561087194999999, 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.556998683000003, 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:18.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.510662449999998, 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:18.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.506901799999994, 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.419607521000003, 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.051 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:18.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:18.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.415767896000006, 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.321637899999999, 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.307478786000004, 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:18.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:18.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.303677488000005, 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.074 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:18.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:18.079 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.668183882000001, 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.080 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:18.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:18.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.085 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:18.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:18.087 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:18.087+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:18.188 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:18.188+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:18.246 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:18.247 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:18.247 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:18.247 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:18.260 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:18.289 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:18.284+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:18.390 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:18.387+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:18.391 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:18.392 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:18.392 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:18.392 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:18.392 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:18.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:18.491 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:18.491+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:18.544 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 97% (11759/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-05-10T14:04:18.572 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:18.572 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:18.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 99.829391076999997, 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:18.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:18.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:18.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 99.829298605999995, 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.579 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:18.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:18.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:18.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.859053747000004, 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:18.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:18.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:18.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.816811626000003, 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:18.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:18.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:18.596 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.777512160000001, 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:18.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:18.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.770507744, 2024-05-10T14:04:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:18.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:18.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.762901962000001, 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:18.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:18.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:18.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:18.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.705625955000002, 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:18.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:18.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.694508378999998, 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:18.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:18.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:18.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.569668849999999, 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:18.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:18.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.474013689000003, 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:18.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:18.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:18.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.469875416999997, 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:18.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:18.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.437123693999993, 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:18.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:18.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:18.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:18.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:18.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.272441494999995, 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:18.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.215234787, 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:18.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.073058079999996, 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:18.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:18.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.052372453999993, 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:18.663 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:18.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.045816314000007, 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.960871846000003, 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:18.674 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.679 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 95.953949007000006, 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:18.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:18.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:18.685 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:18.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:18.687 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:18.684+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:18.788 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:18.784+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:18.819 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:18.819 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:18.819 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:18.819 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:18.834 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:18.888 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:18.887+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:18.989 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:18.988+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:19.001 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:19.001 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:19.002 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:19.002 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:19.002 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:19.016 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:19.102 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:19.100+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:19.186 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 102.49469940100001, 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:19.187 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:19.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.191 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.46686123400001, 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.453102510999997, 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.196 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:19.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:19.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.370198918, 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:19.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:19.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.343861158999999, 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.342771107999994, 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:19.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:19.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.339884052000002, 2024-05-10T14:04:19.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.337305649000001, 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:19.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:19.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:19.228 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.306026352999993, 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:19.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:19.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:19.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.254388047999996, 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.234 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:19.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.239 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.170241898, 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:19.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.166196368000001, 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.245 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.099931386999998, 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:19.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:19.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.256 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.062846098999998, 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.055713256999994, 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:19.262 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:19.267 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.853972190999997, 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:19.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.273 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.698042133000001, 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.691011653999993, 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:19.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.593209926, 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:19.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 96.585903532000003, 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:19.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:19.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:19.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.299 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:19.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:19.301 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:19.296+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:19.402 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:19.399+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to '7ef97a7233c4db41f8dc134b8d64f95427147ce5'. 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T14:04:19.405 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-05-10T14:04:19.406 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at 7ef97a7233c RGW: Rename rgw::sal::Object::get_obj_size() to get_size() 2024-05-10T14:04:19.414 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-10T14:04:19.460 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T14:04:19.463 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T14:04:19.463 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T14:04:19.470 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:19.471 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:19.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:19.530 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:19.528+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:19.604 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:19.603+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:19.608 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:19.608 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:19.609 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:19.609 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:19.609 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:19.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:19.705 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:19.703+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.04624651899999, 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:04:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.09364077799999, 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.798 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:19.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:04:19.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:04:19.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.804 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.066196804, 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.805 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:04:19.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:04:19.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.05293935, 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.811 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:04:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:04:19.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.05036743399999, 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.817 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.822 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.953754843, 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:04:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 98.037640018999994, 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:04:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:04:19.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.998298411999997, 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:04:19.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:04:19.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.836 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.939328447999998, 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:04:19.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:04:19.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:04:19.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.923786815, 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:04:19.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:04:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.923280782000006, 2024-05-10T14:04:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:04:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.919061264000007, 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:04:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:04:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:04:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.903996266000007, 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:04:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:04:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:19.858 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.902610244000002, 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:04:19.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:04:19.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.897668780000004, 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:04:19.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:04:19.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.897212932000002, 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.867 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:04:19.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.871 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.882193666000006, 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:04:19.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:04:19.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.877127645000002, 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.876 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:04:19.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:04:19.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 97.783157544999995, 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:04:19.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 79.973545810000005, 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:19.885 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:04:19.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:19.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:19.890 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:19.890 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:19.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:04:19.892 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:19.891+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:19.892 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:19.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:19.992 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:19.988+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:20.023 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:20.024 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:20.038 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:20.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:20.079 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:20.093 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:20.091+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:20.094 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:20.095 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:20.111 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:20.111 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:20.127 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:20.128 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:20.147 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:20.147 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:20.165 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:20.165 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:20.184 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:20.184 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:20.194 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:20.192+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:20.195 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T14:04:20.204 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:20.206 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.206 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.220 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:20.271 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T14:04:20.295 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:20.295+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:20.318 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T14:04:20.319 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T14:04:20.319 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T14:04:20.360 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T14:04:20.363 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-10T14:04:20.363 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-10T14:04:20.391 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.391 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:20.407 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:20.407+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:20.411 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-05-10T14:04:20.412 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-05-10T14:04:20.412 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7ef97a7233c4db41f8dc134b8d64f95427147ce5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-05-10T14:04:20.499 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:20.499+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:20.528 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.528 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.542 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:20.597 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:20.596+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:20.667 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.667 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:20.722 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:20.720+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-05-10T14:04:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-05-10T14:04:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115113 s, 911 MB/s 2024-05-10T14:04:20.799 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:20.799+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:20.900 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:20.896+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:20.974 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_04_10_14_04_20 2024-05-10T14:04:20.979 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:20.979 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:20.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:21.001 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:21.000+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:21.102 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:21.100+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:21.113 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.113 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.118 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:04:21.128 INFO:tasks.workunit.client.0.smithi016.stdout:quota set for the bucket: buck_2024_04_10_14_04_20 2024-05-10T14:04:21.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:21.204 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:21.200+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:21.250 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.250 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:21.305 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:21.300+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:21.397 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.398 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.406 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:21.404+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:21.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_04_10_14_04_20 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 10Mb. 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - Test max objects passed 2024-05-10T14:04:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T14:04:21.507 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:21.507+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:21.635 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:21.635+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:21.636 INFO:tasks.rgw.client.0.smithi016.stdout:*** Caught signal (Segmentation fault) ** 2024-05-10T14:04:21.636 INFO:tasks.rgw.client.0.smithi016.stdout: in thread 7f81b01f6640 thread_name:io_context_pool 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: ceph version 19.0.0-3577-g7ef97a72 (7ef97a7233c4db41f8dc134b8d64f95427147ce5) squid (dev) 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8298ba2520] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 2: (rgw::sal::RadosObject::load_obj_state(DoutPrefixProvider const*, optional_yield, bool)+0x190) [0x55ae09598a50] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 3: (RGWDeleteObj::execute(optional_yield)+0x131) [0x55ae09383211] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 4: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xa38) [0x55ae0920a258] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 5: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0x21f1) [0x55ae09219b61] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 6: radosgw(+0x11757c7) [0x55ae09d927c7] 2024-05-10T14:04:21.638 INFO:tasks.rgw.client.0.smithi016.stdout: 7: radosgw(+0x560d14) [0x55ae0917dd14] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 8: make_fcontext() 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout:2024-05-10T14:04:21.635+0000 7f81b01f6640 -1 *** Caught signal (Segmentation fault) ** 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: in thread 7f81b01f6640 thread_name:io_context_pool 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: ceph version 19.0.0-3577-g7ef97a72 (7ef97a7233c4db41f8dc134b8d64f95427147ce5) squid (dev) 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8298ba2520] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 2: (rgw::sal::RadosObject::load_obj_state(DoutPrefixProvider const*, optional_yield, bool)+0x190) [0x55ae09598a50] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 3: (RGWDeleteObj::execute(optional_yield)+0x131) [0x55ae09383211] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 4: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xa38) [0x55ae0920a258] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 5: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0x21f1) [0x55ae09219b61] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 6: radosgw(+0x11757c7) [0x55ae09d927c7] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 7: radosgw(+0x560d14) [0x55ae0917dd14] 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 8: make_fcontext() 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-10T14:04:21.639 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: -786> 2024-05-10T14:02:41.868+0000 7f8296403a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: 0> 2024-05-10T14:04:21.635+0000 7f81b01f6640 -1 *** Caught signal (Segmentation fault) ** 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: in thread 7f81b01f6640 thread_name:io_context_pool 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: ceph version 19.0.0-3577-g7ef97a72 (7ef97a7233c4db41f8dc134b8d64f95427147ce5) squid (dev) 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8298ba2520] 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: 2: (rgw::sal::RadosObject::load_obj_state(DoutPrefixProvider const*, optional_yield, bool)+0x190) [0x55ae09598a50] 2024-05-10T14:04:21.640 INFO:tasks.rgw.client.0.smithi016.stdout: 3: (RGWDeleteObj::execute(optional_yield)+0x131) [0x55ae09383211] 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 4: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xa38) [0x55ae0920a258] 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 5: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0x21f1) [0x55ae09219b61] 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 6: radosgw(+0x11757c7) [0x55ae09d927c7] 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 7: radosgw(+0x560d14) [0x55ae0917dd14] 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 8: make_fcontext() 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.641 INFO:tasks.rgw.client.0.smithi016.stdout: -786> 2024-05-10T14:02:41.868+0000 7f8296403a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 0> 2024-05-10T14:04:21.635+0000 7f81b01f6640 -1 *** Caught signal (Segmentation fault) ** 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: in thread 7f81b01f6640 thread_name:io_context_pool 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: ceph version 19.0.0-3577-g7ef97a72 (7ef97a7233c4db41f8dc134b8d64f95427147ce5) squid (dev) 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8298ba2520] 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 2: (rgw::sal::RadosObject::load_obj_state(DoutPrefixProvider const*, optional_yield, bool)+0x190) [0x55ae09598a50] 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 3: (RGWDeleteObj::execute(optional_yield)+0x131) [0x55ae09383211] 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 4: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xa38) [0x55ae0920a258] 2024-05-10T14:04:21.642 INFO:tasks.rgw.client.0.smithi016.stdout: 5: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0x21f1) [0x55ae09219b61] 2024-05-10T14:04:21.643 INFO:tasks.rgw.client.0.smithi016.stdout: 6: radosgw(+0x11757c7) [0x55ae09d927c7] 2024-05-10T14:04:21.643 INFO:tasks.rgw.client.0.smithi016.stdout: 7: radosgw(+0x560d14) [0x55ae0917dd14] 2024-05-10T14:04:21.643 INFO:tasks.rgw.client.0.smithi016.stdout: 8: make_fcontext() 2024-05-10T14:04:21.643 INFO:tasks.rgw.client.0.smithi016.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-10T14:04:21.643 INFO:tasks.rgw.client.0.smithi016.stdout: 2024-05-10T14:04:21.705 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.705 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.709 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:21.707+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:21.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:21.810 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:21.808+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:21.876 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:21.877 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:21.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:21.935 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:21.935+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:22.003 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:22.003 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:22.011 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:22.008+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:22.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:22.112 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:22.108+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:22.183 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:22.183 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:22.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:22.213 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:22.208+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:22.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:22.313 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:22.312+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:22.327 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:22.327 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:22.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:22.414 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:22.411+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:22.466 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:22.467 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:22.470 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:22.470 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:22.485 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:22.485 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:22.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:22.505 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:22.505 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:22.523 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:22.524 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:22.524 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:22.523+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:22.544 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:22.544 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:22.565 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:22.566 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:22.587 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:22.587 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:22.608 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:22.616 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:22.615+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 103.88433183799999, 2024-05-10T14:04:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 103.88423936700001, 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.913994508, 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.871752387, 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.832452921, 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.825448505, 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.817842723, 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.760566716, 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.74944914, 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.624609611, 2024-05-10T14:04:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.52895445, 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.52481617799999, 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.492064455, 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.32738225600001, 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.270175548, 2024-05-10T14:04:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.12799884099999, 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.107313215, 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.100757075, 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.015812607, 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.008889768, 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:22.746 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:22.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:22.748 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:22.744+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:22.849 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:22.847+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:22.881 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:22.881 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:22.881 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:22.881 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:22.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:22.950 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:22.947+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:23.012 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:23.012 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:23.012 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:23.012 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:23.012 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:23.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:23.051 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:23.051+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:23.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:04:23.149 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:23.149 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:23.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.456687561, 2024-05-10T14:04:23.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.151 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:23.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:23.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:23.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 104.428849394, 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:23.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.162 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.415090671, 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:23.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:23.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.171 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.171 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:23.171 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.332187078, 2024-05-10T14:04:23.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:23.171 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.172 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:23.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:23.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:23.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.179 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:23.182 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.305849319, 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:23.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:23.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:23.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.190 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.304759268, 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:23.191 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:23.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:23.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.30187221200001, 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:23.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:23.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:23.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:23.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.29929380900001, 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:23.201 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:23.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.268014513, 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.206 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:23.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:23.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:23.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.216376208, 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:23.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.132230058, 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:23.217 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:23.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.12818452800001, 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.223 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:23.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.061919547, 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.229 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:23.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:23.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.024834259, 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.235 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:23.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.240 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.017701417, 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.241 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.246 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.815960351, 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.247 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.252 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.66003029300001, 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.652999814, 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.258 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:23.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.555198086, 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:23.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.266 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:23.269 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 100.54789169199999, 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:23.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.275 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:23.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:23.277 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:23.272+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:23.378 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:23.375+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:23.447 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:23.447 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:23.447 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:23.447 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:23.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:23.506 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:23.504+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:23.581 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:23.579+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:23.583 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:23.583 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:23.583 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:23.583 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:23.584 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:23.598 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:23.686 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:23.684+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.02001826, 2024-05-10T14:04:23.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:23.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:04:23.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.067412519, 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:04:23.772 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:23.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:04:23.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:04:23.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:23.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:04:23.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.03996854499999, 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.780 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:04:23.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:04:23.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.026711091, 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:04:23.787 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:23.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:04:23.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:04:23.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:04:23.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:23.796 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.024139175, 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:04:23.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:04:23.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:04:23.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.803 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 104.92752658400001, 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:04:23.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 102.01141176, 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.809 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:04:23.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:04:23.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.972070153, 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.814 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:04:23.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.91310018900001, 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:04:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:04:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.89755855600001, 2024-05-10T14:04:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:04:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:04:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.897052523, 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.892833005, 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:04:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:04:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.877768007, 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.87638198499999, 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:04:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:04:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.871440521, 2024-05-10T14:04:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:04:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.870984673, 2024-05-10T14:04:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:04:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.855965407, 2024-05-10T14:04:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:04:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.85089938599999, 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:04:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:04:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 101.756929286, 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:04:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:04:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.947317550999998, 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:04:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:04:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:23.880 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:23.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:23.882 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:23.879+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:23.983 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:23.980+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:24.011 INFO:tasks.rgw.client.0.smithi016.stderr:daemon-helper: command crashed with signal 11 2024-05-10T14:04:24.053 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:24.053 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:24.053 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:24.053 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:24.067 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:24.084 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:24.083+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:24.145 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:24.184 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:24.180+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:24.236 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:24.236 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:24.236 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:24.236 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:24.236 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:24.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:24.298 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:24.296+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:24.387 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:24.387+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:24.427 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.87815204899999, 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:04:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.255248292, 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.436 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:04:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:04:24.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:04:24.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:04:24.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.159714646, 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.447 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:04:24.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:04:24.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:04:24.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.454 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.15966044, 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:04:24.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.15962356999999, 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.461 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:04:24.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:04:24.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.159462025, 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:04:24.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.159408685, 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:04:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:04:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:04:24.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:24.481 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.159350766, 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:04:24.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.15922101699999, 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:04:24.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 124.15918256, 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.493 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:04:24.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:04:24.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93205943700001, 2024-05-10T14:04:24.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:04:24.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:04:24.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:04:24.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93185199200001, 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.505 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:24.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:04:24.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:04:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.931738106, 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.511 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:04:24.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:04:24.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:04:24.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.931569701, 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:04:24.517 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:04:24.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:04:24.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:04:24.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:04:24.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.528 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93153214100001, 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.529 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:04:24.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:04:24.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:04:24.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:04:24.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:04:24.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:04:24.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:04:24.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:04:24.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:04:24.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:04:24.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:04:24.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93147872500001, 2024-05-10T14:04:24.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:04:24.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:24.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:04:24.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:04:24.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93135343599999, 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.550 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:04:24.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:04:24.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.931313293, 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:04:24.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.93126091000001, 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.562 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:04:24.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:04:24.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:04:24.567 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 123.931076512, 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:24.568 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:04:24.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:04:24.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:24.574 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:24.575 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:24.575 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:24.572+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:24.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:24.676 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:24.672+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:24.751 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:24.751 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:24.752 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:24.752 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:24.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:24.777 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:24.775+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:24.787 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:24.787 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:24.804 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:24.822 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:24.823 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:24.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:24.839 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:24.858 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:24.858 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:24.877 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:24.878 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:24.878 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:24.876+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:24.898 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:24.898 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:24.920 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:24.920 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:24.927 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:24.927 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:24.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:24.983 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:24.983+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:25.080 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:25.076+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:25.108 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.108 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:25.181 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:25.179+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:25.260 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.260 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:25.282 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:25.280+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:25.383 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:25.380+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:25.440 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.440 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:25.483 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:25.480+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:25.574 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.575 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.584 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:25.580+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:25.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:25.685 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:25.683+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:25.713 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.713 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:25.815 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:25.815+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:25.888 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:25.884+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:25.896 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:25.897 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:25.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:25.999 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:25.999+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:26.074 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.074 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:26.090 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:26.088+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:26.172 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:04:26.219 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:26.219+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:26.255 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.256 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:26.315 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:26.315+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:26.394 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:26.392+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:26.431 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.432 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:26.495 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:26.492+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:26.578 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.579 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:26.595 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:26.592+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:26.696 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:26.695+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:26.721 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.721 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.735 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:26.823 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:26.823+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:26.898 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:26.896+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:26.904 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:26.905 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:26.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:26.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:26.999 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:26.996+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:27.100 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:27.096+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:27.101 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:27.101 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:27.117 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:27.123 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:27.124 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:27.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:27.141 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:27.157 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:27.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:27.176 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:27.196 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:27.196 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:27.198 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:04:27.204 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:27.199+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:27.219 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:27.219 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:27.240 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:27.252 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:27.252 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:27.252 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:27.252 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:27.260 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:27.261 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:27.267 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:27.314 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:27.312+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:27.384 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:27.384 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:27.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:27.442 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:27.440+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:27.503 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:27.500+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:27.570 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.878379307, 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:04:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:04:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 108.85054114, 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:04:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.83678241699999, 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:04:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:04:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:04:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.753878824, 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:04:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:04:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:04:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:04:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.727541065, 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:04:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.72645101400001, 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.723563958, 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:04:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.720985555, 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:04:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.689706259, 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:04:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.63806795399999, 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:04:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:04:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:04:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.553921804, 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.549876274, 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:04:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.483611293, 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.446526005, 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:04:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.43939316300001, 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.23765209699999, 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:04:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:04:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.081722039, 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:04:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 105.07469156000001, 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:04:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 104.976889832, 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:04:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:04:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:04:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:04:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 104.969583438, 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:04:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:04:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:27.683 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:27.685 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:27.685 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:27.683+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:27.785 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:27.787+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:27.853 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:27.853 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:27.853 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:27.853 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:27.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:27.890 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:27.887+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:27.987 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:27.987+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:27.991 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:27.991 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:28.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:28.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-10T14:04:28.088 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:28.087+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:28.125 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.378261053, 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:04:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:04:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.425655312, 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:04:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:04:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.398211338, 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:04:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.384953884, 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:04:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.382381968, 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 109.28576937699999, 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:04:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:04:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.369654553, 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:04:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.33031294600001, 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:04:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:04:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:04:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.27134298199999, 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:04:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:04:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:04:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.255801349, 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:04:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:04:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:04:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.255295316, 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.251075798, 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.2360108, 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.234624778, 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:04:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.229683314, 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.229227466, 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:04:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:04:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.2142082, 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:04:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:04:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.209142179, 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:04:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 106.115172079, 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:04:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:04:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.305560344, 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:04:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:04:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.220 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:28.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:28.222 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:28.220+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:28.322 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:28.320+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:28.395 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:28.395 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:28.395 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:28.395 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:28.409 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:28.423 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:28.423+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:28.524 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:28.520+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:28.578 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:28.578 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:28.579 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:28.579 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:28.579 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:28.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:28.634 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:28.632+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:28.726 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:28.723+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:28.759 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 129.21003874600001, 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:04:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.58713498899999, 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:04:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.49160134300001, 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.491547137, 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:04:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.491510267, 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:04:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:04:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.491348722, 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.491295382, 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.491237463, 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:04:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.49110771400001, 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:04:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:04:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.49106925699999, 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:04:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:04:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:04:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26394613400001, 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26373868900001, 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.263624803, 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:04:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:04:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26345639799999, 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:04:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:04:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26341883800001, 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:04:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26336542199999, 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:04:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26324013300001, 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:04:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26319999, 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:04:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:04:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:04:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26314760700001, 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 128.26296320899999, 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:04:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:04:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:28.876 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:28.877 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:28.878 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:28.875+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:28.982 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:28.976+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:29.009 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:29.009 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:29.009 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:29.009 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:29.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:29.079 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:29.079+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:29.180 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:29.176+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:29.188 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:29.188 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:29.188 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:29.188 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:29.188 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:29.202 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:29.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:04:29.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:29.281 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:29.279+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.491010281000001, 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:04:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:04:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:04:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.490988611999999, 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:04:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:04:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.489951957999999, 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:04:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:04:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.488334685000002, 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.172022187, 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:04:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 14.488326603000001, 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:04:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 9.4841683670000005, 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:29.394 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:29.395 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:29.392+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:29.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:29.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:29.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:29.466 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:29.466 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:29.498 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:29.492+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:29.500 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:29.500 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:29.517 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:29.517 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:29.537 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:29.540 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:29.540 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:29.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:29.558 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:29.558 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:29.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:29.580 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:29.598 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:29.596+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:29.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:29.601 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:29.669 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:29.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:29.727 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:29.727+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:29.791 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:29.791 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:29.801 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:29.800+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:29.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:29.902 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:29.900+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:29.972 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:29.972 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:29.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:30.003 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:30.000+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:30.103 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.103 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.103 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:30.103+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:30.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:30.204 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:30.203+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:30.211 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:04:30.285 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.285 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:30.347 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:30.347+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:30.407 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:30.404+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:30.425 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.425 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:30.527 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:30.527+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:30.609 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:30.607+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:30.611 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.611 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:30.711 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:30.711+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:30.795 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.795 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:30.851 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:30.851+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:30.912 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:30.912+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:30.970 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:30.971 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:30.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:31.012 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:31.012+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:31.113 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.113 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.113 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:31.108+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:31.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:31.214 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:31.212+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:31.247 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.248 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.262 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:31.315 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:31.315+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:31.393 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.393 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.407 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:31.416 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:31.415+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:31.517 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:31.512+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:31.529 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.529 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:31.617 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:31.615+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:31.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.718 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:31.718 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:31.715+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:31.775 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:31.775 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:31.792 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:31.810 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:31.811 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:31.819 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:31.816+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:31.828 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:31.829 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:31.835 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:31.835 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:31.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:31.851 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:31.869 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:31.870 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:31.887 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:31.906 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:31.906 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:31.920 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:31.919+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:32.018 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.018 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:32.018 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:32.018 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:32.018 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.020 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:32.019+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:32.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:32.122 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:32.119+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 117.41036499499999, 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:04:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.457759254, 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:04:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:04:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.43031528, 2024-05-10T14:04:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:04:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.173 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.417057826, 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:32.174 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.41448591, 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.180 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:32.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 113.317873319, 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.187 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:04:32.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:04:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:04:32.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:04:32.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:04:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.195 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.401758495, 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.196 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:04:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.362416888, 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.303446924, 2024-05-10T14:04:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:04:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:04:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.287905291, 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:04:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:04:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:04:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:04:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.28739925799999, 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.28317973999999, 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:04:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.26811474199999, 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:04:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:04:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:04:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.26672872, 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:04:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:04:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.26178725600001, 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:04:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.261331408, 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:04:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.24631214199999, 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:04:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.241246121, 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:04:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 110.147276021, 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:04:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:04:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:04:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.337664286000006, 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:04:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.265 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:04:32.266 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:32.267 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:32.267+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:32.367 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:32.367+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:32.394 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.394 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:32.394 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:32.394 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:32.468 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:32.467+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:32.532 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.532 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:32.532 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:32.532 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:32.532 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.547 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:32.594 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:32.592+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:32.666 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.666 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:32.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 133.11895808099999, 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.496054324, 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:04:32.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:04:32.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40052067799999, 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:04:32.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:04:32.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:04:32.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.684 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40046647200001, 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:32.685 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:04:32.686 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:04:32.689 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.690 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.400429602, 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.691 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.692 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:04:32.694 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.695 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.696 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40026805700001, 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.697 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.698 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.699 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.700 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40021471700001, 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.702 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.703 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:04:32.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:04:32.706 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40015679800001, 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:04:32.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:04:32.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:04:32.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:32.713 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.40002704899999, 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.714 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:04:32.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:04:32.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.718 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:32.719 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.399988592, 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:04:32.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17286546899999, 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.725 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.726 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.730 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17265802399999, 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.731 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17254413800001, 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:04:32.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.742 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.172375733, 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:04:32.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.748 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17233817300001, 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:04:32.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:04:32.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.172284757, 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.755 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:04:32.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:04:32.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17215946799999, 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.760 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:04:32.765 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17211932500001, 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:04:32.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.771 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.17206694199999, 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:04:32.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:04:32.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:04:32.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:32.777 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 132.171882544, 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:32.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:04:32.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:32.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:32.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:32.783 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:32.785 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:32.783+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:32.885 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:32.883+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:32.954 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:32.954 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:32.954 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:32.954 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:32.968 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:33.014 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:33.012+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:33.086 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:33.084+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:33.090 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:33.090 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:33.090 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:33.090 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:33.090 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:33.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:33.187 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:33.187+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:04:33.270 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:33.270 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.397040769, 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.397019100000001, 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:04:33.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:04:33.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.395982446000001, 2024-05-10T14:04:33.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:33.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:04:33.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:04:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.394365173000001, 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:04:33.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.078052674999999, 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.287 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:04:33.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:04:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 18.394357091, 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:04:33.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:04:33.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 13.390198855, 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.295 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:33.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:33.299 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:33.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:33.301 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:33.299+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:33.401 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:33.399+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:33.430 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:33.431 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:33.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:33.503 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:33.500+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:33.604 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:33.603+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:33.613 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:33.613 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:33.613 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:33.613 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:33.613 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:33.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:33.715 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:33.715+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.632626249, 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.631092564, 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:33.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.29704225200001, 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.05491914700001, 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:33.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:33.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:33.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:33.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.05166438800001, 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:33.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 112.092716704, 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:33.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:33.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:33.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 112.07487751799999, 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:33.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.839 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 112.038419316, 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:33.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 112.02457468599999, 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:33.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:33.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:33.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:33.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.995348675, 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.851 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:33.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:33.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.977921533, 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:33.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:33.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:33.863 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.923763065, 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:33.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:33.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.710872131, 2024-05-10T14:04:33.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.706484149, 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:33.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:33.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.532979277, 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:33.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:33.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:33.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.48020449099999, 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.887 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:33.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:33.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.892 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.475444908, 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:33.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.295092603, 2024-05-10T14:04:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:33.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.903 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 111.291288806, 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:33.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:33.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:33.909 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.931823997999999, 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:33.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:33.915 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:33.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:33.917 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:33.916+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:33.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:34.017 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:34.015+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:34.098 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:34.098 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:34.098 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:34.098 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:34.109 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:34.110 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:34.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:34.119 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:34.116+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:34.126 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:34.127 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:34.146 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:34.146 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:34.162 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:34.163 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:34.183 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:34.183 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:34.204 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:34.219 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:34.219+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:34.225 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:34.225 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:34.246 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:34.251 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:34.251 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:34.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:34.321 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:34.316+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:34.422 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:34.420+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:34.422 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:34.422 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:34.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:34.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2024-05-10T14:04:34.523 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:34.523+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:34.560 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:34.561 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:34.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:34.663 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:34.663+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:34.725 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:34.723+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:34.742 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:34.742 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:34.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:34.843 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:34.843+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:34.925 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:34.925 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:34.927 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:34.927+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:34.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:35.028 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:35.027+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:35.108 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.109 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:35.167 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:35.167+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:35.230 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:35.227+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:35.258 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:04:35.296 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.296 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:35.359 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:35.359+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:35.431 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:35.431+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:35.477 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.477 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:35.535 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:35.535+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:35.623 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.624 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.634 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:35.632+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:35.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:35.735 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:35.735+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:35.802 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.802 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:35.835 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:35.835+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:35.937 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:35.932+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:35.937 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:35.938 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:35.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:36.038 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:36.036+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:36.119 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:36.119 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:36.133 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:36.174 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:36.172+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:36.240 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:36.239+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:36.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:36.297 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:36.297 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:36.311 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:36.358 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:36.356+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:36.419 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:36.434 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:36.434 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:36.435 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:36.435 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:36.441 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:36.439+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:36.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:36.451 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:36.451 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:36.466 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:36.467 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:36.486 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:36.486 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:36.503 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:36.503 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:36.522 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:36.540 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:36.540 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:36.542 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:36.540+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:36.613 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:36.613 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:36.613 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:36.613 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:36.627 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:36.643 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:36.643+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:36.744 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:36.740+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:36.795 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:36.795 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:36.796 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:36.810 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:36.845 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:36.843+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:36.947 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:36.947+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:36.977 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 137.42819866400001, 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:36.978 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:04:36.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:04:36.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:04:36.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:04:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:04:36.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:36.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.80529490699999, 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:36.985 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:04:36.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:04:36.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:36.992 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.70976126100001, 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:36.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:04:36.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:36.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:36.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.709707055, 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.005 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.70967018499999, 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:04:37.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.70950864, 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:04:37.011 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:04:37.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.7094553, 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:04:37.017 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:04:37.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:04:37.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.709397381, 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:04:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:04:37.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:04:37.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.70926763200001, 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:04:37.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:04:37.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:04:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.70922917499999, 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:04:37.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48210605200001, 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:04:37.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:04:37.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:04:37.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:04:37.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48189860700001, 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:04:37.046 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:04:37.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.052 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.481784721, 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:04:37.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:04:37.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:37.058 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48161631599999, 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:04:37.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:04:37.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.481578756, 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.064 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:04:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:04:37.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48152533999999, 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:04:37.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:04:37.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:04:37.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:04:37.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48140005100001, 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:37.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:04:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.481359908, 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:04:37.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48130752500001, 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.087 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:04:37.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.092 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 136.48112312699999, 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:04:37.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:04:37.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.099 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:37.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:37.101 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:37.099+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:37.201 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:37.203+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:37.229 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:37.229 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:37.230 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:37.230 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:37.244 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:37.303 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:37.303+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:37.365 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:37.365 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:37.365 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:37.365 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:37.365 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:37.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:37.403 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:37.403+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.627207073000001, 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:04:37.501 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:04:37.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.627185403999999, 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:37.505 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:04:37.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:04:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.626148749999999, 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:04:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.624531477000001, 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.308218978999999, 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:04:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 22.624523395000001, 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:04:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:04:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 17.620365158999999, 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:04:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:37.529 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:37.531 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:37.528+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:37.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:37.632 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:37.628+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:37.669 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:37.669 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:37.669 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:37.669 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:37.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:37.733 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:37.732+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:37.812 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:37.813 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:37.813 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:37.813 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:37.813 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:37.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:37.834 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:37.832+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:37.935 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:37.935+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:37.950 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:37.950 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:37.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.78019973400001, 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:37.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:37.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.955 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.77866604900001, 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:37.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:37.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.44461573699999, 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:37.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:37.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.202492632, 2024-05-10T14:04:37.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:37.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.199237873, 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:37.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:37.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:37.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.24029018900001, 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:37.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:37.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:37.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.222451003, 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:37.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.185992801, 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:37.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.172148171, 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:37.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:37.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.14292216, 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:37.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:38.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:38.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.125495018, 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:38.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.07133655, 2024-05-10T14:04:38.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:38.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.858445616, 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:38.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.854057634, 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:38.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.680552762, 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:38.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:38.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.627777976, 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:38.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:38.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.623018393, 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:38.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.442666088, 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:38.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:38.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.43886229100001, 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:38.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:38.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:38.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:38.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.079397482999994, 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:38.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.062 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:38.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:38.065 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:38.063+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:38.165 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:38.160+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:38.241 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:38.241 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:38.241 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:38.241 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:38.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:38.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:04:38.303 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:38.303+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:38.368 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:38.367+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:38.388 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:38.388 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:38.388 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:38.388 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:38.388 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:38.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:38.499 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:38.499+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:38.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.88847508800001, 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.842406035, 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.836895689, 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.726636861, 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.850410778, 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.827847895, 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.80151986600001, 2024-05-10T14:04:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.783923308, 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.75158473099999, 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.717508067, 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.706951657, 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.42598889200001, 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.421699713, 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.38025260400001, 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.28201178499999, 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:38.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.260546928, 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:38.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:38.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 116.19601324200001, 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:38.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:38.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 115.92869869899999, 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:38.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.672 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.267268161000004, 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:38.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:38.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:38.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 68.267139868000001, 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.679 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:38.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:38.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:38.684 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:38.685 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:38.568+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:38.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:38.687 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:38.684+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:38.697 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:38.698 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:38.715 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:38.733 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:38.749 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:38.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:38.786 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:38.787+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:38.790 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:38.808 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:38.808 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:38.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:38.811 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:38.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:38.833 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:38.834 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:38.887 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:38.884+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:38.960 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:38.960 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:38.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:39.019 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:39.019+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:39.089 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:39.088+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:39.094 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.094 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:39.191 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:39.188+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:39.241 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:04:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.291 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:39.291+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:39.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:39.392 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:39.392+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:39.467 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.467 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:39.527 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:39.527+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:39.594 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:39.595+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:39.696 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:39.692+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:39.760 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.760 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.775 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:39.818 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:39.816+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:39.897 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:39.899+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:39.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:40.002 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:40.000+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:40.070 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.070 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:40.126 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:40.124+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:40.201 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:40.196+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:40.249 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.249 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.264 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:40.306 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:40.304+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:40.403 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:40.400+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:40.427 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.427 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:40.503 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:40.503+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:40.603 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.603 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.604 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:40.603+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:40.617 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:40.705 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:40.700+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:40.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2024-05-10T14:04:40.838 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:40.836+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:40.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:40.907 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:40.907+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:40.913 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:40.913 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:40.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:41.011 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:41.011 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:41.014 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:41.012+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:41.028 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:41.029 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:41.047 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:41.048 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:41.066 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:41.087 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:41.094 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:41.094 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:41.108 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:41.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:41.110 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:41.104+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:41.127 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:41.128 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:41.147 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:41.210 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:41.208+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:41.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:04:41.275 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:41.275 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:41.275 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:41.276 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:41.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:41.334 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:41.332+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:41.413 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:41.408+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:41.458 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:41.458 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:41.459 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:41.459 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:41.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:41.514 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:41.512+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:41.614 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:41.612+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:41.639 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:41.639 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:41.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:41.640 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:41.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.640 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:41.640 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:41.640 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.765323056, 2024-05-10T14:04:41.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:04:41.641 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:41.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.765301387000001, 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:04:41.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:04:41.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:04:41.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.764264733000001, 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:41.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.657 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.76264746, 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:04:41.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:04:41.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.446334962000002, 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:04:41.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:04:41.666 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 26.762639377999999, 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:41.667 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:04:41.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 21.758481142000001, 2024-05-10T14:04:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.673 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:41.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:04:41.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:04:41.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:41.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:41.727 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:41.727+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:41.812 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:41.812 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:41.812 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:41.812 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:41.815 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:41.815+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:41.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:41.916 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:41.912+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:41.998 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:41.999 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:41.999 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:41.999 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:41.999 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:42.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:42.059 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:42.059+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:42.118 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:42.116+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:42.147 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.97636319899999, 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:42.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:42.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.97482951399999, 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:42.156 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.640779202, 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:42.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.398656097, 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:42.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.395401338, 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:42.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:42.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:42.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:42.173 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.436453654, 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:42.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:42.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.418614468, 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:42.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:42.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:42.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.382156266, 2024-05-10T14:04:42.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.368311636, 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:42.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:42.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.339085625, 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:42.197 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:42.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.32165848299999, 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:42.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:42.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:42.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.267500015, 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:42.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.054609081, 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:42.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:42.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:42.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.050221099, 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.876716227, 2024-05-10T14:04:42.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:42.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:42.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:42.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:42.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.823941441, 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:42.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:42.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.81918185799999, 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:42.240 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:42.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:42.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.246 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.63882955299999, 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:42.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:42.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:42.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 119.635025756, 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:42.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:42.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:42.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.275560948000006, 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.258 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:42.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:42.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.264 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:42.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:42.266 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:42.264+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:42.273 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:04:42.366 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:42.364+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:42.395 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:42.395 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:42.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:42.467 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:42.467+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:42.530 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:42.531 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:42.531 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:42.531 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:42.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:42.568 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:42.564+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:42.669 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:42.667+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:42.718 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.03643724700001, 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.990368194, 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.984857848, 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.87459902000001, 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.998372937, 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.97581005399999, 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.94948202499999, 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.931885467, 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.89954689, 2024-05-10T14:04:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.865470226, 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.85491381600001, 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:42.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.57395105099999, 2024-05-10T14:04:42.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:42.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:42.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.569661872, 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:42.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:42.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.52821476299999, 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.429973944, 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.408509087, 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:42.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:42.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:42.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.34397540099999, 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:42.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.076660858, 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:42.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:42.817 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.415230320000006, 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 72.415102027000003, 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:42.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:42.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:42.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:42.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:42.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:42.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:42.829 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:42.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:42.831 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:42.828+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:42.931 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:42.928+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:43.008 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:43.008 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:43.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:43.031 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:43.028+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:43.132 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:43.131+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:43.142 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:43.142 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:43.142 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:43.142 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:43.142 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:43.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:43.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:43.233 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:43.228+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:43.332 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.594925301, 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.505950216, 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.492682823, 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.48708738099999, 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.169074096, 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.16502083, 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 121.127395933, 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.996223337, 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.992215014, 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.939300703, 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.925691028, 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.92160251599999, 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:43.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.875266283, 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:43.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:43.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.871505633, 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.78421135400001, 2024-05-10T14:04:43.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:43.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.780371729, 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:43.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:43.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.686241733, 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:43.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:43.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.67208261899999, 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:43.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.437 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:43.437 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 120.66828132099999, 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:43.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:43.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:43.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:43.443 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.032787714999998, 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:43.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:43.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:43.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:43.449 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:43.450 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:43.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:43.454 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:43.454 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:43.455 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:43.456 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:43.456 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:43.457 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:43.448+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:43.457 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:43.479 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:43.479 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:43.551 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:43.551+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:43.577 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:43.577 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:43.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:43.652 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:43.652+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:43.753 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:43.751+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:43.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:43.855 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:43.856+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:43.956 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:43.952+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:43.959 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:44.059 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:44.059+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:44.092 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.092 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:44.160 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:44.159+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:44.230 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.230 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.244 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:44.290 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:44.288+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:44.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:04:44.361 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:44.359+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:44.369 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.369 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.381 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-05-10T14:04:44.382 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:04:44.382 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-05-10T14:04:44.382 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2024-05-10T14:04:44.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-10T14:04:44.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:44.470 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:44.468+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:44.547 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.548 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.561 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:44.606 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:44.604+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:44.664 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:44.663+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:44.730 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.730 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:44.790 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:44.788+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:44.861 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:44.861 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:44.866 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:44.864+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:44.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:44.967 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:44.967+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:45.040 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:45.041 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:45.055 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:45.068 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:45.067+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:45.169 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:45.164+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:45.178 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:45.178 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:45.193 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:45.278 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:45.276+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:45.284 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:04:45.292 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-10T14:04:45.357 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:45.357 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:45.371 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:45.368+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:45.372 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:45.472 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:45.468+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:45.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:45.544 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:45.544 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:45.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:45.602 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:45.600+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:45.656 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:45.657 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:45.673 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:45.673 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:45.668+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:45.689 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:45.689 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:45.709 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:45.710 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:45.727 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:45.727 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:45.727 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:45.727 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:45.741 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:45.747 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:45.767 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:45.768 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:45.789 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:45.790 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:45.788+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:45.875 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:45.875+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:45.913 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:04:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 36.040272895999998, 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:04:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 36.040251226999999, 2024-05-10T14:04:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:04:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 36.039214573000002, 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:04:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 36.037597300000002, 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:04:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 35.721284802, 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:04:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:04:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.037589218000001, 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:04:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:04:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 26.033430981999999, 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:04:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:04:45.943 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:45.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:45.991 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:45.991+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:46.076 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:46.077 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:46.077 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:46.077 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:46.077 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:46.072+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:46.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:46.179 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:46.179+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:46.262 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:46.262 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:46.262 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:46.262 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:46.263 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:46.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:46.279 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:46.276+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:46.379 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:46.379+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.28448856899999, 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.28295488399999, 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:46.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:46.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 145.948904572, 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:46.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:46.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.469 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 127.706781467, 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 127.703526708, 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:46.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:46.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.744579024, 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:46.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.726739838, 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:46.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.69028163599999, 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:46.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:46.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.676437006, 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:46.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:46.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.64721099499999, 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:46.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.62978385300001, 2024-05-10T14:04:46.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:46.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:46.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:46.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:46.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.575625385, 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:46.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:46.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.36273445099999, 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:46.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.358346469, 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:46.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.532 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.184841597, 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.533 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:46.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:46.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:46.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.132066811, 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.539 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:46.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.12730722800001, 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:46.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.94695492300001, 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.551 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:46.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:46.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:46.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:46.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 123.943151126, 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:46.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:46.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 94.583686318000005, 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:46.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:46.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:46.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:46.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:46.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:46.568 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:46.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:46.570 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:46.568+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:46.670 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:46.671+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:46.746 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:46.746 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:46.746 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:46.746 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:46.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:46.772 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:46.768+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:46.873 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:46.871+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:46.930 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:46.930 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:46.930 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:46.930 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:46.930 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:46.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:46.974 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:46.972+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:47.076 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:47.076+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:47.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.43041392800001, 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.38434487500001, 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.117 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:47.121 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.37883452899999, 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:47.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:47.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.268575701, 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.126 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:47.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:47.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:47.131 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.392349618, 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:47.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:47.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:47.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.36978673500001, 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:47.140 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:47.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.146 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.34345870600001, 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.152 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.325862148, 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:47.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.158 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.29352357099999, 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:47.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:47.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.259446907, 2024-05-10T14:04:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.248890497, 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:47.170 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.96792773200001, 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.963638553, 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.92219144400001, 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.82395062499999, 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.802485768, 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.73795208200001, 2024-05-10T14:04:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 124.47063753899999, 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.809207001000004, 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.809078708000001, 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.228 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:47.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2024-05-10T14:04:47.230 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:47.230 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:47.227+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:47.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:04:47.331 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:47.328+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:47.406 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:47.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:47.406 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:47.406 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:47.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:47.467 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:47.467+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:47.532 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:47.531+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:47.575 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:47.575 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:47.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:47.633 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:47.628+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:47.733 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:47.731+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:47.754 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:47.754 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:47.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:47.754 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:47.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.755 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:47.755 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:47.755 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.01459972999999, 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.925624645, 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.91235725200001, 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:47.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:47.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:47.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.90676181000001, 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.774 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:47.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:47.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.588748525, 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.780 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:47.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.584695259, 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.786 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:47.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:47.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.547070362, 2024-05-10T14:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:47.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.415897766, 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:47.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.802 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.41188944300001, 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.803 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.358975132, 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:47.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.345365457, 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:47.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:47.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.341276945, 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:47.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:47.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:47.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.294940712, 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.291180062, 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.203885783, 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.20004615800001, 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.105916162, 2024-05-10T14:04:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.09175704800001, 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 125.08795575000001, 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 77.452462143999995, 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:47.870 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:47.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:47.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:47.873 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:47.868+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:47.973 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:47.968+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:48.039 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:48.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:48.040 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:48.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:48.064 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:48.064 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:48.073 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:48.072+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:48.081 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:48.081 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:48.098 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:48.099 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:48.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:48.115 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:48.135 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:48.135 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:48.156 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:48.156 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:48.172 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.172 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.173 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:48.171+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:48.177 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:48.186 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:48.198 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:48.275 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:48.272+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:48.311 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.312 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.320 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:48.329 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:48.376 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:48.372+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:48.463 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.463 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.477 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:48.478 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:48.472+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:48.578 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:48.575+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:48.643 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.643 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.657 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:48.702 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:48.700+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:48.780 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.780 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.780 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:48.776+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:48.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:48.882 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:48.880+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:48.957 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:48.957 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:48.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:48.982 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:48.979+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:49.083 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:49.083+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:49.141 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.141 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:49.202 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:49.200+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:49.274 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.274 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.284 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:49.280+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:49.288 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:49.386 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:49.387+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:49.454 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.454 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.468 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:49.487 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:49.487+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.589 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:49.587+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:49.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:49.689 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:49.684+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:49.726 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.726 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:49.826 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:49.824+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:49.890 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:49.891+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:49.905 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:49.905 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:49.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:50.006 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:50.004+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:50.086 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:50.086 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:50.092 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:50.091+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:50.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:50.193 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:50.191+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:50.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:50.267 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:50.267 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:50.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:50.293 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:50.292+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:50.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:04:50.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:50.361 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:50.395 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:50.395+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:50.395 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:50.412 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:50.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:50.412 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:50.412 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:50.412 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:50.413 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:50.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:50.430 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:50.430 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:50.451 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:50.451 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:50.472 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:50.472 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:50.494 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:50.495 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:50.496 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:50.492+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:50.517 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:50.548 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:50.549 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:50.549 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:50.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:50.607 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:50.607+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:50.697 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:50.692+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:50.744 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:50.744 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:50.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:50.744 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.57370598200001, 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:50.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.750 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.57217229700001, 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:50.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:50.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.23812198499999, 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.755 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:50.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:50.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:50.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 131.99599888, 2024-05-10T14:04:50.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:50.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 131.99274412099999, 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:50.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:50.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:50.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.03379643700001, 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:50.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:50.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.015957251, 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:50.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.979499049, 2024-05-10T14:04:50.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:50.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:50.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.965654419, 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.789 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:50.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.93642840800001, 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:50.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.800 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.91900126600001, 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:50.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:50.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.806 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.86484279800001, 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:50.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:50.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:50.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.65195186400001, 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:50.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.64756388199999, 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.821 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:50.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:50.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:50.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.47405900999999, 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.828 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:50.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:50.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:50.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:50.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:50.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:50.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:50.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:50.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:50.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.421284224, 2024-05-10T14:04:50.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.841 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:50.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.416524641, 2024-05-10T14:04:50.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.853 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:50.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:50.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:50.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:50.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.23617233600001, 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:50.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.23236853899999, 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:50.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:50.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:50.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.872903730999994, 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:50.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:50.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:50.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:50.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:50.882 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:50.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:50.885 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:50.880+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:50.985 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:50.980+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:51.018 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.019 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:51.019 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:51.019 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:51.034 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:51.086 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:51.083+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:51.164 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:51.165 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:51.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:51.186 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:51.184+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:51.287 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:51.287+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:04:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.359 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:51.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:51.359 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:51.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 136.67968128300001, 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.360 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.63361223000001, 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:51.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.62810188399999, 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:51.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.517843056, 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:51.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:51.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.641616973, 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:51.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.61905408999999, 2024-05-10T14:04:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.59272606100001, 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.575129503, 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.54279092600001, 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.50871426200001, 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.49815785199999, 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.21719508699999, 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.21290590800001, 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.17145879899999, 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.07321798000001, 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.051753123, 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.98721943699999, 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 128.719904894, 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.058474356000005, 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.058346063000002, 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:51.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:51.476 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:51.475+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:51.577 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:51.572+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:51.649 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:51.649 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:51.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:51.678 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:51.676+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:51.779 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:51.780+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:51.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:51.793 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:51.793 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:51.793 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:51.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:51.880 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:51.879+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:51.939 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:51.939 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:51.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:51.939 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:51.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.19955602100001, 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:51.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:51.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:51.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.11058093599999, 2024-05-10T14:04:51.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:51.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:51.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:51.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.09731354300001, 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:51.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.091718101, 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.77370481599999, 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.76965154999999, 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.73202665299999, 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.60085405699999, 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.596845734, 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.543931423, 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.53032174800001, 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.526233236, 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.47989700299999, 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.47613635299999, 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.388842074, 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.38500244900001, 2024-05-10T14:04:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.29087245299999, 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.276713339, 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.27291204100001, 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 81.637418435000001, 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.057 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:52.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:52.061 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:52.059+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:52.159 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:52.156+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:52.236 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:52.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:52.237 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:52.237 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:52.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:52.259 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:52.256+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:52.361 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:52.356+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:52.372 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:52.372 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:52.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:52.462 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:52.459+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:52.507 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:52.507 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.76450511900001, 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.508 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:52.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.76441264799999, 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:52.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:52.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.794167789, 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:52.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:52.527 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.75192566800001, 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:52.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.534 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.712626202, 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:52.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:52.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.70562178599999, 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:52.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.69801600400001, 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:52.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.640739997, 2024-05-10T14:04:52.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:52.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:52.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.62962242099999, 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:52.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.50478289200001, 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:52.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:52.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:52.572 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.40912773100001, 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:52.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:52.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.40498945900001, 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:52.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.37223773599999, 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:52.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.591 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.20755553699999, 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.150348829, 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 130.00817212199999, 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.987486496, 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.98093035599999, 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.89598588800001, 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.88906304899999, 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:52.640 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:52.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:52.643 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:52.643 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:52.639+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:52.743 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:52.743+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:52.777 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:52.777 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:52.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:52.843 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:52.844 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:52.843+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:52.860 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:52.876 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:52.893 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:52.894 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:52.914 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:52.994 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:52.994 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:52.995 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:52.996 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:52.996 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:52.996 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:52.997 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:52.998 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:52.998 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:52.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:52.999 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:52.996+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:53.099 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:53.099+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:53.168 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:53.169 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:53.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:53.230 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:53.228+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:53.300 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:53.296+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:53.307 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:53.307 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:53.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:53.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:04:53.401 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:53.399+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:53.490 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:53.490 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:53.501 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:53.500+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:53.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:53.602 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:53.600+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:53.670 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:53.670 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:53.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:53.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~26s 2024-05-10T14:04:53.703 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:53.703+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:53.804 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:53.800+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:53.848 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:53.848 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:53.862 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:53.910 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:53.908+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:54.006 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:54.007+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:54.028 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.028 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:54.107 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:54.107+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:54.166 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.166 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:54.208 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:54.211+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:54.305 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.305 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.309 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:54.304+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:54.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:54.335 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:04:54.414 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:54.412+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:54.486 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.486 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.502 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:54.546 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:54.544+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:54.612 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:54.608+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:54.670 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.671 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:54.731 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:54.731+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:54.814 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:54.811+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:54.823 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:54.823 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:54.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:54.927 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:54.927+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:54.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:55.012 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:55.012 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:55.014 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:55.012+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:55.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:55.115 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:55.115+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:55.147 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:55.147 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:55.164 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:55.180 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:55.197 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:55.201 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.03282645199999, 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:04:55.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.031292767, 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:04:55.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:04:55.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:04:55.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 154.69724245500001, 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 136.45511934999999, 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.214 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 136.451864591, 2024-05-10T14:04:55.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:04:55.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:04:55.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:04:55.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.49291690699999, 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:04:55.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.47507772099999, 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:04:55.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.43861951900001, 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:55.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.42477488899999, 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:04:55.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:04:55.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.395548878, 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:04:55.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:04:55.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:04:55.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:04:55.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.378121736, 2024-05-10T14:04:55.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:04:55.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.323963268, 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:04:55.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.111072334, 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:04:55.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:04:55.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:04:55.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.106684352, 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.272 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:04:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:04:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:04:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:04:55.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.93317948000001, 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:04:55.277 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:04:55.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:04:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:04:55.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.88040469399999, 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:04:55.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:04:55.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.87564511100001, 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:04:55.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:04:55.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:04:55.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.294 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.695292806, 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:55.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.69148900900001, 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:04:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:04:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:04:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:04:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 103.332024201, 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:04:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:04:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.311 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:55.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:55.313 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:55.314 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:55.314 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:55.314 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:55.315 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:55.315 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:55.315 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:55.316 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:55.308+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:55.414 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:55.412+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:55.485 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:55.485 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:55.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:55.547 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:55.547+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:55.616 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:55.612+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:55.625 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:55.625 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:55.625 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:55.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:55.727 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:55.727+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:55.813 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.13160467899999, 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:04:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.085535626, 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.08002528, 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:04:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:04:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:04:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 136.96976645199999, 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:04:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.09354036900001, 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.070977486, 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:04:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:04:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:04:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.04464945699999, 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.02705289900001, 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.99471432199999, 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:04:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:04:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:04:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:04:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:04:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.960637658, 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:04:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:04:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.950081248, 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:04:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:04:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.66911848300001, 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:04:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.66482930399999, 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.623382195, 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:04:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:04:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:04:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:04:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.52514137599999, 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:04:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:04:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.50367651900001, 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:04:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:04:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:04:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:04:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.43914283300001, 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.17182829000001, 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.510397752000003, 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:04:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:04:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:04:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 85.510269459, 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:55.922 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:55.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:04:55.924 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:55.923+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:56.025 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:56.023+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:56.100 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:56.101 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:56.101 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:56.101 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:56.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:04:56.126 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:56.124+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:56.227 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:56.228+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:56.286 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:56.286 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:56.286 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:56.286 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:56.286 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:56.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:04:56.327 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:56.324+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:56.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:04:56.428 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:56.428+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:56.436 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.69863272000001, 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.60965763499999, 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:04:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:04:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.59639024200001, 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:04:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:04:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:04:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.5907948, 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:04:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.27278151499999, 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:04:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:04:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:04:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.26872824899999, 2024-05-10T14:04:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:04:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:04:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:04:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.23110335199999, 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.09993075599999, 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.095922433, 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:04:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:04:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.043008122, 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.02939844700001, 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:04:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:04:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:04:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.025309935, 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:04:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.97897370199999, 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:04:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.97521305199999, 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:04:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:04:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:04:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:04:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.887918773, 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:04:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:04:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:04:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:04:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.88407914800001, 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:04:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:04:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.78994915199999, 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:04:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:04:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:04:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:04:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.775790038, 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:04:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.77198874000001, 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:04:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:04:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:04:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:04:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 86.136495134, 2024-05-10T14:04:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:04:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:04:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:04:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:56.552 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:56.553 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:04:56.554 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:56.551+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:56.654 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:56.651+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:56.723 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:56.724 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:56.724 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:04:56.724 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:56.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:04:56.783 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:04:56.783+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:04:56.857 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:56.856+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:56.909 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:56.910 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:56.910 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:56.910 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:56.910 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:56.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:04:56.957 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:56.956+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.30969258900001, 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:04:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.30960011799999, 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:04:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:04:57.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.339355259, 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.067 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:04:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:04:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:04:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.29711313799999, 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:04:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:04:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.257813672, 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:04:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:04:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.250809256, 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:04:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.24320347400001, 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:04:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.185927467, 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:04:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:04:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.174809891, 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.04997036200001, 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:04:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:04:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:04:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.95431520099999, 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:04:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:04:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.95017692900001, 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:04:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:04:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:04:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:04:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.91742520599999, 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:04:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.75274300699999, 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:04:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:04:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.695536299, 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:04:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:04:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.55335959199999, 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:04:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:04:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:04:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.532673966, 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:04:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:04:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.52611782599999, 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:04:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:04:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:04:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:04:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:04:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:04:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:04:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.44117335799999, 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:04:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:04:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:04:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 134.43425051899999, 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:04:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:04:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:04:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:04:57.171 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:57.173 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:04:57.173 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:57.172+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:57.274 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:57.271+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:57.304 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:57.304 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:04:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:57.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:04:57.318 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:04:57.358 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:04:57.375 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:57.375+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:57.475 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:57.476 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:57.475+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:57.485 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:04:57.485 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:04:57.486 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:04:57.486 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:04:57.486 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:04:57.491 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:57.492 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:57.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:04:57.508 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:57.508 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:57.524 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:57.525 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:57.542 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:57.560 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:57.561 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:57.576 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:57.575+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:57.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:57.580 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:57.602 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:57.603 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:57.619 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:57.619 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:57.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:04:57.677 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:57.675+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:57.756 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:57.757 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:57.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:04:57.778 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:57.775+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:57.879 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:57.879+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:57.938 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:57.938 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:57.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:04:57.998 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:57.995+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:58.069 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.070 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.080 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:58.079+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:58.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:04:58.181 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:58.179+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:58.250 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.251 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.265 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:04:58.282 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:58.283+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:58.384 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:58.379+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:58.389 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.390 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:04:58.485 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:58.483+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:58.564 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.565 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.579 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:04:58.626 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:58.623+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:58.686 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:04:58.687+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:04:58.703 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.704 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.718 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:04:58.806 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:58.803+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:58.887 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:58.887 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:58.888 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:04:58.883+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:04:58.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:04:58.990 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:58.987+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:59.065 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:59.065 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:59.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:04:59.122 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:59.119+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:59.191 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:59.191+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:59.216 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:59.216 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:59.231 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:04:59.319 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:59.319+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:59.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:04:59.401 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:59.401 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:59.401 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:59.399+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:59.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:04:59.494 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:59.491+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:04:59.589 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:59.590 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:59.594 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:04:59.591+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:04:59.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:04:59.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:04:59.696 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:04:59.691+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:04:59.762 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:04:59.782 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:04:59.782 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:04:59.794 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:04:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:04:59.796 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:04:59.791+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:04:59.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:04:59.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:04:59.812 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:04:59.829 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:04:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:04:59.845 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:04:59.846 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:04:59.866 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:04:59.867 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:04:59.887 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:04:59.887 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:04:59.897 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:04:59.895+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:04:59.907 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:04:59.908 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:04:59.928 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:04:59.928 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:04:59.928 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:04:59.928 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:04:59.929 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:04:59.931 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:04:59.931 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:04:59.945 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:04:59.998 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:04:59.995+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:00.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2024-05-10T14:05:00.098 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:00.095+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:00.119 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 145.43803292999999, 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:00.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:00.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:00.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.39196387699999, 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:00.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.386453531, 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.129 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:00.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.27619470299999, 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:00.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.39996862000001, 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.140 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:00.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.377405737, 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.146 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:00.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.35107770799999, 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.152 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.157 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.33348115000001, 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:00.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.30114257299999, 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.267065909, 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.256509499, 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.97554673400001, 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.97125755499999, 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.929810446, 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.83156962699999, 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.81010477000001, 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.74557108400001, 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.47825654100001, 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.816826003000003, 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 89.81669771, 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.232 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:00.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:00.234 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:00.231+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:00.335 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:00.331+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:00.365 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:00.365 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:00.365 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:00.365 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:00.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:00.435 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:00.435+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:00.499 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:00.500 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:00.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:00.559 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:00.559+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:00.638 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:00.635+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:00.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.951307141, 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:00.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.697 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.86233205600001, 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:00.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.84906466300001, 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:00.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:00.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.84346922099999, 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:00.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:00.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:00.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:00.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:00.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.52545593599999, 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:00.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:00.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:00.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.52140266999999, 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.48377777300001, 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:00.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:00.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.35260517699999, 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:00.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.34859685399999, 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:00.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.295682543, 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:00.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.282072868, 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:00.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.758 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.27798435599999, 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:00.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:00.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.23164812300001, 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:00.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:00.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.22788747300001, 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.14059319399999, 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.13675356900001, 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.04262357299999, 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.02846445899999, 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.02466316100001, 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 90.389169554999995, 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:00.813 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:00.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:00.815 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:00.811+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:00.915 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:00.915+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:00.948 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:00.948 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:00.963 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:01.016 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:01.015+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:01.085 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:01.086 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:01.086 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:01.086 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:01.086 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:01.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:01.143 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:01.143+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:01.219 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:01.219+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:01.275 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.53017475499999, 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.530082284, 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.55983742500001, 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.517595304, 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.47829583800001, 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.47129142200001, 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.46368563999999, 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.40640963300001, 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.39529205700001, 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.27045252799999, 2024-05-10T14:05:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.174797367, 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.17065909499999, 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:01.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:01.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:01.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 139.137907372, 2024-05-10T14:05:01.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:01.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.973225173, 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.354 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:01.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:01.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:01.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.91601846500001, 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:01.359 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:01.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:01.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:01.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:01.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.773841758, 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:01.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:01.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.75315613199999, 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.370 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.375 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.746599992, 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:01.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:01.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.661655524, 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:01.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:01.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:01.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:01.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 138.654732685, 2024-05-10T14:05:01.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:01.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:01.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:01.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:01.394 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:01.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:01.396 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:01.395+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:01.498 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:01.499+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:01.527 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:01.527 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:01.527 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:01.527 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:01.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:01.599 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:01.599+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:01.658 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:01.659 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:01.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:01.701 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:01.699+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:01.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 145.10659920399999, 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:01.799 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:01.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:01.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.07876103699999, 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:01.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:01.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.065002314, 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.808 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:01.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.982098721, 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.814 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:01.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:01.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.819 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.955760962, 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.820 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:01.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:01.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:01.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.95467091099999, 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:01.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:01.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:01.832 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.951783855, 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.833 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:01.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:01.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:01.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.949205452, 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.91792615599999, 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.86628785100001, 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:01.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.782141701, 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:01.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:01.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.77809617099999, 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.865 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.71183119, 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:01.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:01.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:01.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.67474590200001, 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:01.877 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:01.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.66761306000001, 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:01.883 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:01.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.465871994, 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:01.889 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:01.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.309941936, 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:01.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:01.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.901 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.30291145699999, 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.902 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:01.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:01.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.907 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.20510972899999, 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.908 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:01.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:01.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:01.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:01.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 139.197803335, 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:01.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:01.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:01.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:01.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:01.922 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:01.923 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:01.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:01.925 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:01.923+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:01.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:02.025 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:02.019+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:02.050 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:02.051 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:02.051 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:02.051 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:02.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:02.092 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:02.093 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:02.123 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:02.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:02.141 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:02.149 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:02.147+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:02.159 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:02.159 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:02.179 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:02.179 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:02.199 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:02.200 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:02.218 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:02.219 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:02.227 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:02.223+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:02.239 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:02.240 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:02.247 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:02.328 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:02.327+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:02.416 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:02.417 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:02.429 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:02.427+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:02.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:02.531 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:02.531+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:02.552 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:02.552 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:02.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:02.631 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:02.627+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:02.685 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:02.685 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:02.699 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:02.732 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:02.731+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:02.834 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:02.831+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:02.867 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:02.868 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:02.881 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:02.934 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:02.935+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:03.036 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:03.035+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:03.048 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.048 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:03.136 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:03.131+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:05:03.187 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.187 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:03.237 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:03.235+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:03.338 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:03.335+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:03.371 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.371 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:03.439 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:03.439+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:03.520 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.520 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:03.583 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:03.583+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:03.640 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:03.639+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:03.701 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.701 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.716 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:03.742 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:03.739+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:03.843 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:03.843+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:03.880 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:03.880 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:03.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:03.943 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:03.943+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:04.044 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:04.043+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:04.066 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:04.066 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:04.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:04.167 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:04.167+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:04.246 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:04.243+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:04.253 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:04.253 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:04.260 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:04.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:04.347 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:04.343+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:04.427 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:04.427 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:04.445 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 149.76790987800001, 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:04.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:04.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:04.454 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 145.72184082499999, 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:04.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:04.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.459 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 145.71633047899999, 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:04.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:04.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:04.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 145.60607165100001, 2024-05-10T14:05:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.729845568, 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.707282685, 2024-05-10T14:05:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.68095465600001, 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.663358098, 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.63101952100001, 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.59694285699999, 2024-05-10T14:05:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.586386447, 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.305423682, 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.30113450299999, 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.259687394, 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.16144657500001, 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.139981718, 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.075448032, 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.808133489, 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 94.146702950999995, 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 94.146574658000006, 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:04.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:04.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:04.596 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:04.596 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:04.447+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:04.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:04.598 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:04.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:04.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:04.600 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:04.600 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:04.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:04.643 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:04.643+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:04.702 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:04.699+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:04.778 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:04.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:04.778 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:04.778 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:04.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:04.835 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:04.835+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:04.904 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:04.903+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:04.959 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:04.959 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:04.960 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:04.960 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:04.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:05.006 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:05.003+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:05.107 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:05.103+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:05.152 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:05.152 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:05.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.41296324800001, 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:05.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.323988163, 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.31072076999999, 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.305125328, 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.987112043, 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.983058777, 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.94543388, 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.814261284, 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.810252961, 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.75733865000001, 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.74372897500001, 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.739640463, 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.69330423, 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.68954357999999, 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.602249301, 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.59840967599999, 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.50427968, 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.490120566, 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.48631926799999, 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 94.850825662000005, 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.268 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:05.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:05:05.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:05.270 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:05.267+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:05.370 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:05.367+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:05.439 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:05.439 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:05.439 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:05.439 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:05.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:05.471 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:05.467+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:05.571 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:05.571 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:05.571 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:05.571 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:05.571 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:05.572 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:05.571+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:05.585 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:05.672 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:05.671+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:05.705 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.96256149199999, 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.962469021, 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.99222416200001, 2024-05-10T14:05:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.949982041, 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.91068257500001, 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:05.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.90367815900001, 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:05.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:05.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:05.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.896072377, 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:05.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:05.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:05.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.83879637000001, 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.82767879400001, 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:05.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:05.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.70283926499999, 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:05.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:05.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:05.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.607184104, 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:05.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.60304583199999, 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.767 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:05.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:05.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.570294109, 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:05.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:05.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:05.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.40561191, 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:05.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:05.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:05.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.34840520200001, 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.206228495, 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.18554286899999, 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.178986729, 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.094042261, 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 143.087119422, 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:05.818 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:05.819 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:05.820 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:05.819+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:05.921 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:05.919+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:05.954 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:05.954 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:05.954 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:05.954 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:05.968 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:06.022 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:06.019+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:06.090 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:06.091 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:06.091 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:06.091 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:06.091 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:06.105 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:06.123 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:06.123+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:06.156 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:05:06.227 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:06.227+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:06.274 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:06.274 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:06.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:06.274 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:06.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.58204914300001, 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.275 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:06.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 147.55421097600001, 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:06.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:06.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:06.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.54045225300001, 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.284 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:06.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.45754865999999, 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.291 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:06.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:06.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.43121090099999, 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.297 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:06.302 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.43012085000001, 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:06.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:06.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.42723379399999, 2024-05-10T14:05:06.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:06.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:06.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.42465539099999, 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.313 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:06.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.39337609500001, 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:06.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:06.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.34173779, 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:06.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:06.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:06.329 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.25759163999999, 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:06.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:06.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:06.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.25354611, 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:06.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.18728112900001, 2024-05-10T14:05:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:06.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:06.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.150195841, 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.347 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:06.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:06.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:06.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.14306299899999, 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:06.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.94132193300001, 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.359 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:06.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.78539187499999, 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.365 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:06.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:06.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.77836139600001, 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:06.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:06.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:06.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.680559668, 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:06.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:06.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 143.67325327399999, 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.383 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:06.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.388 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:06.390 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:06.391 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:06.391+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:06.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2024-05-10T14:05:06.491 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:06.491+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:06.519 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:06.519 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:06.519 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:06.519 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:06.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:06.595 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:06.595+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:06.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:06.652 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:06.653 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:06.653 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:06.653 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:06.653 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:06.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:06.714 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:06.711+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:06.765 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:06.765 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:06.782 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:06.782 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.04507634800001, 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.792 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:06.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:06.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.092470607, 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.797 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:06.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:06.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:06.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.065026633, 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.803 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:06.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:06.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.808 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.05176917899999, 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.809 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:06.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:06.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:06.814 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.049197263, 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:06.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:06.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:06.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:06.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:06.820 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 147.952584672, 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 145.036469848, 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:06.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:06.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.99712824100001, 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.93815827700001, 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.92261664399999, 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.92211061099999, 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.842 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:06.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:06.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.91789109300001, 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:06.846 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:06.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:06.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.90282609499999, 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:06.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.901440073, 2024-05-10T14:05:06.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:06.859 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.89649860899999, 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:06.863 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.89604276099999, 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:06.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:06.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.88102349499999, 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:06.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:06.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.87595747399999, 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.872 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:06.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.876 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.78198737400001, 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 126.97237563900001, 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:06.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:06.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:06.885 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:06.886 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:06.886 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:06.887 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:06.887 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:06.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:06.888 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:06.889 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:06.889 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:06.890 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:06.883+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:06.897 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:06.897 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:06.988 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:06.983+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:07.056 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.057 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.071 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:07.089 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:07.087+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:07.190 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:07.187+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:07.235 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.235 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:07.290 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:07.291+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:07.371 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.372 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:07.430 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:07.427+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:07.492 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:07.491+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:07.509 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.509 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:07.610 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:07.607+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:07.692 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.693 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.694 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:07.691+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:07.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:07.795 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:07.791+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:07.874 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:07.874 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:07.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:07.935 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:07.935+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:07.998 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:07.995+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:08.023 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.023 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.037 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:08.098 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:08.099+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:08.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:05:08.208 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.208 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.208 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:08.207+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:08.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:08.315 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:08.315+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:08.388 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.389 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.401 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:08.399+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:08.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:08.502 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:08.503+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:08.566 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.566 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:08.623 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:08.623+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:08.704 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:08.699+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:08.740 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.741 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:08.805 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:08.803+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:08.882 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:08.883 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:08.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:08.905 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:08.903+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:08.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:09.006 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:09.003+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:09.060 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:09.060 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:09.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:09.090 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:09.105 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:09.106 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:09.103+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:09.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:09.122 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:09.139 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:09.139 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:09.160 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:09.181 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:09.204 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:09.205 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:09.205 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:09.205 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:09.205 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:09.207 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:09.203+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:09.217 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:09.217 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:09.224 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:05:09.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:09.242 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:09.243 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:09.308 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:09.303+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:09.361 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.624259787, 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.53528470200001, 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:09.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.52201730900001, 2024-05-10T14:05:09.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:09.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:09.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.51642186699999, 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:09.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.19840858200001, 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:09.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:09.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.19435531600001, 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:09.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:09.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.15673041900001, 2024-05-10T14:05:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:09.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:09.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:09.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.02555782300001, 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:09.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.02154949999999, 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:09.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:09.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:09.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:09.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.968635189, 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:09.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:09.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:09.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:09.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.955025514, 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.95093700199999, 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:09.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.90460076900001, 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.90084011900001, 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.81354583999999, 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.80970621500001, 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.71557621900001, 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.70141710499999, 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.69761580700001, 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 99.062122200999994, 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.477 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:09.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:09.478 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:09.475+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:09.579 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:09.579+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:09.654 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:09.654 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:09.655 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:09.669 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:09.711 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:09.711+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:09.780 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:09.775+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:09.836 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:09.837 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:09.837 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:09.837 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:09.837 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:09.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:09.899 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:09.899+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:09.977 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:09.978 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:09.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:09.978 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:09.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.978 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.233298668, 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.979 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:09.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:09.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:09.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.23320619699999, 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.262961338, 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:09.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:09.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:09.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.22071921700001, 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:10.006 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.18141975099999, 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:10.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:10.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.17441533499999, 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:10.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:10.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:10.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.018 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.16680955300001, 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.10953354599999, 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:10.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:10.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 148.09841596999999, 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:10.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:10.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.97357644100001, 2024-05-10T14:05:10.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:10.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:10.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.87792128000001, 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:10.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:10.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.873783008, 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:10.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:10.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:10.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.84103128500001, 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:10.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:10.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.67634908599999, 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:10.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:10.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:10.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.61914237799999, 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.47696567099999, 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.070 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:10.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:10.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.456280045, 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:10.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:10.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.44972390500001, 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.36477943700001, 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 147.35785659800001, 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:10.099 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:10.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:10.101 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:10.099+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:10.201 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:10.195+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:10.235 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:10.235 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:10.235 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:10.235 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:10.249 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:10.302 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:10.299+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:10.403 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:10.403+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:10.413 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:10.413 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:10.413 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:10.414 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:10.414 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:10.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:10.503 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:10.499+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:10.550 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.858745298, 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:10.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 151.830907131, 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.555 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:10.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:10.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:10.559 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.81714840800001, 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:10.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:10.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.73424481500001, 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.566 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.571 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.70790705600001, 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.706817005, 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.577 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.581 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.70392994900001, 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.70135154600001, 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.587 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:10.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:10.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.67007225, 2024-05-10T14:05:10.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:10.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:10.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:10.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.61843394499999, 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.597 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:10.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:10.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.53428779500001, 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.603 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.608 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.530242265, 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:10.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.46397728400001, 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.614 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:10.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.619 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.42689199599999, 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.620 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:10.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:10.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:10.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.41975915399999, 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.626 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.629 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.21801808800001, 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:10.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:10.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.06208803000001, 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:10.640 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:10.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:10.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:10.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.055057551, 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.646 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:10.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:10.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:10.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 147.957255823, 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:10.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.657 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 147.94994942899999, 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:10.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:10.663 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:10.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:10.665 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:10.659+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:10.766 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:10.763+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:10.833 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:10.833 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:10.833 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:10.833 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:10.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:10.890 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:10.887+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:10.968 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:10.971+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:11.014 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:11.015 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:11.015 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:11.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:11.073 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:11.071+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:11.155 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.408098897, 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.156 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.158 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.159 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.45549315599999, 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.428049182, 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:11.167 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:11.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:11.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.41479172800001, 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:11.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:11.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:11.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:11.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:11.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.41221981199999, 2024-05-10T14:05:11.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:11.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.31560722099999, 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.186 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:11.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:11.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:11.190 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.39949239699999, 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:11.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:11.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.194 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.36015079000001, 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:11.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.30118082600001, 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.199 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:11.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:11.203 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.28563919300001, 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:11.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.28513315999999, 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.280913642, 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.212 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:11.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:11.216 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.26584864399999, 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:11.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:11.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:11.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.264462622, 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:11.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.25952115800001, 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.25906531000001, 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.229 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:11.233 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.24404604399999, 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:11.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:11.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:11.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.237 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.23898002300001, 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.241 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 149.145009923, 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:11.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:11.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:11.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 131.335398188, 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:11.246 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:11.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:11.248 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:11.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:11.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:05:11.251 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:11.251+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:11.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:11.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:11.352 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:11.347+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:11.422 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:11.422 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:11.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:11.442 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:11.443 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:11.459 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:11.460 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:11.478 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:11.475+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:11.478 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:11.478 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:11.495 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:11.495 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:11.513 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:11.514 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:11.532 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:11.532 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:11.551 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:11.551 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:11.553 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:11.551+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:11.570 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:11.571 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:11.599 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:11.599 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:11.613 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:11.658 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:11.655+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:11.731 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:11.732 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:11.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:11.755 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:11.755+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:11.856 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:11.851+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:11.914 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:11.915 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:11.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:11.970 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:11.967+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:12.058 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:12.059+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:12.088 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.089 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:12.162 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:12.159+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:12.227 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.228 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.232 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:05:12.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:12.260 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:12.255+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:12.361 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:12.359+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:12.365 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.365 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:12.462 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:12.459+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:12.540 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.540 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:12.598 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:12.599+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:12.663 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:12.663+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:12.666 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.666 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:12.766 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:12.767+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:12.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~45s 2024-05-10T14:05:12.839 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:12.839 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:12.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:12.899 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:12.899+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:12.966 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:12.967+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:13.024 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:13.024 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:13.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:13.083 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:13.083+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:13.168 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:13.167+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:13.209 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:13.209 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:13.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:13.311 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:13.310+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:13.369 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:13.366+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:13.392 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:13.392 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:13.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:13.470 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:13.467+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:13.571 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:13.571 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:13.572 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:13.571+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:13.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:13.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:13.672 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:13.667+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:13.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:13.773 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:13.767+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:13.776 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:13.776 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:13.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:13.842 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:13.874 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:13.870+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:13.877 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:13.878 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:13.893 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:13.893 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:13.893 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:13.893 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:13.898 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:13.899 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:13.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:13.920 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:13.920 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:13.942 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:13.942 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:13.963 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:13.975 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:13.974+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:14.039 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:14.039 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:14.039 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:14.039 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:14.039 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:14.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:14.099 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:14.098+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:14.178 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:14.175+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.43799376600001, 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:14.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:14.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:14.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:14.198 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.43790129499999, 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:14.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:14.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.467656436, 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:14.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:14.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:14.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:14.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:14.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:14.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.223 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.42541431500001, 2024-05-10T14:05:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.224 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:14.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:14.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:14.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.38611484899999, 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.37911043299999, 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.37150465100001, 2024-05-10T14:05:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.314228644, 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.30311106799999, 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.17827153900001, 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.08261637800001, 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.07847810600001, 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 152.04572638299999, 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.88104418399999, 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.82383747599999, 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.68166076899999, 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.660975143, 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.65441900299999, 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.56947453500001, 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.56255169600001, 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:14.332 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:14.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:05:14.334 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:14.335 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:14.331+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:14.435 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:14.431+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:14.467 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:14.467 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:14.467 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:14.467 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:14.481 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:14.536 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:14.534+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:14.637 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:14.631+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:14.658 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:14.658 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:14.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:14.737 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:14.734+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:14.838 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:14.838+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.14933411499999, 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.12149594799999, 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.10773722499999, 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.024833632, 2024-05-10T14:05:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.998495873, 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.99740582199999, 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.994518766, 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.991940363, 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.96066106699999, 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.90902276200001, 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:14.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:14.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:14.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.894 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.824876612, 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:14.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:14.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.82083108200001, 2024-05-10T14:05:14.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:14.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.75456610099999, 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:14.906 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:14.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:14.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.71748081300001, 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.912 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:14.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.710347971, 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.918 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:14.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.923 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.50860690499999, 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.924 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:14.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:14.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:14.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.352676847, 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:14.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:14.935 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.34564636799999, 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:14.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:14.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.24784464000001, 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.941 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.946 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 152.240538246, 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:14.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:14.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:14.952 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:14.954 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:14.954 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:14.950+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:15.055 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:15.051+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:15.080 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.080 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:15.080 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:15.080 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:15.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:15.182 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:15.179+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:15.236 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:05:15.256 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:15.251+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:15.265 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:15.265 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:15.265 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:15.265 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:15.279 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:15.319 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-05-10T14:05:15.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:05:15.319 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T14:05:15.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-05-10T14:05:15.370 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:15.367+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 160.70197535299999, 2024-05-10T14:05:15.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:15.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.74936961200001, 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.454 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:15.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:15.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.72192563799999, 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:15.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:15.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.708668184, 2024-05-10T14:05:15.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:15.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:15.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.70609626800001, 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.472 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:15.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.477 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.60948367699999, 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:15.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.69336885300001, 2024-05-10T14:05:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:15.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.654027246, 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:15.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.595057282, 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:15.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.495 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.579515649, 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:15.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.57900961600001, 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:15.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:15.504 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.57479009799999, 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:15.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.55972510000001, 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.55833907799999, 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:15.513 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:15.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.517 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.553397614, 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.552941766, 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:15.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.53792250000001, 2024-05-10T14:05:15.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:15.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.530 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.532856479, 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:15.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.438886379, 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:15.535 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:15.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 135.62927464399999, 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:15.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:15.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:15.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:15.544 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:15.546 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:15.546 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:15.542+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:15.642 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-05-10T14:05:15.638+0000 7f59ce941640 -1 mon.a@0(leader).osd e99 definitely_dead 0 2024-05-10T14:05:15.646 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:15.642+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:15.718 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:15.718 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:15.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:15.747 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:15.746+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:15.850 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:15.850+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:15.854 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.855 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:15.855 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:15.855 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:15.855 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:15.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:15.951 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:15.947+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:15.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 176.44792123299999, 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:15.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:15.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:16.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:16.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.003 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.825017476, 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:16.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:16.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:16.009 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72948382999999, 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:16.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:16.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.015 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72942962400001, 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:16.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.729392754, 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:16.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:16.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.028 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72923120900001, 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:16.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:16.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72917786900001, 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:16.034 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:16.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:16.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72911995000001, 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.040 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:16.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.72899020099999, 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:16.046 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:16.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:16.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.728951744, 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:16.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:16.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.059 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50182862099999, 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:16.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:16.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:16.065 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50162117599999, 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:16.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:16.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:16.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:16.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50150729000001, 2024-05-10T14:05:16.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:16.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:16.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.501338885, 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:16.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50130132499999, 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:16.083 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:16.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:16.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.501247909, 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.089 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:16.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:16.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:16.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50112261999999, 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:16.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:16.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:16.100 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50108247700001, 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:16.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.50103009399999, 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:16.106 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:16.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:16.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 175.500845696, 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:16.112 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:16.117 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:16.119 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:16.119 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:16.118+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:16.142 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:16.142 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:16.159 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:16.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:16.176 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:16.194 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:16.195 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:16.213 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:16.220 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:16.215+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:16.233 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:16.250 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:16.251 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:16.262 INFO:teuthology.orchestra.run.smithi016.stderr:marked out osd.7. 2024-05-10T14:05:16.296 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:16.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:16.307 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:16.308 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:16.322 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:16.359 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:16.358+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:16.422 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:16.419+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:16.487 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:16.487 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:16.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:16.542 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:16.539+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:16.624 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:16.619+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:16.663 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:16.663 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:16.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:16.725 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:16.722+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:16.813 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:16.813 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:16.827 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:16.823+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:16.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:16.928 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:16.923+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:16.998 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:16.998 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:17.059 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:17.058+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:17.130 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:17.130+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:17.139 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:17.139 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:17.232 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:17.227+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:17.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:05:17.332 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:17.330+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:17.361 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:17.361 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:17.463 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:17.462+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:17.533 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:17.531+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:17.536 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:17.537 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:17.639 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:17.638+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:17.719 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:17.719 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:17.735 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:17.731+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:17.836 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:17.834+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:17.901 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:17.901 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:17.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:17.937 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:17.931+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:18.038 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:18.034+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:18.089 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:18.090 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:18.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:18.139 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:18.139+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:18.239 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:18.238+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:18.272 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:18.272 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:18.292 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:05:18.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:18.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:18.352 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:18.350+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:18.441 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:18.438+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:18.467 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:18.468 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:18.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:18.487 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:18.488 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:18.504 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:18.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:18.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:18.580 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:18.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:18.580 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:18.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:18.581 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:18.581 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:18.581 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:18.582 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:18.582+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:18.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:18.601 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:18.602 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:18.602 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:18.603 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:18.603 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:18.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:18.623 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:18.624 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:18.691 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:18.690+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:18.763 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.01780213200001, 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.017709661, 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 157.04746480200001, 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 157.00522268099999, 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.965923215, 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.958918799, 2024-05-10T14:05:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.95131301699999, 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.89403701000001, 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.882919434, 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.75807990499999, 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.66242474399999, 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.65828647199999, 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.625534749, 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.46085255, 2024-05-10T14:05:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.403645842, 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.261469135, 2024-05-10T14:05:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.24078350900001, 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.234227369, 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.14928290099999, 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 156.14236006199999, 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:18.901 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:18.902 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:18.903 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:18.899+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:19.004 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:19.002+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:19.035 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.036 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:19.036 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:19.036 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:19.050 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:19.105 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:19.099+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:19.176 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.177 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:19.177 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:19.177 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:19.177 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:19.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:19.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~51s 2024-05-10T14:05:19.234 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:19.231+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:19.306 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:19.303+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:19.360 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.66840966199999, 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:19.361 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 160.64057149499999, 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:19.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.62681277199999, 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.371 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:19.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:19.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.543909179, 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:19.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.51757142, 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:19.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:19.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:19.389 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.51648136899999, 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.393 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.513594313, 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.394 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:19.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.399 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.51101591, 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:19.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:19.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.47973661399999, 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.404 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:19.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.409 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.42809830900001, 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:19.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:19.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:19.415 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.343952159, 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:19.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.33990662900001, 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.421 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.426 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.27364164799999, 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.427 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:19.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:19.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.23655636000001, 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:19.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:19.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:19.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.229423518, 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:19.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:19.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.02768245199999, 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:19.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.871752394, 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:19.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.455 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.86472191499999, 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.456 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:19.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.76692018700001, 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.462 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:19.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:19.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 156.759613793, 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:19.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.474 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.474 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:19.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:19.476 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:19.474+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:19.577 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:19.578+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:19.644 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.644 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:19.644 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:19.645 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:19.658 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:19.678 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:19.674+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:19.779 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:19.775+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:19.781 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.781 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:19.781 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:19.781 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:19.781 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:19.795 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:19.880 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:19.878+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.966 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.21926067300001, 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.26665493199999, 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.971 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:19.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:19.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.239210958, 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.978 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:19.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:19.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.22595350399999, 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:19.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:19.989 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.223381588, 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:19.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.126768997, 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:19.995 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:19.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.21065417299999, 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.17131256600001, 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.11234260200001, 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.09680096899999, 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.09629493599999, 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.09207541800001, 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.07701041999999, 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.075624398, 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.07068293399999, 2024-05-10T14:05:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.07022708599999, 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.05520781999999, 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 158.05014179899999, 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 157.95617169900001, 2024-05-10T14:05:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.14655996400001, 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.062 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:20.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:20.064 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:20.059+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:20.165 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:20.162+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:20.231 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:20.232 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:20.246 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:20.293 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:20.291+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:20.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:05:20.364 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:20.364 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:20.365 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:20.363+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:20.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:20.467 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:20.463+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:20.546 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:20.546 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:20.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:20.546 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.99880932799999, 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.547 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:20.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:20.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:20.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.375905571, 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.554 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:20.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:20.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.280371925, 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.560 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:20.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.28031771900001, 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.566 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:20.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:20.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:20.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:20.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:20.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.28028084900001, 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:20.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:20.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:20.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:20.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.28011930400001, 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.579 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:20.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:20.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.28006596399999, 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.585 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:20.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:20.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.28000804499999, 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.592 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:20.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:20.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:20.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.27987829599999, 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.598 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:20.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.279839839, 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:20.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.609 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05271671599999, 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05250927099999, 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05239538500001, 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05222698, 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05218941999999, 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.052136004, 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05201071499999, 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05197057199999, 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.05191818899999, 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 180.051733791, 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:20.671 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:20.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:20.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:20.673 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:20.667+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:20.773 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:20.771+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:20.822 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:20.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:20.839 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:20.848 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:20.848 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:20.856 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:20.862 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:20.872 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:20.891 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:20.891 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:20.906 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:20.903+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:20.911 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:20.930 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:20.931 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:20.949 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:20.975 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:20.971+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:21.030 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.031 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:21.076 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:21.074+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:21.176 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:21.171+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:21.208 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.208 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:21.277 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:21.274+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:21.296 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:05:21.361 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.361 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:21.419 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:21.418+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:21.478 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:21.478+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:21.603 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:21.602+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:21.680 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:21.679+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:21.729 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.729 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:21.781 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:21.775+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:21.871 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:21.871 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:21.881 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:21.878+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:21.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:21.982 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:21.979+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:22.047 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.048 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:22.111 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:22.110+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:22.183 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:22.182+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:22.188 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.188 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:22.284 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:22.279+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:22.368 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.368 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:22.384 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:22.379+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:22.486 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:22.482+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:22.509 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.509 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.525 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:22.611 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:22.610+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:22.687 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:22.686+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:22.697 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.697 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:22.799 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:22.798+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:22.880 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:22.880 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:22.889 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:22.883+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:22.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:22.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:23.030 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:23.026+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:23.059 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:23.059 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:23.074 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:23.123 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:23.122+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:23.126 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:23.126 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:23.143 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:23.143 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:23.161 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:23.161 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:23.178 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:23.193 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:23.187+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:23.199 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:23.199 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:23.220 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:23.220 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:23.240 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:23.240 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:23.242 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 164.49831094499999, 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:23.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:23.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:23.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 164.498218474, 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:23.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:23.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.52797361500001, 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:23.254 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:23.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:23.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:23.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:23.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.48573149399999, 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:23.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:23.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:23.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.446432028, 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.271 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.439427612, 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:23.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.43182182999999, 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.37454582300001, 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:23.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.363428247, 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:23.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.23858871799999, 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.14293355699999, 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:23.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:23.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:23.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:23.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:23.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.13879528499999, 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 161.106043562, 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.941361363, 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.884154655, 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.741977948, 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.72129232200001, 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.714736182, 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.62979171399999, 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 160.62286887499999, 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:23.364 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:23.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:05:23.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:23.366 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:23.367 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:23.367 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:23.362+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:23.466 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:23.462+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:23.500 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:23.500 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:23.500 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:23.500 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:23.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:23.566 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:23.563+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:23.637 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:23.637 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:23.637 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:23.637 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:23.637 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:23.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:23.698 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:23.695+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:23.769 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:23.766+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 167.135181996, 2024-05-10T14:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.107343829, 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.09358510600001, 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.01068151300001, 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.98434375400001, 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:23.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.983253703, 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:23.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:23.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:23.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.98036664700001, 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.97778824400001, 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:23.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:23.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:23.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:23.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.946508948, 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.870 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:23.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:23.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.89487064299999, 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:23.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:23.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.81072449300001, 2024-05-10T14:05:23.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:23.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:23.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.806678963, 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.887 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:23.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:23.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.892 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.74041398200001, 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:23.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.898 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.70332869399999, 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.69619585199999, 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.904 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:23.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:23.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.49445478600001, 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.910 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.915 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.33852472800001, 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:23.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:23.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.331494249, 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.921 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.926 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.23369252099999, 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 161.22638612700001, 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:23.932 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:23.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:23.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:23.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:23.938 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:23.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:23.940 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:23.938+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:24.041 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:24.038+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:24.067 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.067 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:24.067 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:24.067 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:24.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:24.142 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:24.138+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:24.204 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.204 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:24.204 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:24.204 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:24.204 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:24.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:24.265 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:24.263+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 169.59424299099999, 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.64163725, 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.61419327600001, 2024-05-10T14:05:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.600935822, 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.598363906, 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.50175131500001, 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.585636491, 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.54629488399999, 2024-05-10T14:05:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:24.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.48732491999999, 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.47178328699999, 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.387 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:24.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:24.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:24.391 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.471277254, 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:24.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:24.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.395 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.46705773599999, 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:24.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:24.400 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.451992738, 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:24.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.404 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.45060671600001, 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.445665252, 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.409 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:24.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.445209404, 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:24.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.430190138, 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.418 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:24.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:24.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:24.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.425124117, 2024-05-10T14:05:24.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 162.33115401699999, 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 144.52154228200001, 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:24.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:24.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:24.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.435 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:24.437 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:24.437 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:24.431+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:24.537 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:24.535+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:24.604 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.604 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:24.604 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:24.604 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:24.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:24.666 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:24.663+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:24.740 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:24.738+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:24.788 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.788 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:24.788 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:24.789 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:24.789 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:24.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:24.841 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:24.838+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 185.38143501499999, 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.758531258, 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.662997612, 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66294340600001, 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66290653600001, 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66274499100001, 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66269165099999, 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.974 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66263373199999, 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:24.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:24.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:24.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:24.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66250398299999, 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.980 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.985 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.66246552600001, 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.991 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43534240299999, 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:24.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:24.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:24.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.997 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43513495799999, 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:24.998 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:24.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:25.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:25.004 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43502107200001, 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.434852667, 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.010 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:25.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:25.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:25.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43481510699999, 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:25.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:25.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:25.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:25.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43476169100001, 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.022 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:25.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:25.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.027 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.434636402, 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:25.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:25.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43459625899999, 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:25.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:25.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.43454387599999, 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:25.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:25.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:25.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 184.434359478, 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:25.048 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:25.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:25.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:25.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:25.056 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:25.056 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:25.051+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:25.157 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:25.151+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:25.224 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:25.224 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:25.224 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:25.224 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:25.238 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:25.258 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:25.254+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:25.358 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:25.355+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:25.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:25.405 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:25.405 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:25.405 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:25.406 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:25.406 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:25.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:25.460 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:25.458+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:25.529 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:25.530 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:25.546 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:25.561 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:25.559+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:25.566 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:25.567 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:25.584 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.712077323000003, 2024-05-10T14:05:25.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.712055653999997, 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:05:25.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.593 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.711018999999993, 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:05:25.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:05:25.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:05:25.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.709401726999999, 2024-05-10T14:05:25.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:05:25.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:05:25.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:25.602 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.393089228999997, 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.603 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:05:25.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.606 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 70.709393645000006, 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:25.607 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:05:25.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:25.611 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 65.705235408999997, 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:25.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.615 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 15.356656245, 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:05:25.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:25.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:25.620 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:25.621 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:25.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:25.622 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:25.623 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:25.644 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:25.644 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:25.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2024-05-10T14:05:25.664 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:25.664 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:25.670 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:25.667+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:25.757 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:25.757 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:25.762 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:25.762+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:25.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:25.864 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:25.859+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:25.946 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:25.946 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:25.961 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:25.964 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:25.959+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:26.065 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:26.062+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:26.081 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.081 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:26.187 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:26.186+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:26.266 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:26.266+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:26.273 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.273 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:26.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:05:26.375 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:26.374+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:26.460 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.460 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.468 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:26.467+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:26.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:26.569 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:26.566+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:26.598 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.598 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:26.698 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:26.698+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:26.771 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:26.770+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:26.781 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.782 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:26.872 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:26.867+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:26.964 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:26.964 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:26.973 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:26.970+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:26.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:27.073 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:27.070+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:27.152 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:27.152 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:27.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:27.211 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:27.210+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:27.275 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:27.274+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:27.333 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:05:27.346 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:27.346 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:27.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:27.403 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:27.402+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:27.477 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:27.475+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:27.520 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:27.520 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:27.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:27.578 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:27.578+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:27.652 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:27.652 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:27.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:27.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:27.707 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:27.706+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:27.780 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:27.775+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:27.796 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:27.796 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:27.811 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:27.858 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:27.875 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:27.875 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:27.881 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:27.878+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:27.891 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:27.892 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:27.908 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:27.908 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:27.926 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:27.927 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:27.944 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:27.965 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:27.965 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:27.980 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:27.980 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:27.981 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:27.979+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:27.983 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:27.984 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:27.994 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:28.082 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:28.078+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:28.161 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 171.46928283299999, 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:05:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 169.441444666, 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:05:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:05:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.427685943, 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:05:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.34478235, 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:05:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:05:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:05:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.318444591, 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:05:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.31735454, 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:05:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.31446748400001, 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:05:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:05:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:05:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:05:28.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.311889081, 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:05:28.201 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:05:28.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.280609785, 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:05:28.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:05:28.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:05:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:05:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.22897148000001, 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.211 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:05:28.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.14482533, 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:05:28.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:28.223 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.14077979999999, 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:28.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.226 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:05:28.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:05:28.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.074514819, 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.230 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.231 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.232 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:05:28.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:05:28.235 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.03742953099999, 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.236 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.237 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.239 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:05:28.240 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:05:28.241 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.03029668900001, 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.242 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:05:28.244 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.245 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.246 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:05:28.247 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.828555623, 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.248 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.250 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.251 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.253 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.672625565, 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.254 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.255 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.256 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:05:28.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:05:28.258 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.665595086, 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:05:28.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:28.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.265 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.56779335799999, 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.266 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:05:28.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:05:28.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 165.56048696400001, 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:05:28.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.277 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.277 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.277 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:28.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:28.279 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:28.275+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:28.379 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:28.378+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:28.447 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:28.447 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:28.448 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:28.448 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:28.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:28.479 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:28.478+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:28.581 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:28.575+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:28.584 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:28.585 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:28.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:28.681 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:28.678+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:28.769 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 174.02230314100001, 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.0696974, 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.042253426, 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:28.788 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.02899597199999, 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.026424056, 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 169.929811465, 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 167.013696641, 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.97435503400001, 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.91538507000001, 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.89984343699999, 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.89933740399999, 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.89511788600001, 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.88005288799999, 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.878666866, 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.87372540199999, 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.87326955399999, 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.85825028799999, 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.85318426699999, 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 166.75921416700001, 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 148.94960243200001, 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:28.865 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:28.866 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:28.867 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:28.866+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:28.968 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:28.963+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:28.994 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:28.994 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:28.994 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:29.069 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:29.066+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:29.171 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:29.171 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:29.172 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:29.172 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:29.172 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.172 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:29.170+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:29.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:29.272 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:29.267+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.76201931400001, 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:29.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.139115557, 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.318 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.04358191099999, 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.324 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.043527705, 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.043490835, 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.04332929, 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.04327595000001, 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.04321803100001, 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.04308828200001, 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 189.043049825, 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81592670200001, 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81571925700001, 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.815605371, 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81543696599999, 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81539940600001, 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81534599, 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81522070099999, 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81518055800001, 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.81512817500001, 2024-05-10T14:05:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 188.814943777, 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.446 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:05:29.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:29.448 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:29.443+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:29.549 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:29.543+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:29.617 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:29.617 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:29.617 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:29.618 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:29.678 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:29.675+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:29.751 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:29.750+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:29.799 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:29.799 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:29.799 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:29.799 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:29.799 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:29.823 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:05:29.851 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:29.850+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:29.936 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.062967798000003, 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.062946128999997, 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.061909474999993, 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:05:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:05:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.060292201999999, 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 79.743979703999997, 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 75.060284120000006, 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 70.056125883999997, 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:05:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:05:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:05:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 19.70754672, 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:29.969 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:29.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:29.970 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:29.966+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:30.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:30.071 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:30.070+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:30.105 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:30.105 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:30.105 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:30.105 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:30.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:30.163 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:30.171 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:30.167+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:30.181 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:30.181 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:30.198 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:30.215 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:30.215 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:30.236 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:30.257 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:30.258 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:30.272 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:30.270+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:30.279 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:30.281 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:30.281 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:30.281 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:30.294 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:30.300 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:30.301 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:30.373 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:30.367+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:30.417 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:30.417 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:30.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:30.478 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:30.478+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:30.557 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:30.557 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:30.572 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:30.574 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:30.571+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:30.675 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:30.675+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:30.742 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:30.742 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:30.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:30.776 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:30.771+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:30.877 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:30.874+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:30.887 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:30.887 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:30.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:30.978 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:30.975+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:31.075 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.075 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.078 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:31.079+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:31.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:31.180 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:31.175+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:31.218 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.218 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:31.281 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:31.275+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:31.363 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.363 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:31.423 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:31.422+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:31.482 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:31.479+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:31.502 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.502 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:31.603 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:31.602+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:31.683 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:31.682+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:31.690 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.690 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:31.785 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:31.783+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:31.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:05:31.866 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:31.866 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:31.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:31.930 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:31.927+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:31.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~64s 2024-05-10T14:05:31.986 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:31.982+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:32.010 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:32.010 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:32.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:32.110 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:32.107+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:32.188 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:32.188 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:32.188 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:32.186+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:32.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:05:32.291 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:32.290+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:32.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:32.367 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:32.367 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:32.381 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:32.390 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:32.390+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:32.474 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:32.475 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:32.491 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:32.492 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:32.487+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:32.506 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:32.506 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:32.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:32.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:32.523 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:32.523 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:32.541 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:32.558 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:32.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:32.592 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:32.590+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:32.598 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:32.687 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:32.687 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:32.688 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:32.688 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:32.693 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:32.690+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:32.701 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:32.794 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:32.791+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 178.075419732, 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:05:32.823 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:05:32.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 174.12281399099999, 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:32.828 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:05:32.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:05:32.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:05:32.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.835 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 174.09537001699999, 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 174.08211256300001, 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.842 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.843 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:05:32.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:05:32.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:05:32.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 174.07954064699999, 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:32.848 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:05:32.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:05:32.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:32.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 173.98292805599999, 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 171.06681323199999, 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.858 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 171.027471625, 2024-05-10T14:05:32.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:05:32.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:05:32.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.968501661, 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:05:32.870 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.95296002800001, 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:05:32.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.95245399500001, 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.875 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.948234477, 2024-05-10T14:05:32.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.93316947900001, 2024-05-10T14:05:32.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.93178345699999, 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:05:32.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:05:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.92684199300001, 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:05:32.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:05:32.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.92638614500001, 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:32.900 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.91136687900001, 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.90630085800001, 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:05:32.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:05:32.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:05:32.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 170.812330758, 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:32.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:05:32.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:05:32.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:05:32.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 153.002719023, 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:32.913 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:32.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:32.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:32.917 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:32.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:32.919 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:32.918+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:33.019 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:33.015+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:33.088 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.088 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:33.088 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:33.088 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:33.146 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:33.143+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:33.222 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:33.218+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:33.262 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:33.263 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:33.263 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:33.263 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:33.322 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:33.319+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.400 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.850725665, 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:33.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.22782190800001, 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.407 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:33.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:33.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.132288262, 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:33.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:33.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:33.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13223405599999, 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.419 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:33.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13219718600001, 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.430 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13203564099999, 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13198230099999, 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13192438199999, 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.131794633, 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 193.13175617600001, 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.904633053, 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.904425608, 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.90431172199999, 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.90414331700001, 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.904105757, 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.90405234100001, 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.903927052, 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.90388690899999, 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.903834526, 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.90365012800001, 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.522 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.524 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:33.524 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:33.519+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:33.625 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:33.622+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:33.726 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:33.726+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:33.823 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.823 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:33.823 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:33.824 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:33.824 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.827 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:33.826+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:33.836 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:33.928 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:33.930+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.084186407000004, 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.084164737999998, 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.083128083999995, 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:05:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 84.081510811000001, 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:05:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:05:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.765198312999999, 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:05:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:05:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 79.081502728999993, 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:05:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 74.077344492999998, 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:05:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 23.728765329000002, 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:33.991 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:33.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:34.039 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:34.038+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:34.129 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:34.129 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:34.129 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:34.129 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:34.130 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:34.127+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:34.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:34.231 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:34.230+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:34.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:05:34.313 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:34.313 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:34.313 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:34.313 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:34.313 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:34.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:34.331 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:34.330+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:34.433 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:34.427+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:34.461 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.29107806299999, 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.28954437799999, 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.955494066, 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:34.475 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 175.71337096100001, 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 175.71011620199999, 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.75116851799999, 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.73332933200001, 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.69687113000001, 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.68302650000001, 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.65380048899999, 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:34.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.63637334699999, 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:34.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:34.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.58221487899999, 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:34.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.36932394499999, 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:34.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.534 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.36493596299999, 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:34.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.191431091, 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.13865630500001, 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:34.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:34.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:34.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 172.133896722, 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:34.552 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 171.95354441699999, 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:34.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 171.94974062, 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.59027581199999, 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:34.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:34.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:34.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:34.575 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:34.577 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:34.577 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:34.574+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:34.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:34.677 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:34.674+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:34.751 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:34.751 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:34.751 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:34.751 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:34.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:34.767 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:34.768 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:34.785 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:34.785 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:34.786 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:34.782+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:34.802 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:34.802 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:34.818 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:34.819 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:34.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:34.839 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:34.860 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:34.879 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:34.875+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:34.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:34.881 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:34.883 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:34.884 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:34.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:34.901 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:34.902 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:34.980 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:34.975+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:35.017 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.017 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:35.081 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:35.078+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:35.215 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:35.214+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:05:35.283 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:35.279+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:35.348 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.348 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:35.407 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:35.406+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:35.485 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:35.483+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:35.487 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.487 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:35.586 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:35.586+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:35.671 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.672 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:35.688 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:35.683+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:35.788 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:35.786+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:35.862 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:35.862 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:35.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:35.919 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:35.918+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:35.989 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:35.986+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:36.047 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.047 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.061 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:36.106 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:36.103+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:36.192 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:36.194+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:36.193 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.194 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:36.292 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:36.290+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:36.370 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.370 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:36.429 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:36.427+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:36.494 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:36.491+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:36.510 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.511 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.525 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:36.595 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:36.594+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:36.688 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.688 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.696 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:36.694+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:36.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:36.797 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:36.795+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:36.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:36.898 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:36.898+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:36.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:36.999 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:36.998+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:37.000 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:37.000 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:37.014 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:37.080 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:37.080 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:37.097 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:37.099 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:37.095+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:37.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:37.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:37.132 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:37.138 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:37.138 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:37.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:37.153 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:37.154 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:37.170 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:37.205 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:37.206 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:37.241 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:37.239+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:37.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:05:37.315 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:37.314+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:37.322 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:37.322 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:37.322 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:37.322 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:37.322 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:37.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:37.403 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:37.402+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:37.504 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:37.499+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.95787107199999, 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.507 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.513 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.334967315, 2024-05-10T14:05:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:05:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.520 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.521 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23943366899999, 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.522 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:05:37.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23937946300001, 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.528 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:05:37.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:05:37.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:05:37.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:05:37.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.536 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.537 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:37.537 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.239342593, 2024-05-10T14:05:37.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.538 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:05:37.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:05:37.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:05:37.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23918104800001, 2024-05-10T14:05:37.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:05:37.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:05:37.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23912770800001, 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:37.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:05:37.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:05:37.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:05:37.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:05:37.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23906978900001, 2024-05-10T14:05:37.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:05:37.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:05:37.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:05:37.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:05:37.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:05:37.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.576 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.23894003999999, 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:05:37.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.238901583, 2024-05-10T14:05:37.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:05:37.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:37.590 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01177845999999, 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:05:37.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:05:37.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01157101499999, 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.598 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.599 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.599 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.599 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.599 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:05:37.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:05:37.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:05:37.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.607 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01145712900001, 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.608 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:37.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.011288724, 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.614 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:05:37.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:05:37.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01125116399999, 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.620 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:37.626 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.011197748, 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.632 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01107245899999, 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:05:37.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:05:37.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:05:37.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.638 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01103231600001, 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:37.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:05:37.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:05:37.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.01097993299999, 2024-05-10T14:05:37.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:05:37.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:05:37.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:05:37.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:05:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 197.010795535, 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:37.651 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:05:37.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:05:37.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:05:37.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:37.657 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:37.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:37.659 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:37.655+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:37.760 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:37.755+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:37.829 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:37.829 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:37.843 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:37.886 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:37.883+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:37.961 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:37.959+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:38.010 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:38.010 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:38.010 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:38.010 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:38.011 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:38.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:38.062 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:38.062+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:38.163 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:38.159+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:38.191 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:38.191 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.317957059999998, 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:05:38.192 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.193 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:05:38.195 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.317935391000006, 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:05:38.196 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.197 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:05:38.198 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.199 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:38.200 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.316898737000002, 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.201 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.202 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.203 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:05:38.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.206 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 88.315281463999995, 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.207 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.209 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.210 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.998968966000007, 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:05:38.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.212 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:05:38.213 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:05:38.215 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 83.315273382000001, 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.216 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:05:38.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:05:38.219 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 78.311115146000006, 2024-05-10T14:05:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:05:38.222 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.223 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 27.962535981999999, 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:38.225 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:38.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:38.227 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:38.228 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:05:38.229 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:38.230 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:38.231 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:38.254 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:05:38.273 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:38.271+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:38.363 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:38.364 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:38.364 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:38.364 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:38.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~70s 2024-05-10T14:05:38.365 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:38.362+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:38.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:38.467 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:38.467+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:38.545 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:38.545 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:38.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:38.607 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:38.606+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:38.668 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:38.666+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.51948279300001, 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:38.690 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:38.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:38.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.51794910800001, 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:38.699 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.18389879599999, 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.703 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 179.941775691, 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.704 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:38.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:38.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 179.93852093199999, 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.710 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:38.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:38.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:38.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:38.715 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.97957324800001, 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:38.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:38.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:38.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.961734062, 2024-05-10T14:05:38.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:38.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.92527586, 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.91143123000001, 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.88220521900001, 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:38.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:38.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:38.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.86477807700001, 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.81061960900001, 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:38.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.59772867500001, 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:38.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:38.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:38.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.59334069299999, 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:38.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:38.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.41983582099999, 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.36706103500001, 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:38.779 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.362301452, 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:38.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.785 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.18194914700001, 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:38.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:38.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:38.791 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.17814534999999, 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.81868054200001, 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:38.804 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:38.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:38.806 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:38.802+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:38.906 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:38.906+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:38.979 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:38.979 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:38.979 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:38.979 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:38.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:39.007 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:39.003+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:39.107 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:39.106+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:39.163 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:39.163 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:39.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:39.208 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:39.207+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:39.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:39.310 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:39.310+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:39.354 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:39.354 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.67274815499999, 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:39.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:39.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.626679102, 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:39.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.621168756, 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:39.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.51090992799999, 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.369 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:39.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.63468384500001, 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.375 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:39.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:39.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.61212096200001, 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:39.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.387 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.58579293299999, 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:39.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:39.393 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.56819637500001, 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:39.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:39.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:39.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.535857798, 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:39.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:39.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.501781134, 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:39.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.49122472400001, 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:39.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:39.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.21026195900001, 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:39.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:39.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:39.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.20597278, 2024-05-10T14:05:39.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:39.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.16452567100001, 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:39.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:39.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:39.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.066284852, 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:39.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:39.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 177.04481999500001, 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:39.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.98028630900001, 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:39.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:39.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 176.71297176600001, 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.453 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:39.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.05154122799999, 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:39.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:39.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 129.051412935, 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:39.464 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:39.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:39.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:39.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:39.470 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:39.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:39.472 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:39.472 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:39.473 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:39.473 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:39.473 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:39.473 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:39.474 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:39.474 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:39.474 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:39.467+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:39.478 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:39.479 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:39.500 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:39.500 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:39.521 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:39.521 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:39.543 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:39.543 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:39.596 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:39.597 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:39.597 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:39.594+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:39.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:39.698 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:39.698+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:39.775 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:39.774+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:39.779 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:39.779 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:39.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:39.876 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:39.875+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:39.958 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:39.958 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:39.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:39.977 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:39.975+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:40.078 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:40.079+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:40.100 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.101 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:40.179 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:40.179+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:40.241 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.241 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:40.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:05:40.303 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:40.302+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:40.378 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.378 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.382 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:40.378+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:40.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:40.483 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:40.482+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:40.524 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.524 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:40.585 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:40.583+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:40.656 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.656 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:40.713 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:40.711+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:40.786 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:40.782+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:40.833 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.833 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:40.887 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:40.886+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:40.965 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:40.965 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:40.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:40.987 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:40.986+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:41.089 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:41.086+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:41.092 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:41.092 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:41.105 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:41.190 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:41.190+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:41.211 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:41.212 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:41.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:05:41.292 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:41.290+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:41.338 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:41.338 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:41.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:41.397 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:41.395+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:41.473 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:41.473 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:41.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:41.530 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:41.527+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:41.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:41.594 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:41.591+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:41.654 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:41.655 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:41.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:41.714 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:41.715+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:41.719 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:41.737 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:41.738 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:41.756 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:41.774 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:41.775 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:41.793 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:41.796 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:41.791+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:41.814 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:41.835 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:41.835 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:41.838 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:41.838 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:41.838 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:41.838 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:41.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:41.855 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:41.855 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:41.897 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:41.894+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:41.998 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:41.998+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:42.014 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:42.014 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:42.014 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:42.014 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:42.014 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:42.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:42.099 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:42.098+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:42.159 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:42.159 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.28598461, 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.160 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:05:42.162 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.285962940999994, 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:05:42.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:05:42.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.284926287000005, 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:05:42.167 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.168 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.169 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.170 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 92.283309013999997, 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:42.172 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.173 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.174 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:05:42.175 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 91.966996515999995, 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:42.176 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.177 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.178 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:05:42.179 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 87.283300932000003, 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.181 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.182 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:05:42.183 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 82.279142695999994, 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:42.184 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.186 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:05:42.187 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:42.188 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 31.930563532000001, 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:42.189 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:05:42.190 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:05:42.191 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:05:42.192 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:42.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:42.199 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:42.195+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:42.300 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:42.299+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:42.332 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:42.333 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:42.333 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:42.333 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:42.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:42.401 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:42.398+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:42.475 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:42.475 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:42.475 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:42.475 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:42.475 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:42.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:42.531 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:42.530+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:42.602 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:42.602+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:42.662 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:42.662 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:42.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:42.662 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:42.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.49170023799999, 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:42.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.49016655299999, 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:42.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.671 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.15611624100001, 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:42.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 183.91399313599999, 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:42.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 183.910738377, 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:42.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:42.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.95179069299999, 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:42.687 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:42.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:42.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.93395150699999, 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.694 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:42.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.89749330500001, 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:42.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:42.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.88364867499999, 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:42.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.854422664, 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:42.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.836995522, 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:42.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:42.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.782837054, 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:42.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.56994612, 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:42.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:42.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:42.734 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.565558138, 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:42.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.392053266, 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:42.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.745 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.33927847999999, 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:42.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.33451889700001, 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:42.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:42.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:42.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:42.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:42.757 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.154166592, 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:42.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.15036279500001, 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:42.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:42.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:42.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:42.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.79089798699999, 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:42.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:42.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:42.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:42.775 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:42.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:42.777 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:42.774+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:42.877 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:42.874+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:42.950 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:42.951 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:42.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:42.978 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:42.979+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:43.080 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:43.079+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:43.133 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:43.134 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:43.134 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:43.134 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:43.134 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:43.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:43.195 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:43.194+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.59323134499999, 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:43.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:43.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.547162292, 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:43.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:43.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.541651946, 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:43.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.43139311799999, 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:43.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:43.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:43.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:43.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.55516703500001, 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:43.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.532604152, 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:43.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:43.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:43.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.50627612299999, 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:43.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:43.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.48867956500001, 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.45634098799999, 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:43.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.422264324, 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:43.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:43.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.411707914, 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:43.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:43.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.13074514900001, 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:43.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.346 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.12645596999999, 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:43.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.352 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.08500886100001, 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:43.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.98676804199999, 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:43.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:43.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:43.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.96530318500001, 2024-05-10T14:05:43.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.90076949900001, 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:43.370 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:43.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 180.63345495600001, 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:43.376 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:43.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.97202441799999, 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:43.382 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:43.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:43.388 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 132.971896125, 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:43.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:43.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:43.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.394 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:43.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:05:43.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:43.397 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:43.394+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:43.498 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:43.495+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:43.565 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:43.566 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:43.566 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:43.566 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:43.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:43.597 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:43.595+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:43.698 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:43.694+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:43.698 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:43.698 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:43.699 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:43.699 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:43.699 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:43.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:43.799 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:43.799+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:43.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:43.876 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.13650798399999, 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.877 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:43.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:43.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 182.047532899, 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.883 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:43.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:43.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 182.034265506, 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:43.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:43.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:43.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 182.02867006400001, 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:43.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:43.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.710656779, 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:43.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:43.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:43.906 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.706603513, 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:43.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:43.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.668978616, 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:43.912 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:43.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:43.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.53780602, 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.918 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:43.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:43.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.53379769700001, 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.48088338599999, 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:43.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.46727371099999, 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:43.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:43.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.46318519900001, 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.942 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:43.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:43.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.416848966, 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.948 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:43.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.413088316, 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.959 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.32579403700001, 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:43.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:43.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:43.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.321954412, 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.966 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:43.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:43.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:43.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:43.971 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.227824416, 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:43.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:43.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:43.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.21366530200001, 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:43.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:43.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:43.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:43.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 181.209864004, 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:43.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 133.57437039800001, 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:43.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:43.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:43.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:43.995 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:43.995 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:43.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:43.997 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:43.994+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:44.097 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:44.094+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:44.147 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:44.148 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:44.164 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:44.164 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:44.174 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:44.174 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:44.182 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:44.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:44.200 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:44.200 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:44.198+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:44.221 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:44.221 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:44.242 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:44.263 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:44.284 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:05:44.299 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:44.295+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:44.324 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:44.324 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:44.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:44.430 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:44.430+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:44.501 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:44.498+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:44.505 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:44.505 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:44.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:44.602 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:44.599+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:44.654 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:44.655 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:44.669 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:44.704 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:44.702+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:44.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~77s 2024-05-10T14:05:44.805 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:44.799+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:44.840 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:44.840 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:44.854 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:44.941 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:44.939+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:45.007 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:45.006+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:45.023 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.023 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:45.125 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:45.127+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:45.207 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.207 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.209 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:45.206+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:45.221 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:45.313 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:45.315+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:45.395 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.396 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.409 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:45.411 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:45.410+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:45.511 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:45.511+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:45.576 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.577 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:45.633 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:45.635+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:45.714 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:45.715+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:45.759 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.759 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:45.817 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:45.819+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:45.916 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:45.918+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:45.942 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:45.942 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:45.958 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:46.018 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:46.014+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:46.073 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:46.073 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:46.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:46.119 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:46.118+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:46.220 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:46.219+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:46.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:46.296 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-05-10T14:05:46.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T14:05:46.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:46.315 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:05:46.343 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:46.342+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:46.390 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:46.390 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:46.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:46.421 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:46.418+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:46.491 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:46.491 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:46.508 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:46.508 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:46.522 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:46.518+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:46.524 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:46.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:46.541 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:46.561 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:46.582 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:46.602 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:46.602 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:46.623 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:46.623+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:46.655 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:46.655 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:46.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:46.724 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:46.723+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:46.824 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:46.824 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:46.824 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:46.824 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:46.824 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:46.825 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:46.823+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:46.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:46.925 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:46.927+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.78222495, 2024-05-10T14:05:46.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:46.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:46.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.780691265, 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:46.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:46.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:46.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.44664095300001, 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.20451784799999, 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.20126308900001, 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:46.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:46.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:46.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.242315405, 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:46.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.224476219, 2024-05-10T14:05:46.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:46.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.18801801699999, 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:46.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:46.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:46.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.174173387, 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:46.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:46.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:46.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:46.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:46.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.144947376, 2024-05-10T14:05:47.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:47.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:47.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:47.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:47.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.127520234, 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.073361766, 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:47.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:47.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:47.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.860470832, 2024-05-10T14:05:47.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:47.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:47.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.85608285000001, 2024-05-10T14:05:47.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:47.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:47.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.68257797800001, 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.629803192, 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:47.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:47.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.62504360899999, 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:47.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.046 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.444691304, 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:47.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.44088750700001, 2024-05-10T14:05:47.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.081422699, 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:47.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.064 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.064 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.064 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.064 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.064 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:47.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:47.066 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:47.062+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:47.166 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:47.166+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:47.236 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:47.236 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:47.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:47.267 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:47.267+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:47.287 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T14:05:47.287 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:05:47.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T14:05:47.368 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:47.367+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:47.408 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:47.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:47.409 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:47.409 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:47.409 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:47.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:47.470 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:47.470+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 192.86772588400001, 2024-05-10T14:05:47.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:47.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.82165683100001, 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.553 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:47.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:47.557 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.81614648499999, 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:47.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:47.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:47.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.70588765700001, 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.562 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:47.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.567 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.829661574, 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:47.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:47.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:47.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.80709869099999, 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:47.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:47.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:47.578 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.78077066200001, 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.584 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.763174104, 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.73083552700001, 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:47.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:47.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.69675886300001, 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:47.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.601 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.68620245299999, 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:47.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.40523968799999, 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:47.607 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:47.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:47.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:47.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.40095050900001, 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:47.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:47.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:47.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.35950339999999, 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:47.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:47.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:47.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.26126258100001, 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:47.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.239797724, 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:47.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:47.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:47.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.17526403799999, 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 184.907949495, 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:47.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.24651895700001, 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.647 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:47.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:47.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:47.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:47.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.24639066399999, 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:47.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.658 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:47.658 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:47.658 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:47.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:47.660 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:47.658+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:47.760 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:47.758+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:47.818 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:47.819 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:47.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:47.875 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:47.874+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:47.963 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:47.963+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:47.998 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:47.998 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:47.998 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:47.998 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:47.998 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:48.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:48.064 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:48.063+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.127 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.38737596600001, 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:48.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:48.133 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.29840088099999, 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:48.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:48.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.28513348800001, 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.139 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.144 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.279538046, 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.96152476099999, 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:48.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.95747149499999, 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:48.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:48.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:48.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:48.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.91984659799999, 2024-05-10T14:05:48.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:48.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:48.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:48.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.78867400199999, 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.172 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.784665679, 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.173 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.178 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.731751368, 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:48.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:48.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.71814169300001, 2024-05-10T14:05:48.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:48.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:48.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:48.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.714053181, 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:48.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.66771694799999, 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.196 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:48.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:48.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.66395629799999, 2024-05-10T14:05:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:48.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:48.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:48.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.576662019, 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:48.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:48.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:48.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.57282239400001, 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:48.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.47869239799999, 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:48.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.464533284, 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:48.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 185.46073198600001, 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.230 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.235 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 137.82523838, 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.241 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:48.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:48.243 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:48.243+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:48.305 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T14:05:48.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T14:05:48.343 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:48.343+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:48.380 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:48.380 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:48.380 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:48.380 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:48.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:48.482 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:48.482+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:48.545 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:48.547+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:48.567 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:48.568 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:48.568 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:48.568 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:48.568 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:48.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:48.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:48.671 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:48.670+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:48.746 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:48.747+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:48.753 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:48.753 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:48.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:48.753 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.008467956, 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:48.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:48.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:48.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.759 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.00837548499999, 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 187.038130626, 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:48.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:48.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.99588850500001, 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.95658903899999, 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:48.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.94958462299999, 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.94197884100001, 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.794 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.884702834, 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:48.800 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.87358525799999, 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:48.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.74874572900001, 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:48.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.65309056800001, 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:48.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:48.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.648952296, 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.61620057299999, 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:48.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:48.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:48.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.45151837399999, 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:48.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:48.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:48.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:48.835 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.39431166599999, 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:48.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.25213495899999, 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:48.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.231449333, 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:48.848 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:48.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.22489319300001, 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:48.854 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:48.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.13994872500001, 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:48.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:48.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:48.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:48.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:48.871 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 186.13302588600001, 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:48.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:48.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:48.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:48.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:48.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:48.879 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:48.880 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:48.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:48.882 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:48.883 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:48.884 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:48.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:48.885 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:48.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:48.886 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:48.886 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:48.887 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:48.887 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:48.878+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:48.900 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:48.900 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:48.922 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:48.945 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:48.982 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:48.983+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:49.016 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.016 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:49.117 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:49.119+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:49.184 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:49.183+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:49.194 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.195 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.209 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:49.286 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:49.282+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:49.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:05:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T14:05:49.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T14:05:49.380 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.380 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.387 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:49.387+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:49.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:49.487 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:49.486+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:49.562 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.562 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.578 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:49.625 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:49.627+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:49.689 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:49.686+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:49.700 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.701 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:49.790 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:49.786+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:49.878 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:49.878 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:49.891 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:49.891+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:49.892 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:49.992 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:49.991+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:50.061 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.061 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:50.121 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:50.123+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:50.193 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:50.190+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:50.246 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.246 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.262 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:50.294 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:50.290+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:50.330 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T14:05:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:05:50.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T14:05:50.388 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.388 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.395 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:50.395+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:50.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:50.496 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:50.495+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:50.571 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.572 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.587 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:50.598 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:50.594+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:50.699 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:50.699+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:50.758 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.759 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:50.800 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:50.798+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:50.901 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:50.899+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:50.942 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:50.942 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:50.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:50.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:51.007 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:51.006+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:51.094 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:51.094 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:51.103 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:51.103+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:51.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:51.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~83s 2024-05-10T14:05:51.157 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:51.157 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:51.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:51.174 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:51.192 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:51.204 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:51.202+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:51.209 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:51.229 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:51.229 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:51.229 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:51.230 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:51.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:51.252 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:51.252 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:51.274 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:51.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:51.304 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:51.302+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:51.337 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T14:05:51.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T14:05:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:51.384 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.215934092, 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:51.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.214400407, 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:51.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 210.88035009500001, 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.395 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:51.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 192.63822698999999, 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:51.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:51.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 192.63497223100001, 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:51.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:51.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.676024547, 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:51.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:51.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.65818536099999, 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:51.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.62172715899999, 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.426 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:51.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.60788252899999, 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:51.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.578656518, 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:51.438 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:51.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:51.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:51.444 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.561229376, 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:51.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.507070908, 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:51.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.294179974, 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:51.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:51.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.289791992, 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.463 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:51.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:51.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:51.468 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.11628712000001, 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:51.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:51.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:51.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:51.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.063512334, 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:51.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:51.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:51.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.05875275099999, 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:51.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:51.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.878400446, 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:51.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 188.87459664900001, 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:51.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:51.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 159.515131841, 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:51.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:51.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.509 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.509 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.509 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:51.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:51.512 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:51.510+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:51.612 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:51.611+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:51.681 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:51.681 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:51.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:51.712 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:51.711+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:51.812 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:51.812 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:51.812 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:51.812 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:51.812 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:51.814 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:51.815+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:51.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:51.914 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:51.915+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:51.954 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:51.954 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.272809685, 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:51.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:51.959 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.226740632, 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:51.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.22123028600001, 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:51.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:51.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:51.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.11097145799999, 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:51.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:51.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:51.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.23474537499999, 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:51.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:51.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:51.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.21218249200001, 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:51.979 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:51.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:51.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.185854463, 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.985 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.990 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.16825790499999, 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:51.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:51.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.135919328, 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:51.996 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:51.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:52.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.101842664, 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:52.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.09128625400001, 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:52.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:52.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.81032348900001, 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:52.013 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:52.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:52.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:52.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:52.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.80603431, 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:52.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:52.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:52.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.76458720100001, 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:52.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:52.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:52.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:52.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:52.030 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.666346382, 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:52.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:52.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.64488152499999, 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.037 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:52.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:52.042 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.58034783900001, 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:52.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:52.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:52.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.31303329599999, 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:52.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:52.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:52.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.651602758, 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:52.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:52.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 141.65147446500001, 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:52.059 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:52.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:52.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:52.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:52.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.065 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:52.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:52.067 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:52.067+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:52.167 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:52.166+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:52.198 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:52.199 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:52.199 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:52.199 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:52.213 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:52.303 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:52.302+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:52.343 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T14:05:52.369 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:52.366+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:52.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:05:52.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T14:05:52.395 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:52.395 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:52.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:52.498 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:52.498+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:52.571 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:52.571+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:52.593 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.85394011299999, 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:52.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:52.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.76496502800001, 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:52.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:52.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.751697635, 2024-05-10T14:05:52.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:52.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:52.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:52.611 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.74610219300001, 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:52.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:52.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.42808890800001, 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:52.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:52.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:52.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.42403564200001, 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:52.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.38641074500001, 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:52.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:52.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.25523814900001, 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:52.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.640 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.25122982600001, 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.19831551499999, 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:52.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.18470583999999, 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.652 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:52.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:52.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:52.657 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.18061732800001, 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:52.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:52.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:52.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.13428109500001, 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:52.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.130520445, 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.674 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.04322616600001, 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:52.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:52.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.039386541, 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.685 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.94525654500001, 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:52.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:52.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.93109743100001, 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:52.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:52.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:52.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 189.927296133, 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:52.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 142.29180252699999, 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:52.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:52.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:52.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:52.708 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:52.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:52.710 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:52.711+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:52.811 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:52.811+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:52.877 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:52.877 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:52.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:52.912 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:52.911+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:53.013 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:53.010+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:53.016 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:53.016 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:53.016 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:53.017 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:53.017 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:53.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:53.115 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:53.115+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:53.205 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.462321965, 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:53.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:53.211 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.46222949400001, 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:53.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.49198463499999, 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.222 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.44974251400001, 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:53.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:53.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:53.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.41044304799999, 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:53.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.40343863199999, 2024-05-10T14:05:53.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:53.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:53.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.39583285000001, 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:53.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.245 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.33855684299999, 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.246 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:53.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.32743926699999, 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:53.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.202599738, 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.10694457700001, 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.267 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.102806305, 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:53.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 191.07005458200001, 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:53.273 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.90537238300001, 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:53.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:53.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.84816567499999, 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:53.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:53.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:53.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.290 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.70598896800001, 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:53.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.685303342, 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:53.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.67874720200001, 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:53.302 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:53.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:53.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.59380273400001, 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.308 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:53.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:53.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:53.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 190.58687989500001, 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:53.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:53.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:53.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:53.319 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:53.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:53.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:53.322 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:53.318+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:05:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T14:05:53.406 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T14:05:53.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:05:53.451 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:53.450+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:53.455 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:53.455 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:53.455 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:53.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:53.522 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:53.523+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:53.527 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:53.527 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:53.544 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:53.545 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:53.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:53.577 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:53.596 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:53.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:53.615 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:53.615 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:53.623 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:53.622+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:53.636 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:53.636 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:53.656 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:53.657 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:53.675 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:53.724 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:53.723+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:53.775 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:53.775 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:53.789 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:53.795 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:05:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:05:53.813 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-10T14:05:53.365354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6883704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":266764,"kb_used_data":31316,"kb_used_omap":13,"kb_used_meta":235314,"kb_avail":660336116,"statfs":{"total":676457349120,"available":676184182784,"internally_reserved":0,"allocated":32067584,"data_stored":27749306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14125,"internal_metadata":240961747},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665169+0000","last_change":"2024-05-10T14:05:17.308499+0000","last_active":"2024-05-10T14:05:51.665169+0000","last_peered":"2024-05-10T14:05:51.665169+0000","last_clean":"2024-05-10T14:05:51.665169+0000","last_became_active":"2024-05-10T14:05:17.307153+0000","last_became_peered":"2024-05-10T14:05:17.307153+0000","last_unstale":"2024-05-10T14:05:51.665169+0000","last_undegraded":"2024-05-10T14:05:51.665169+0000","last_fullsized":"2024-05-10T14:05:51.665169+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:41.503945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588800+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:05:48.588800+0000","last_peered":"2024-05-10T14:05:48.588800+0000","last_clean":"2024-05-10T14:05:48.588800+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:05:48.588800+0000","last_undegraded":"2024-05-10T14:05:48.588800+0000","last_fullsized":"2024-05-10T14:05:48.588800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317935+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:05:48.317935+0000","last_peered":"2024-05-10T14:05:48.317935+0000","last_clean":"2024-05-10T14:05:48.317935+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:05:48.317935+0000","last_undegraded":"2024-05-10T14:05:48.317935+0000","last_fullsized":"2024-05-10T14:05:48.317935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316034+0000","last_change":"2024-05-10T14:05:17.302016+0000","last_active":"2024-05-10T14:05:48.316034+0000","last_peered":"2024-05-10T14:05:48.316034+0000","last_clean":"2024-05-10T14:05:48.316034+0000","last_became_active":"2024-05-10T14:05:17.301670+0000","last_became_peered":"2024-05-10T14:05:17.301670+0000","last_unstale":"2024-05-10T14:05:48.316034+0000","last_undegraded":"2024-05-10T14:05:48.316034+0000","last_fullsized":"2024-05-10T14:05:48.316034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:45:00.694606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659922+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:05:51.659922+0000","last_peered":"2024-05-10T14:05:51.659922+0000","last_clean":"2024-05-10T14:05:51.659922+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:05:51.659922+0000","last_undegraded":"2024-05-10T14:05:51.659922+0000","last_fullsized":"2024-05-10T14:05:51.659922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341056+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:05:51.341056+0000","last_peered":"2024-05-10T14:05:51.341056+0000","last_clean":"2024-05-10T14:05:51.341056+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:05:51.341056+0000","last_undegraded":"2024-05-10T14:05:51.341056+0000","last_fullsized":"2024-05-10T14:05:51.341056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589242+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:05:48.589242+0000","last_peered":"2024-05-10T14:05:48.589242+0000","last_clean":"2024-05-10T14:05:48.589242+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:05:48.589242+0000","last_undegraded":"2024-05-10T14:05:48.589242+0000","last_fullsized":"2024-05-10T14:05:48.589242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659422+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:05:51.659422+0000","last_peered":"2024-05-10T14:05:51.659422+0000","last_clean":"2024-05-10T14:05:51.659422+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:05:51.659422+0000","last_undegraded":"2024-05-10T14:05:51.659422+0000","last_fullsized":"2024-05-10T14:05:51.659422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339898+0000","last_change":"2024-05-10T14:05:17.288678+0000","last_active":"2024-05-10T14:05:51.339898+0000","last_peered":"2024-05-10T14:05:51.339898+0000","last_clean":"2024-05-10T14:05:51.339898+0000","last_became_active":"2024-05-10T14:05:17.288084+0000","last_became_peered":"2024-05-10T14:05:17.288084+0000","last_unstale":"2024-05-10T14:05:51.339898+0000","last_undegraded":"2024-05-10T14:05:51.339898+0000","last_fullsized":"2024-05-10T14:05:51.339898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:03.103193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664424+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:05:51.664424+0000","last_peered":"2024-05-10T14:05:51.664424+0000","last_clean":"2024-05-10T14:05:51.664424+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:05:51.664424+0000","last_undegraded":"2024-05-10T14:05:51.664424+0000","last_fullsized":"2024-05-10T14:05:51.664424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.585584+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:05:48.585584+0000","last_peered":"2024-05-10T14:05:48.585584+0000","last_clean":"2024-05-10T14:05:48.585584+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:05:48.585584+0000","last_undegraded":"2024-05-10T14:05:48.585584+0000","last_fullsized":"2024-05-10T14:05:48.585584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343885+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:05:51.343885+0000","last_peered":"2024-05-10T14:05:51.343885+0000","last_clean":"2024-05-10T14:05:51.343885+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:05:51.343885+0000","last_undegraded":"2024-05-10T14:05:51.343885+0000","last_fullsized":"2024-05-10T14:05:51.343885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658723+0000","last_change":"2024-05-10T14:05:17.315837+0000","last_active":"2024-05-10T14:05:51.658723+0000","last_peered":"2024-05-10T14:05:51.658723+0000","last_clean":"2024-05-10T14:05:51.658723+0000","last_became_active":"2024-05-10T14:05:17.315476+0000","last_became_peered":"2024-05-10T14:05:17.315476+0000","last_unstale":"2024-05-10T14:05:51.658723+0000","last_undegraded":"2024-05-10T14:05:51.658723+0000","last_fullsized":"2024-05-10T14:05:51.658723+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:37.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590703+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:05:48.590703+0000","last_peered":"2024-05-10T14:05:48.590703+0000","last_clean":"2024-05-10T14:05:48.590703+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:05:48.590703+0000","last_undegraded":"2024-05-10T14:05:48.590703+0000","last_fullsized":"2024-05-10T14:05:48.590703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337326+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:05:51.337326+0000","last_peered":"2024-05-10T14:05:51.337326+0000","last_clean":"2024-05-10T14:05:51.337326+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:05:51.337326+0000","last_undegraded":"2024-05-10T14:05:51.337326+0000","last_fullsized":"2024-05-10T14:05:51.337326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341281+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:05:51.341281+0000","last_peered":"2024-05-10T14:05:51.341281+0000","last_clean":"2024-05-10T14:05:51.341281+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:05:51.341281+0000","last_undegraded":"2024-05-10T14:05:51.341281+0000","last_fullsized":"2024-05-10T14:05:51.341281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340025+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:05:51.340025+0000","last_peered":"2024-05-10T14:05:51.340025+0000","last_clean":"2024-05-10T14:05:51.340025+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:05:51.340025+0000","last_undegraded":"2024-05-10T14:05:51.340025+0000","last_fullsized":"2024-05-10T14:05:51.340025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593178+0000","last_change":"2024-05-10T14:05:17.307897+0000","last_active":"2024-05-10T14:05:48.593178+0000","last_peered":"2024-05-10T14:05:48.593178+0000","last_clean":"2024-05-10T14:05:48.593178+0000","last_became_active":"2024-05-10T14:05:17.307124+0000","last_became_peered":"2024-05-10T14:05:17.307124+0000","last_unstale":"2024-05-10T14:05:48.593178+0000","last_undegraded":"2024-05-10T14:05:48.593178+0000","last_fullsized":"2024-05-10T14:05:48.593178+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:29.087558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":153,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315611+0000","last_change":"2024-05-10T14:05:17.306970+0000","last_active":"2024-05-10T14:05:48.315611+0000","last_peered":"2024-05-10T14:05:48.315611+0000","last_clean":"2024-05-10T14:05:48.315611+0000","last_became_active":"2024-05-10T14:05:17.291013+0000","last_became_peered":"2024-05-10T14:05:17.291013+0000","last_unstale":"2024-05-10T14:05:48.315611+0000","last_undegraded":"2024-05-10T14:05:48.315611+0000","last_fullsized":"2024-05-10T14:05:48.315611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:27.227907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663934+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:05:51.663934+0000","last_peered":"2024-05-10T14:05:51.663934+0000","last_clean":"2024-05-10T14:05:51.663934+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:05:51.663934+0000","last_undegraded":"2024-05-10T14:05:51.663934+0000","last_fullsized":"2024-05-10T14:05:51.663934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586597+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:05:48.586597+0000","last_peered":"2024-05-10T14:05:48.586597+0000","last_clean":"2024-05-10T14:05:48.586597+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:05:48.586597+0000","last_undegraded":"2024-05-10T14:05:48.586597+0000","last_fullsized":"2024-05-10T14:05:48.586597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664581+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:05:51.664581+0000","last_peered":"2024-05-10T14:05:51.664581+0000","last_clean":"2024-05-10T14:05:51.664581+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:05:51.664581+0000","last_undegraded":"2024-05-10T14:05:51.664581+0000","last_fullsized":"2024-05-10T14:05:51.664581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339719+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:05:51.339719+0000","last_peered":"2024-05-10T14:05:51.339719+0000","last_clean":"2024-05-10T14:05:51.339719+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:05:51.339719+0000","last_undegraded":"2024-05-10T14:05:51.339719+0000","last_fullsized":"2024-05-10T14:05:51.339719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341931+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:05:51.341931+0000","last_peered":"2024-05-10T14:05:51.341931+0000","last_clean":"2024-05-10T14:05:51.341931+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:05:51.341931+0000","last_undegraded":"2024-05-10T14:05:51.341931+0000","last_fullsized":"2024-05-10T14:05:51.341931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338688+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:05:51.338688+0000","last_peered":"2024-05-10T14:05:51.338688+0000","last_clean":"2024-05-10T14:05:51.338688+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:05:51.338688+0000","last_undegraded":"2024-05-10T14:05:51.338688+0000","last_fullsized":"2024-05-10T14:05:51.338688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338750+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:05:51.338750+0000","last_peered":"2024-05-10T14:05:51.338750+0000","last_clean":"2024-05-10T14:05:51.338750+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:05:51.338750+0000","last_undegraded":"2024-05-10T14:05:51.338750+0000","last_fullsized":"2024-05-10T14:05:51.338750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342998+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:05:51.342998+0000","last_peered":"2024-05-10T14:05:51.342998+0000","last_clean":"2024-05-10T14:05:51.342998+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:05:51.342998+0000","last_undegraded":"2024-05-10T14:05:51.342998+0000","last_fullsized":"2024-05-10T14:05:51.342998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659564+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:05:51.659564+0000","last_peered":"2024-05-10T14:05:51.659564+0000","last_clean":"2024-05-10T14:05:51.659564+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:05:51.659564+0000","last_undegraded":"2024-05-10T14:05:51.659564+0000","last_fullsized":"2024-05-10T14:05:51.659564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339399+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:05:51.339399+0000","last_peered":"2024-05-10T14:05:51.339399+0000","last_clean":"2024-05-10T14:05:51.339399+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:05:51.339399+0000","last_undegraded":"2024-05-10T14:05:51.339399+0000","last_fullsized":"2024-05-10T14:05:51.339399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339678+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:05:51.339678+0000","last_peered":"2024-05-10T14:05:51.339678+0000","last_clean":"2024-05-10T14:05:51.339678+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:05:51.339678+0000","last_undegraded":"2024-05-10T14:05:51.339678+0000","last_fullsized":"2024-05-10T14:05:51.339678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341370+0000","last_change":"2024-05-10T14:05:17.290958+0000","last_active":"2024-05-10T14:05:51.341370+0000","last_peered":"2024-05-10T14:05:51.341370+0000","last_clean":"2024-05-10T14:05:51.341370+0000","last_became_active":"2024-05-10T14:05:17.290101+0000","last_became_peered":"2024-05-10T14:05:17.290101+0000","last_unstale":"2024-05-10T14:05:51.341370+0000","last_undegraded":"2024-05-10T14:05:51.341370+0000","last_fullsized":"2024-05-10T14:05:51.341370+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:27.117104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592019+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:05:48.592019+0000","last_peered":"2024-05-10T14:05:48.592019+0000","last_clean":"2024-05-10T14:05:48.592019+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:05:48.592019+0000","last_undegraded":"2024-05-10T14:05:48.592019+0000","last_fullsized":"2024-05-10T14:05:48.592019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659528+0000","last_change":"2024-05-10T14:05:17.323385+0000","last_active":"2024-05-10T14:05:51.659528+0000","last_peered":"2024-05-10T14:05:51.659528+0000","last_clean":"2024-05-10T14:05:51.659528+0000","last_became_active":"2024-05-10T14:05:17.300528+0000","last_became_peered":"2024-05-10T14:05:17.300528+0000","last_unstale":"2024-05-10T14:05:51.659528+0000","last_undegraded":"2024-05-10T14:05:51.659528+0000","last_fullsized":"2024-05-10T14:05:51.659528+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:52:04.169092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":120,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593847+0000","last_change":"2024-05-10T14:05:17.310099+0000","last_active":"2024-05-10T14:05:48.593847+0000","last_peered":"2024-05-10T14:05:48.593847+0000","last_clean":"2024-05-10T14:05:48.593847+0000","last_became_active":"2024-05-10T14:05:17.308694+0000","last_became_peered":"2024-05-10T14:05:17.308694+0000","last_unstale":"2024-05-10T14:05:48.593847+0000","last_undegraded":"2024-05-10T14:05:48.593847+0000","last_fullsized":"2024-05-10T14:05:48.593847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:10.446308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":103,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584166+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:05:48.584166+0000","last_peered":"2024-05-10T14:05:48.584166+0000","last_clean":"2024-05-10T14:05:48.584166+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:05:48.584166+0000","last_undegraded":"2024-05-10T14:05:48.584166+0000","last_fullsized":"2024-05-10T14:05:48.584166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590576+0000","last_change":"2024-05-10T14:05:17.316524+0000","last_active":"2024-05-10T14:05:48.590576+0000","last_peered":"2024-05-10T14:05:48.590576+0000","last_clean":"2024-05-10T14:05:48.590576+0000","last_became_active":"2024-05-10T14:05:17.315121+0000","last_became_peered":"2024-05-10T14:05:17.315121+0000","last_unstale":"2024-05-10T14:05:48.590576+0000","last_undegraded":"2024-05-10T14:05:48.590576+0000","last_fullsized":"2024-05-10T14:05:48.590576+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:01:20.607843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":142,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315866+0000","last_change":"2024-05-10T14:05:17.289297+0000","last_active":"2024-05-10T14:05:48.315866+0000","last_peered":"2024-05-10T14:05:48.315866+0000","last_clean":"2024-05-10T14:05:48.315866+0000","last_became_active":"2024-05-10T14:05:17.286429+0000","last_became_peered":"2024-05-10T14:05:17.286429+0000","last_unstale":"2024-05-10T14:05:48.315866+0000","last_undegraded":"2024-05-10T14:05:48.315866+0000","last_fullsized":"2024-05-10T14:05:48.315866+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:38.676231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339487+0000","last_change":"2024-05-10T14:05:17.286410+0000","last_active":"2024-05-10T14:05:51.339487+0000","last_peered":"2024-05-10T14:05:51.339487+0000","last_clean":"2024-05-10T14:05:51.339487+0000","last_became_active":"2024-05-10T14:05:17.285957+0000","last_became_peered":"2024-05-10T14:05:17.285957+0000","last_unstale":"2024-05-10T14:05:51.339487+0000","last_undegraded":"2024-05-10T14:05:51.339487+0000","last_fullsized":"2024-05-10T14:05:51.339487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:52:02.150804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342934+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:05:51.342934+0000","last_peered":"2024-05-10T14:05:51.342934+0000","last_clean":"2024-05-10T14:05:51.342934+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:05:51.342934+0000","last_undegraded":"2024-05-10T14:05:51.342934+0000","last_fullsized":"2024-05-10T14:05:51.342934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342380+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:05:51.342380+0000","last_peered":"2024-05-10T14:05:51.342380+0000","last_clean":"2024-05-10T14:05:51.342380+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:05:51.342380+0000","last_undegraded":"2024-05-10T14:05:51.342380+0000","last_fullsized":"2024-05-10T14:05:51.342380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659157+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:05:51.659157+0000","last_peered":"2024-05-10T14:05:51.659157+0000","last_clean":"2024-05-10T14:05:51.659157+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:05:51.659157+0000","last_undegraded":"2024-05-10T14:05:51.659157+0000","last_fullsized":"2024-05-10T14:05:51.659157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660374+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:05:51.660374+0000","last_peered":"2024-05-10T14:05:51.660374+0000","last_clean":"2024-05-10T14:05:51.660374+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:05:51.660374+0000","last_undegraded":"2024-05-10T14:05:51.660374+0000","last_fullsized":"2024-05-10T14:05:51.660374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340508+0000","last_change":"2024-05-10T14:05:17.329005+0000","last_active":"2024-05-10T14:05:51.340508+0000","last_peered":"2024-05-10T14:05:51.340508+0000","last_clean":"2024-05-10T14:05:51.340508+0000","last_became_active":"2024-05-10T14:05:17.328500+0000","last_became_peered":"2024-05-10T14:05:17.328500+0000","last_unstale":"2024-05-10T14:05:51.340508+0000","last_undegraded":"2024-05-10T14:05:51.340508+0000","last_fullsized":"2024-05-10T14:05:51.340508+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:18.918351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339335+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:05:51.339335+0000","last_peered":"2024-05-10T14:05:51.339335+0000","last_clean":"2024-05-10T14:05:51.339335+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:05:51.339335+0000","last_undegraded":"2024-05-10T14:05:51.339335+0000","last_fullsized":"2024-05-10T14:05:51.339335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338384+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:05:51.338384+0000","last_peered":"2024-05-10T14:05:51.338384+0000","last_clean":"2024-05-10T14:05:51.338384+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:05:51.338384+0000","last_undegraded":"2024-05-10T14:05:51.338384+0000","last_fullsized":"2024-05-10T14:05:51.338384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":196,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316448+0000","last_change":"2024-05-10T14:05:17.319512+0000","last_active":"2024-05-10T14:05:48.316448+0000","last_peered":"2024-05-10T14:05:48.316448+0000","last_clean":"2024-05-10T14:05:48.316448+0000","last_became_active":"2024-05-10T14:05:17.294295+0000","last_became_peered":"2024-05-10T14:05:17.294295+0000","last_unstale":"2024-05-10T14:05:48.316448+0000","last_undegraded":"2024-05-10T14:05:48.316448+0000","last_fullsized":"2024-05-10T14:05:48.316448+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:59.079415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340703+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:05:51.340703+0000","last_peered":"2024-05-10T14:05:51.340703+0000","last_clean":"2024-05-10T14:05:51.340703+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:05:51.340703+0000","last_undegraded":"2024-05-10T14:05:51.340703+0000","last_fullsized":"2024-05-10T14:05:51.340703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338718+0000","last_change":"2024-05-10T14:05:17.290164+0000","last_active":"2024-05-10T14:05:51.338718+0000","last_peered":"2024-05-10T14:05:51.338718+0000","last_clean":"2024-05-10T14:05:51.338718+0000","last_became_active":"2024-05-10T14:05:17.286857+0000","last_became_peered":"2024-05-10T14:05:17.286857+0000","last_unstale":"2024-05-10T14:05:51.338718+0000","last_undegraded":"2024-05-10T14:05:51.338718+0000","last_fullsized":"2024-05-10T14:05:51.338718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:11:20.969931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661156+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:05:51.661156+0000","last_peered":"2024-05-10T14:05:51.661156+0000","last_clean":"2024-05-10T14:05:51.661156+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:05:51.661156+0000","last_undegraded":"2024-05-10T14:05:51.661156+0000","last_fullsized":"2024-05-10T14:05:51.661156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592579+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:05:48.592579+0000","last_peered":"2024-05-10T14:05:48.592579+0000","last_clean":"2024-05-10T14:05:48.592579+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:05:48.592579+0000","last_undegraded":"2024-05-10T14:05:48.592579+0000","last_fullsized":"2024-05-10T14:05:48.592579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663809+0000","last_change":"2024-05-10T14:05:17.382411+0000","last_active":"2024-05-10T14:05:51.663809+0000","last_peered":"2024-05-10T14:05:51.663809+0000","last_clean":"2024-05-10T14:05:51.663809+0000","last_became_active":"2024-05-10T14:05:17.331609+0000","last_became_peered":"2024-05-10T14:05:17.331609+0000","last_unstale":"2024-05-10T14:05:51.663809+0000","last_undegraded":"2024-05-10T14:05:51.663809+0000","last_fullsized":"2024-05-10T14:05:51.663809+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:40.242859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339132+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:05:51.339132+0000","last_peered":"2024-05-10T14:05:51.339132+0000","last_clean":"2024-05-10T14:05:51.339132+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:05:51.339132+0000","last_undegraded":"2024-05-10T14:05:51.339132+0000","last_fullsized":"2024-05-10T14:05:51.339132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.585297+0000","last_change":"2024-05-10T14:05:17.329953+0000","last_active":"2024-05-10T14:05:48.585297+0000","last_peered":"2024-05-10T14:05:48.585297+0000","last_clean":"2024-05-10T14:05:48.585297+0000","last_became_active":"2024-05-10T14:05:17.329389+0000","last_became_peered":"2024-05-10T14:05:17.329389+0000","last_unstale":"2024-05-10T14:05:48.585297+0000","last_undegraded":"2024-05-10T14:05:48.585297+0000","last_fullsized":"2024-05-10T14:05:48.585297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:41:52.177733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343497+0000","last_change":"2024-05-10T14:05:17.307196+0000","last_active":"2024-05-10T14:05:51.343497+0000","last_peered":"2024-05-10T14:05:51.343497+0000","last_clean":"2024-05-10T14:05:51.343497+0000","last_became_active":"2024-05-10T14:05:17.300975+0000","last_became_peered":"2024-05-10T14:05:17.300975+0000","last_unstale":"2024-05-10T14:05:51.343497+0000","last_undegraded":"2024-05-10T14:05:51.343497+0000","last_fullsized":"2024-05-10T14:05:51.343497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:54:50.675218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660787+0000","last_change":"2024-05-10T14:05:17.325788+0000","last_active":"2024-05-10T14:05:51.660787+0000","last_peered":"2024-05-10T14:05:51.660787+0000","last_clean":"2024-05-10T14:05:51.660787+0000","last_became_active":"2024-05-10T14:05:17.318528+0000","last_became_peered":"2024-05-10T14:05:17.318528+0000","last_unstale":"2024-05-10T14:05:51.660787+0000","last_undegraded":"2024-05-10T14:05:51.660787+0000","last_fullsized":"2024-05-10T14:05:51.660787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:19.277081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":145,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586730+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:05:48.586730+0000","last_peered":"2024-05-10T14:05:48.586730+0000","last_clean":"2024-05-10T14:05:48.586730+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:05:48.586730+0000","last_undegraded":"2024-05-10T14:05:48.586730+0000","last_fullsized":"2024-05-10T14:05:48.586730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":178,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316571+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:05:48.316571+0000","last_peered":"2024-05-10T14:05:48.316571+0000","last_clean":"2024-05-10T14:05:48.316571+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:05:48.316571+0000","last_undegraded":"2024-05-10T14:05:48.316571+0000","last_fullsized":"2024-05-10T14:05:48.316571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592060+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:05:48.592060+0000","last_peered":"2024-05-10T14:05:48.592060+0000","last_clean":"2024-05-10T14:05:48.592060+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:05:48.592060+0000","last_undegraded":"2024-05-10T14:05:48.592060+0000","last_fullsized":"2024-05-10T14:05:48.592060+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340761+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:05:51.340761+0000","last_peered":"2024-05-10T14:05:51.340761+0000","last_clean":"2024-05-10T14:05:51.340761+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:05:51.340761+0000","last_undegraded":"2024-05-10T14:05:51.340761+0000","last_fullsized":"2024-05-10T14:05:51.340761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343502+0000","last_change":"2024-05-10T14:05:17.307271+0000","last_active":"2024-05-10T14:05:51.343502+0000","last_peered":"2024-05-10T14:05:51.343502+0000","last_clean":"2024-05-10T14:05:51.343502+0000","last_became_active":"2024-05-10T14:05:17.300871+0000","last_became_peered":"2024-05-10T14:05:17.300871+0000","last_unstale":"2024-05-10T14:05:51.343502+0000","last_undegraded":"2024-05-10T14:05:51.343502+0000","last_fullsized":"2024-05-10T14:05:51.343502+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:48.902158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337963+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:05:51.337963+0000","last_peered":"2024-05-10T14:05:51.337963+0000","last_clean":"2024-05-10T14:05:51.337963+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:05:51.337963+0000","last_undegraded":"2024-05-10T14:05:51.337963+0000","last_fullsized":"2024-05-10T14:05:51.337963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340254+0000","last_change":"2024-05-10T14:05:17.304071+0000","last_active":"2024-05-10T14:05:51.340254+0000","last_peered":"2024-05-10T14:05:51.340254+0000","last_clean":"2024-05-10T14:05:51.340254+0000","last_became_active":"2024-05-10T14:05:17.293002+0000","last_became_peered":"2024-05-10T14:05:17.293002+0000","last_unstale":"2024-05-10T14:05:51.340254+0000","last_undegraded":"2024-05-10T14:05:51.340254+0000","last_fullsized":"2024-05-10T14:05:51.340254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:34.033853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337726+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:05:51.337726+0000","last_peered":"2024-05-10T14:05:51.337726+0000","last_clean":"2024-05-10T14:05:51.337726+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:05:51.337726+0000","last_undegraded":"2024-05-10T14:05:51.337726+0000","last_fullsized":"2024-05-10T14:05:51.337726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661106+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:05:51.661106+0000","last_peered":"2024-05-10T14:05:51.661106+0000","last_clean":"2024-05-10T14:05:51.661106+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:05:51.661106+0000","last_undegraded":"2024-05-10T14:05:51.661106+0000","last_fullsized":"2024-05-10T14:05:51.661106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661000+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:05:51.661000+0000","last_peered":"2024-05-10T14:05:51.661000+0000","last_clean":"2024-05-10T14:05:51.661000+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:05:51.661000+0000","last_undegraded":"2024-05-10T14:05:51.661000+0000","last_fullsized":"2024-05-10T14:05:51.661000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591002+0000","last_change":"2024-05-10T14:05:17.336003+0000","last_active":"2024-05-10T14:05:48.591002+0000","last_peered":"2024-05-10T14:05:48.591002+0000","last_clean":"2024-05-10T14:05:48.591002+0000","last_became_active":"2024-05-10T14:05:17.335538+0000","last_became_peered":"2024-05-10T14:05:17.335538+0000","last_unstale":"2024-05-10T14:05:48.591002+0000","last_undegraded":"2024-05-10T14:05:48.591002+0000","last_fullsized":"2024-05-10T14:05:48.591002+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:34.119071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340062+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:05:51.340062+0000","last_peered":"2024-05-10T14:05:51.340062+0000","last_clean":"2024-05-10T14:05:51.340062+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:05:51.340062+0000","last_undegraded":"2024-05-10T14:05:51.340062+0000","last_fullsized":"2024-05-10T14:05:51.340062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":99,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337865+0000","last_change":"2024-05-10T14:05:17.314577+0000","last_active":"2024-05-10T14:05:51.337865+0000","last_peered":"2024-05-10T14:05:51.337865+0000","last_clean":"2024-05-10T14:05:51.337865+0000","last_became_active":"2024-05-10T14:05:17.296146+0000","last_became_peered":"2024-05-10T14:05:17.296146+0000","last_unstale":"2024-05-10T14:05:51.337865+0000","last_undegraded":"2024-05-10T14:05:51.337865+0000","last_fullsized":"2024-05-10T14:05:51.337865+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:16.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658497+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:05:51.658497+0000","last_peered":"2024-05-10T14:05:51.658497+0000","last_clean":"2024-05-10T14:05:51.658497+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:05:51.658497+0000","last_undegraded":"2024-05-10T14:05:51.658497+0000","last_fullsized":"2024-05-10T14:05:51.658497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659814+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:05:51.659814+0000","last_peered":"2024-05-10T14:05:51.659814+0000","last_clean":"2024-05-10T14:05:51.659814+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:05:51.659814+0000","last_undegraded":"2024-05-10T14:05:51.659814+0000","last_fullsized":"2024-05-10T14:05:51.659814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660051+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:05:51.660051+0000","last_peered":"2024-05-10T14:05:51.660051+0000","last_clean":"2024-05-10T14:05:51.660051+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:05:51.660051+0000","last_undegraded":"2024-05-10T14:05:51.660051+0000","last_fullsized":"2024-05-10T14:05:51.660051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590546+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:05:48.590546+0000","last_peered":"2024-05-10T14:05:48.590546+0000","last_clean":"2024-05-10T14:05:48.590546+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:05:48.590546+0000","last_undegraded":"2024-05-10T14:05:48.590546+0000","last_fullsized":"2024-05-10T14:05:48.590546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339148+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:05:51.339148+0000","last_peered":"2024-05-10T14:05:51.339148+0000","last_clean":"2024-05-10T14:05:51.339148+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:05:51.339148+0000","last_undegraded":"2024-05-10T14:05:51.339148+0000","last_fullsized":"2024-05-10T14:05:51.339148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658828+0000","last_change":"2024-05-10T14:05:17.316461+0000","last_active":"2024-05-10T14:05:51.658828+0000","last_peered":"2024-05-10T14:05:51.658828+0000","last_clean":"2024-05-10T14:05:51.658828+0000","last_became_active":"2024-05-10T14:05:17.291102+0000","last_became_peered":"2024-05-10T14:05:17.291102+0000","last_unstale":"2024-05-10T14:05:51.658828+0000","last_undegraded":"2024-05-10T14:05:51.658828+0000","last_fullsized":"2024-05-10T14:05:51.658828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:36.011027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337755+0000","last_change":"2024-05-10T14:05:17.286796+0000","last_active":"2024-05-10T14:05:51.337755+0000","last_peered":"2024-05-10T14:05:51.337755+0000","last_clean":"2024-05-10T14:05:51.337755+0000","last_became_active":"2024-05-10T14:05:17.286392+0000","last_became_peered":"2024-05-10T14:05:17.286392+0000","last_unstale":"2024-05-10T14:05:51.337755+0000","last_undegraded":"2024-05-10T14:05:51.337755+0000","last_fullsized":"2024-05-10T14:05:51.337755+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:53.061423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":169,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317260+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:05:48.317260+0000","last_peered":"2024-05-10T14:05:48.317260+0000","last_clean":"2024-05-10T14:05:48.317260+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:05:48.317260+0000","last_undegraded":"2024-05-10T14:05:48.317260+0000","last_fullsized":"2024-05-10T14:05:48.317260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343743+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:05:51.343743+0000","last_peered":"2024-05-10T14:05:51.343743+0000","last_clean":"2024-05-10T14:05:51.343743+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:05:51.343743+0000","last_undegraded":"2024-05-10T14:05:51.343743+0000","last_fullsized":"2024-05-10T14:05:51.343743+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338435+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:05:51.338435+0000","last_peered":"2024-05-10T14:05:51.338435+0000","last_clean":"2024-05-10T14:05:51.338435+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:05:51.338435+0000","last_undegraded":"2024-05-10T14:05:51.338435+0000","last_fullsized":"2024-05-10T14:05:51.338435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340475+0000","last_change":"2024-05-10T14:05:17.317624+0000","last_active":"2024-05-10T14:05:51.340475+0000","last_peered":"2024-05-10T14:05:51.340475+0000","last_clean":"2024-05-10T14:05:51.340475+0000","last_became_active":"2024-05-10T14:05:17.317305+0000","last_became_peered":"2024-05-10T14:05:17.317305+0000","last_unstale":"2024-05-10T14:05:51.340475+0000","last_undegraded":"2024-05-10T14:05:51.340475+0000","last_fullsized":"2024-05-10T14:05:51.340475+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:43.831375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342666+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:05:51.342666+0000","last_peered":"2024-05-10T14:05:51.342666+0000","last_clean":"2024-05-10T14:05:51.342666+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:05:51.342666+0000","last_undegraded":"2024-05-10T14:05:51.342666+0000","last_fullsized":"2024-05-10T14:05:51.342666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660057+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:05:51.660057+0000","last_peered":"2024-05-10T14:05:51.660057+0000","last_clean":"2024-05-10T14:05:51.660057+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:05:51.660057+0000","last_undegraded":"2024-05-10T14:05:51.660057+0000","last_fullsized":"2024-05-10T14:05:51.660057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338014+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:05:51.338014+0000","last_peered":"2024-05-10T14:05:51.338014+0000","last_clean":"2024-05-10T14:05:51.338014+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:05:51.338014+0000","last_undegraded":"2024-05-10T14:05:51.338014+0000","last_fullsized":"2024-05-10T14:05:51.338014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343439+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:05:51.343439+0000","last_peered":"2024-05-10T14:05:51.343439+0000","last_clean":"2024-05-10T14:05:51.343439+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:05:51.343439+0000","last_undegraded":"2024-05-10T14:05:51.343439+0000","last_fullsized":"2024-05-10T14:05:51.343439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661279+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:05:51.661279+0000","last_peered":"2024-05-10T14:05:51.661279+0000","last_clean":"2024-05-10T14:05:51.661279+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:05:51.661279+0000","last_undegraded":"2024-05-10T14:05:51.661279+0000","last_fullsized":"2024-05-10T14:05:51.661279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316155+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:05:48.316155+0000","last_peered":"2024-05-10T14:05:48.316155+0000","last_clean":"2024-05-10T14:05:48.316155+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:05:48.316155+0000","last_undegraded":"2024-05-10T14:05:48.316155+0000","last_fullsized":"2024-05-10T14:05:48.316155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341117+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:05:51.341117+0000","last_peered":"2024-05-10T14:05:51.341117+0000","last_clean":"2024-05-10T14:05:51.341117+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:05:51.341117+0000","last_undegraded":"2024-05-10T14:05:51.341117+0000","last_fullsized":"2024-05-10T14:05:51.341117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337871+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:05:51.337871+0000","last_peered":"2024-05-10T14:05:51.337871+0000","last_clean":"2024-05-10T14:05:51.337871+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:05:51.337871+0000","last_undegraded":"2024-05-10T14:05:51.337871+0000","last_fullsized":"2024-05-10T14:05:51.337871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315964+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:05:48.315964+0000","last_peered":"2024-05-10T14:05:48.315964+0000","last_clean":"2024-05-10T14:05:48.315964+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:05:48.315964+0000","last_undegraded":"2024-05-10T14:05:48.315964+0000","last_fullsized":"2024-05-10T14:05:48.315964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343219+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:05:51.343219+0000","last_peered":"2024-05-10T14:05:51.343219+0000","last_clean":"2024-05-10T14:05:51.343219+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:05:51.343219+0000","last_undegraded":"2024-05-10T14:05:51.343219+0000","last_fullsized":"2024-05-10T14:05:51.343219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339808+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:05:51.339808+0000","last_peered":"2024-05-10T14:05:51.339808+0000","last_clean":"2024-05-10T14:05:51.339808+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:05:51.339808+0000","last_undegraded":"2024-05-10T14:05:51.339808+0000","last_fullsized":"2024-05-10T14:05:51.339808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":128,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.594071+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:05:48.594071+0000","last_peered":"2024-05-10T14:05:48.594071+0000","last_clean":"2024-05-10T14:05:48.594071+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:05:48.594071+0000","last_undegraded":"2024-05-10T14:05:48.594071+0000","last_fullsized":"2024-05-10T14:05:48.594071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339181+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:05:51.339181+0000","last_peered":"2024-05-10T14:05:51.339181+0000","last_clean":"2024-05-10T14:05:51.339181+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:05:51.339181+0000","last_undegraded":"2024-05-10T14:05:51.339181+0000","last_fullsized":"2024-05-10T14:05:51.339181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663753+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:05:51.663753+0000","last_peered":"2024-05-10T14:05:51.663753+0000","last_clean":"2024-05-10T14:05:51.663753+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:05:51.663753+0000","last_undegraded":"2024-05-10T14:05:51.663753+0000","last_fullsized":"2024-05-10T14:05:51.663753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341496+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:05:51.341496+0000","last_peered":"2024-05-10T14:05:51.341496+0000","last_clean":"2024-05-10T14:05:51.341496+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:05:51.341496+0000","last_undegraded":"2024-05-10T14:05:51.341496+0000","last_fullsized":"2024-05-10T14:05:51.341496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317581+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:05:48.317581+0000","last_peered":"2024-05-10T14:05:48.317581+0000","last_clean":"2024-05-10T14:05:48.317581+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:05:48.317581+0000","last_undegraded":"2024-05-10T14:05:48.317581+0000","last_fullsized":"2024-05-10T14:05:48.317581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337139+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:05:51.337139+0000","last_peered":"2024-05-10T14:05:51.337139+0000","last_clean":"2024-05-10T14:05:51.337139+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:05:51.337139+0000","last_undegraded":"2024-05-10T14:05:51.337139+0000","last_fullsized":"2024-05-10T14:05:51.337139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342957+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:05:51.342957+0000","last_peered":"2024-05-10T14:05:51.342957+0000","last_clean":"2024-05-10T14:05:51.342957+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:05:51.342957+0000","last_undegraded":"2024-05-10T14:05:51.342957+0000","last_fullsized":"2024-05-10T14:05:51.342957+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":142,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592376+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:05:48.592376+0000","last_peered":"2024-05-10T14:05:48.592376+0000","last_clean":"2024-05-10T14:05:48.592376+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:05:48.592376+0000","last_undegraded":"2024-05-10T14:05:48.592376+0000","last_fullsized":"2024-05-10T14:05:48.592376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663631+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:05:51.663631+0000","last_peered":"2024-05-10T14:05:51.663631+0000","last_clean":"2024-05-10T14:05:51.663631+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:05:51.663631+0000","last_undegraded":"2024-05-10T14:05:51.663631+0000","last_fullsized":"2024-05-10T14:05:51.663631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":174,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315837+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:05:48.315837+0000","last_peered":"2024-05-10T14:05:48.315837+0000","last_clean":"2024-05-10T14:05:48.315837+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:05:48.315837+0000","last_undegraded":"2024-05-10T14:05:48.315837+0000","last_fullsized":"2024-05-10T14:05:48.315837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664342+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:05:51.664342+0000","last_peered":"2024-05-10T14:05:51.664342+0000","last_clean":"2024-05-10T14:05:51.664342+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:05:51.664342+0000","last_undegraded":"2024-05-10T14:05:51.664342+0000","last_fullsized":"2024-05-10T14:05:51.664342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658264+0000","last_change":"2024-05-10T14:05:17.354857+0000","last_active":"2024-05-10T14:05:51.658264+0000","last_peered":"2024-05-10T14:05:51.658264+0000","last_clean":"2024-05-10T14:05:51.658264+0000","last_became_active":"2024-05-10T14:05:17.320795+0000","last_became_peered":"2024-05-10T14:05:17.320795+0000","last_unstale":"2024-05-10T14:05:51.658264+0000","last_undegraded":"2024-05-10T14:05:51.658264+0000","last_fullsized":"2024-05-10T14:05:51.658264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:11:07.864891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586343+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:05:48.586343+0000","last_peered":"2024-05-10T14:05:48.586343+0000","last_clean":"2024-05-10T14:05:48.586343+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:05:48.586343+0000","last_undegraded":"2024-05-10T14:05:48.586343+0000","last_fullsized":"2024-05-10T14:05:48.586343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338151+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:05:51.338151+0000","last_peered":"2024-05-10T14:05:51.338151+0000","last_clean":"2024-05-10T14:05:51.338151+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:05:51.338151+0000","last_undegraded":"2024-05-10T14:05:51.338151+0000","last_fullsized":"2024-05-10T14:05:51.338151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338486+0000","last_change":"2024-05-10T14:05:17.313576+0000","last_active":"2024-05-10T14:05:51.338486+0000","last_peered":"2024-05-10T14:05:51.338486+0000","last_clean":"2024-05-10T14:05:51.338486+0000","last_became_active":"2024-05-10T14:05:17.313245+0000","last_became_peered":"2024-05-10T14:05:17.313245+0000","last_unstale":"2024-05-10T14:05:51.338486+0000","last_undegraded":"2024-05-10T14:05:51.338486+0000","last_fullsized":"2024-05-10T14:05:51.338486+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:22.410591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593386+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:05:48.593386+0000","last_peered":"2024-05-10T14:05:48.593386+0000","last_clean":"2024-05-10T14:05:48.593386+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:05:48.593386+0000","last_undegraded":"2024-05-10T14:05:48.593386+0000","last_fullsized":"2024-05-10T14:05:48.593386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659998+0000","last_change":"2024-05-10T14:05:17.299690+0000","last_active":"2024-05-10T14:05:51.659998+0000","last_peered":"2024-05-10T14:05:51.659998+0000","last_clean":"2024-05-10T14:05:51.659998+0000","last_became_active":"2024-05-10T14:05:17.299332+0000","last_became_peered":"2024-05-10T14:05:17.299332+0000","last_unstale":"2024-05-10T14:05:51.659998+0000","last_undegraded":"2024-05-10T14:05:51.659998+0000","last_fullsized":"2024-05-10T14:05:51.659998+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:32.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659964+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:05:51.659964+0000","last_peered":"2024-05-10T14:05:51.659964+0000","last_clean":"2024-05-10T14:05:51.659964+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:05:51.659964+0000","last_undegraded":"2024-05-10T14:05:51.659964+0000","last_fullsized":"2024-05-10T14:05:51.659964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660226+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:05:51.660226+0000","last_peered":"2024-05-10T14:05:51.660226+0000","last_clean":"2024-05-10T14:05:51.660226+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:05:51.660226+0000","last_undegraded":"2024-05-10T14:05:51.660226+0000","last_fullsized":"2024-05-10T14:05:51.660226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315201+0000","last_change":"2024-05-10T14:05:17.289458+0000","last_active":"2024-05-10T14:05:48.315201+0000","last_peered":"2024-05-10T14:05:48.315201+0000","last_clean":"2024-05-10T14:05:48.315201+0000","last_became_active":"2024-05-10T14:05:17.289122+0000","last_became_peered":"2024-05-10T14:05:17.289122+0000","last_unstale":"2024-05-10T14:05:48.315201+0000","last_undegraded":"2024-05-10T14:05:48.315201+0000","last_fullsized":"2024-05-10T14:05:48.315201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:46.862871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658936+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:05:51.658936+0000","last_peered":"2024-05-10T14:05:51.658936+0000","last_clean":"2024-05-10T14:05:51.658936+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:05:51.658936+0000","last_undegraded":"2024-05-10T14:05:51.658936+0000","last_fullsized":"2024-05-10T14:05:51.658936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593577+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:05:48.593577+0000","last_peered":"2024-05-10T14:05:48.593577+0000","last_clean":"2024-05-10T14:05:48.593577+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:05:48.593577+0000","last_undegraded":"2024-05-10T14:05:48.593577+0000","last_fullsized":"2024-05-10T14:05:48.593577+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":262,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316099+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:05:48.316099+0000","last_peered":"2024-05-10T14:05:48.316099+0000","last_clean":"2024-05-10T14:05:48.316099+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:05:48.316099+0000","last_undegraded":"2024-05-10T14:05:48.316099+0000","last_fullsized":"2024-05-10T14:05:48.316099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340617+0000","last_change":"2024-05-10T14:05:17.288435+0000","last_active":"2024-05-10T14:05:51.340617+0000","last_peered":"2024-05-10T14:05:51.340617+0000","last_clean":"2024-05-10T14:05:51.340617+0000","last_became_active":"2024-05-10T14:05:17.287979+0000","last_became_peered":"2024-05-10T14:05:17.287979+0000","last_unstale":"2024-05-10T14:05:51.340617+0000","last_undegraded":"2024-05-10T14:05:51.340617+0000","last_fullsized":"2024-05-10T14:05:51.340617+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315837+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:05:48.315837+0000","last_peered":"2024-05-10T14:05:48.315837+0000","last_clean":"2024-05-10T14:05:48.315837+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:05:48.315837+0000","last_undegraded":"2024-05-10T14:05:48.315837+0000","last_fullsized":"2024-05-10T14:05:48.315837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":192,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317674+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:05:48.317674+0000","last_peered":"2024-05-10T14:05:48.317674+0000","last_clean":"2024-05-10T14:05:48.317674+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:05:48.317674+0000","last_undegraded":"2024-05-10T14:05:48.317674+0000","last_fullsized":"2024-05-10T14:05:48.317674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338666+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:05:51.338666+0000","last_peered":"2024-05-10T14:05:51.338666+0000","last_clean":"2024-05-10T14:05:51.338666+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:05:51.338666+0000","last_undegraded":"2024-05-10T14:05:51.338666+0000","last_fullsized":"2024-05-10T14:05:51.338666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315224+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:05:48.315224+0000","last_peered":"2024-05-10T14:05:48.315224+0000","last_clean":"2024-05-10T14:05:48.315224+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:05:48.315224+0000","last_undegraded":"2024-05-10T14:05:48.315224+0000","last_fullsized":"2024-05-10T14:05:48.315224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338033+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:05:51.338033+0000","last_peered":"2024-05-10T14:05:51.338033+0000","last_clean":"2024-05-10T14:05:51.338033+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:05:51.338033+0000","last_undegraded":"2024-05-10T14:05:51.338033+0000","last_fullsized":"2024-05-10T14:05:51.338033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664108+0000","last_change":"2024-05-10T14:05:17.370707+0000","last_active":"2024-05-10T14:05:51.664108+0000","last_peered":"2024-05-10T14:05:51.664108+0000","last_clean":"2024-05-10T14:05:51.664108+0000","last_became_active":"2024-05-10T14:05:17.328233+0000","last_became_peered":"2024-05-10T14:05:17.328233+0000","last_unstale":"2024-05-10T14:05:51.664108+0000","last_undegraded":"2024-05-10T14:05:51.664108+0000","last_fullsized":"2024-05-10T14:05:51.664108+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:04:11.721159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659359+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:05:51.659359+0000","last_peered":"2024-05-10T14:05:51.659359+0000","last_clean":"2024-05-10T14:05:51.659359+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:05:51.659359+0000","last_undegraded":"2024-05-10T14:05:51.659359+0000","last_fullsized":"2024-05-10T14:05:51.659359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338940+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:05:51.338940+0000","last_peered":"2024-05-10T14:05:51.338940+0000","last_clean":"2024-05-10T14:05:51.338940+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:05:51.338940+0000","last_undegraded":"2024-05-10T14:05:51.338940+0000","last_fullsized":"2024-05-10T14:05:51.338940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316440+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:05:48.316440+0000","last_peered":"2024-05-10T14:05:48.316440+0000","last_clean":"2024-05-10T14:05:48.316440+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:05:48.316440+0000","last_undegraded":"2024-05-10T14:05:48.316440+0000","last_fullsized":"2024-05-10T14:05:48.316440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584279+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:05:48.584279+0000","last_peered":"2024-05-10T14:05:48.584279+0000","last_clean":"2024-05-10T14:05:48.584279+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:05:48.584279+0000","last_undegraded":"2024-05-10T14:05:48.584279+0000","last_fullsized":"2024-05-10T14:05:48.584279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341641+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:05:51.341641+0000","last_peered":"2024-05-10T14:05:51.341641+0000","last_clean":"2024-05-10T14:05:51.341641+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:05:51.341641+0000","last_undegraded":"2024-05-10T14:05:51.341641+0000","last_fullsized":"2024-05-10T14:05:51.341641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659805+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:05:51.659805+0000","last_peered":"2024-05-10T14:05:51.659805+0000","last_clean":"2024-05-10T14:05:51.659805+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:05:51.659805+0000","last_undegraded":"2024-05-10T14:05:51.659805+0000","last_fullsized":"2024-05-10T14:05:51.659805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340834+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:05:51.340834+0000","last_peered":"2024-05-10T14:05:51.340834+0000","last_clean":"2024-05-10T14:05:51.340834+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:05:51.340834+0000","last_undegraded":"2024-05-10T14:05:51.340834+0000","last_fullsized":"2024-05-10T14:05:51.340834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664549+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:05:51.664549+0000","last_peered":"2024-05-10T14:05:51.664549+0000","last_clean":"2024-05-10T14:05:51.664549+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:05:51.664549+0000","last_undegraded":"2024-05-10T14:05:51.664549+0000","last_fullsized":"2024-05-10T14:05:51.664549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589776+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:05:48.589776+0000","last_peered":"2024-05-10T14:05:48.589776+0000","last_clean":"2024-05-10T14:05:48.589776+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:05:48.589776+0000","last_undegraded":"2024-05-10T14:05:48.589776+0000","last_fullsized":"2024-05-10T14:05:48.589776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":192,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316710+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:05:48.316710+0000","last_peered":"2024-05-10T14:05:48.316710+0000","last_clean":"2024-05-10T14:05:48.316710+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:05:48.316710+0000","last_undegraded":"2024-05-10T14:05:48.316710+0000","last_fullsized":"2024-05-10T14:05:48.316710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340376+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:05:51.340376+0000","last_peered":"2024-05-10T14:05:51.340376+0000","last_clean":"2024-05-10T14:05:51.340376+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:05:51.340376+0000","last_undegraded":"2024-05-10T14:05:51.340376+0000","last_fullsized":"2024-05-10T14:05:51.340376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316775+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:05:48.316775+0000","last_peered":"2024-05-10T14:05:48.316775+0000","last_clean":"2024-05-10T14:05:48.316775+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:05:48.316775+0000","last_undegraded":"2024-05-10T14:05:48.316775+0000","last_fullsized":"2024-05-10T14:05:48.316775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659611+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:05:51.659611+0000","last_peered":"2024-05-10T14:05:51.659611+0000","last_clean":"2024-05-10T14:05:51.659611+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:05:51.659611+0000","last_undegraded":"2024-05-10T14:05:51.659611+0000","last_fullsized":"2024-05-10T14:05:51.659611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658029+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:05:51.658029+0000","last_peered":"2024-05-10T14:05:51.658029+0000","last_clean":"2024-05-10T14:05:51.658029+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:05:51.658029+0000","last_undegraded":"2024-05-10T14:05:51.658029+0000","last_fullsized":"2024-05-10T14:05:51.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341429+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:05:51.341429+0000","last_peered":"2024-05-10T14:05:51.341429+0000","last_clean":"2024-05-10T14:05:51.341429+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:05:51.341429+0000","last_undegraded":"2024-05-10T14:05:51.341429+0000","last_fullsized":"2024-05-10T14:05:51.341429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659356+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:05:51.659356+0000","last_peered":"2024-05-10T14:05:51.659356+0000","last_clean":"2024-05-10T14:05:51.659356+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:05:51.659356+0000","last_undegraded":"2024-05-10T14:05:51.659356+0000","last_fullsized":"2024-05-10T14:05:51.659356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659938+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:05:51.659938+0000","last_peered":"2024-05-10T14:05:51.659938+0000","last_clean":"2024-05-10T14:05:51.659938+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:05:51.659938+0000","last_undegraded":"2024-05-10T14:05:51.659938+0000","last_fullsized":"2024-05-10T14:05:51.659938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316560+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:05:48.316560+0000","last_peered":"2024-05-10T14:05:48.316560+0000","last_clean":"2024-05-10T14:05:48.316560+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:05:48.316560+0000","last_undegraded":"2024-05-10T14:05:48.316560+0000","last_fullsized":"2024-05-10T14:05:48.316560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660026+0000","last_change":"2024-05-10T14:05:17.305129+0000","last_active":"2024-05-10T14:05:51.660026+0000","last_peered":"2024-05-10T14:05:51.660026+0000","last_clean":"2024-05-10T14:05:51.660026+0000","last_became_active":"2024-05-10T14:05:17.304295+0000","last_became_peered":"2024-05-10T14:05:17.304295+0000","last_unstale":"2024-05-10T14:05:51.660026+0000","last_undegraded":"2024-05-10T14:05:51.660026+0000","last_fullsized":"2024-05-10T14:05:51.660026+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:58.234019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660534+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:05:51.660534+0000","last_peered":"2024-05-10T14:05:51.660534+0000","last_clean":"2024-05-10T14:05:51.660534+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:05:51.660534+0000","last_undegraded":"2024-05-10T14:05:51.660534+0000","last_fullsized":"2024-05-10T14:05:51.660534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":196,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.314975+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:05:48.314975+0000","last_peered":"2024-05-10T14:05:48.314975+0000","last_clean":"2024-05-10T14:05:48.314975+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:05:48.314975+0000","last_undegraded":"2024-05-10T14:05:48.314975+0000","last_fullsized":"2024-05-10T14:05:48.314975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":119,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588463+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:05:48.588463+0000","last_peered":"2024-05-10T14:05:48.588463+0000","last_clean":"2024-05-10T14:05:48.588463+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:05:48.588463+0000","last_undegraded":"2024-05-10T14:05:48.588463+0000","last_fullsized":"2024-05-10T14:05:48.588463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338902+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:05:51.338902+0000","last_peered":"2024-05-10T14:05:51.338902+0000","last_clean":"2024-05-10T14:05:51.338902+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:05:51.338902+0000","last_undegraded":"2024-05-10T14:05:51.338902+0000","last_fullsized":"2024-05-10T14:05:51.338902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337582+0000","last_change":"2024-05-10T14:05:17.294354+0000","last_active":"2024-05-10T14:05:51.337582+0000","last_peered":"2024-05-10T14:05:51.337582+0000","last_clean":"2024-05-10T14:05:51.337582+0000","last_became_active":"2024-05-10T14:05:17.293930+0000","last_became_peered":"2024-05-10T14:05:17.293930+0000","last_unstale":"2024-05-10T14:05:51.337582+0000","last_undegraded":"2024-05-10T14:05:51.337582+0000","last_fullsized":"2024-05-10T14:05:51.337582+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:28.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338568+0000","last_change":"2024-05-10T14:05:17.293374+0000","last_active":"2024-05-10T14:05:51.338568+0000","last_peered":"2024-05-10T14:05:51.338568+0000","last_clean":"2024-05-10T14:05:51.338568+0000","last_became_active":"2024-05-10T14:05:17.293062+0000","last_became_peered":"2024-05-10T14:05:17.293062+0000","last_unstale":"2024-05-10T14:05:51.338568+0000","last_undegraded":"2024-05-10T14:05:51.338568+0000","last_fullsized":"2024-05-10T14:05:51.338568+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:21.545080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.318060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:05:48.318060+0000","last_peered":"2024-05-10T14:05:48.318060+0000","last_clean":"2024-05-10T14:05:48.318060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:05:48.318060+0000","last_undegraded":"2024-05-10T14:05:48.318060+0000","last_fullsized":"2024-05-10T14:05:48.318060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341050+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:05:51.341050+0000","last_peered":"2024-05-10T14:05:51.341050+0000","last_clean":"2024-05-10T14:05:51.341050+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:05:51.341050+0000","last_undegraded":"2024-05-10T14:05:51.341050+0000","last_fullsized":"2024-05-10T14:05:51.341050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341302+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:05:51.341302+0000","last_peered":"2024-05-10T14:05:51.341302+0000","last_clean":"2024-05-10T14:05:51.341302+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:05:51.341302+0000","last_undegraded":"2024-05-10T14:05:51.341302+0000","last_fullsized":"2024-05-10T14:05:51.341302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340710+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:05:51.340710+0000","last_peered":"2024-05-10T14:05:51.340710+0000","last_clean":"2024-05-10T14:05:51.340710+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:05:51.340710+0000","last_undegraded":"2024-05-10T14:05:51.340710+0000","last_fullsized":"2024-05-10T14:05:51.340710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659464+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:05:51.659464+0000","last_peered":"2024-05-10T14:05:51.659464+0000","last_clean":"2024-05-10T14:05:51.659464+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:05:51.659464+0000","last_undegraded":"2024-05-10T14:05:51.659464+0000","last_fullsized":"2024-05-10T14:05:51.659464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340208+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:05:51.340208+0000","last_peered":"2024-05-10T14:05:51.340208+0000","last_clean":"2024-05-10T14:05:51.340208+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:05:51.340208+0000","last_undegraded":"2024-05-10T14:05:51.340208+0000","last_fullsized":"2024-05-10T14:05:51.340208+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660492+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:05:51.660492+0000","last_peered":"2024-05-10T14:05:51.660492+0000","last_clean":"2024-05-10T14:05:51.660492+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:05:51.660492+0000","last_undegraded":"2024-05-10T14:05:51.660492+0000","last_fullsized":"2024-05-10T14:05:51.660492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665396+0000","last_change":"2024-05-10T14:05:17.325615+0000","last_active":"2024-05-10T14:05:51.665396+0000","last_peered":"2024-05-10T14:05:51.665396+0000","last_clean":"2024-05-10T14:05:51.665396+0000","last_became_active":"2024-05-10T14:05:17.318529+0000","last_became_peered":"2024-05-10T14:05:17.318529+0000","last_unstale":"2024-05-10T14:05:51.665396+0000","last_undegraded":"2024-05-10T14:05:51.665396+0000","last_fullsized":"2024-05-10T14:05:51.665396+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:36.085486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337766+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:05:51.337766+0000","last_peered":"2024-05-10T14:05:51.337766+0000","last_clean":"2024-05-10T14:05:51.337766+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:05:51.337766+0000","last_undegraded":"2024-05-10T14:05:51.337766+0000","last_fullsized":"2024-05-10T14:05:51.337766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":112,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661590+0000","last_change":"2024-05-10T14:05:17.358122+0000","last_active":"2024-05-10T14:05:51.661590+0000","last_peered":"2024-05-10T14:05:51.661590+0000","last_clean":"2024-05-10T14:05:51.661590+0000","last_became_active":"2024-05-10T14:05:17.318464+0000","last_became_peered":"2024-05-10T14:05:17.318464+0000","last_unstale":"2024-05-10T14:05:51.661590+0000","last_undegraded":"2024-05-10T14:05:51.661590+0000","last_fullsized":"2024-05-10T14:05:51.661590+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:30:24.279780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337826+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:05:51.337826+0000","last_peered":"2024-05-10T14:05:51.337826+0000","last_clean":"2024-05-10T14:05:51.337826+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:05:51.337826+0000","last_undegraded":"2024-05-10T14:05:51.337826+0000","last_fullsized":"2024-05-10T14:05:51.337826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":115,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591978+0000","last_change":"2024-05-10T14:05:17.361139+0000","last_active":"2024-05-10T14:05:48.591978+0000","last_peered":"2024-05-10T14:05:48.591978+0000","last_clean":"2024-05-10T14:05:48.591978+0000","last_became_active":"2024-05-10T14:05:17.298778+0000","last_became_peered":"2024-05-10T14:05:17.298778+0000","last_unstale":"2024-05-10T14:05:48.591978+0000","last_undegraded":"2024-05-10T14:05:48.591978+0000","last_fullsized":"2024-05-10T14:05:48.591978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:06.452122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":406,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659744+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:05:51.659744+0000","last_peered":"2024-05-10T14:05:51.659744+0000","last_clean":"2024-05-10T14:05:51.659744+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:05:51.659744+0000","last_undegraded":"2024-05-10T14:05:51.659744+0000","last_fullsized":"2024-05-10T14:05:51.659744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341102+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:05:51.341102+0000","last_peered":"2024-05-10T14:05:51.341102+0000","last_clean":"2024-05-10T14:05:51.341102+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:05:51.341102+0000","last_undegraded":"2024-05-10T14:05:51.341102+0000","last_fullsized":"2024-05-10T14:05:51.341102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341731+0000","last_change":"2024-05-10T14:05:17.382896+0000","last_active":"2024-05-10T14:05:51.341731+0000","last_peered":"2024-05-10T14:05:51.341731+0000","last_clean":"2024-05-10T14:05:51.341731+0000","last_became_active":"2024-05-10T14:05:17.328643+0000","last_became_peered":"2024-05-10T14:05:17.328643+0000","last_unstale":"2024-05-10T14:05:51.341731+0000","last_undegraded":"2024-05-10T14:05:51.341731+0000","last_fullsized":"2024-05-10T14:05:51.341731+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:59.031951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":186,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316796+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:05:48.316796+0000","last_peered":"2024-05-10T14:05:48.316796+0000","last_clean":"2024-05-10T14:05:48.316796+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:05:48.316796+0000","last_undegraded":"2024-05-10T14:05:48.316796+0000","last_fullsized":"2024-05-10T14:05:48.316796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338385+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:05:51.338385+0000","last_peered":"2024-05-10T14:05:51.338385+0000","last_clean":"2024-05-10T14:05:51.338385+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:05:51.338385+0000","last_undegraded":"2024-05-10T14:05:51.338385+0000","last_fullsized":"2024-05-10T14:05:51.338385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337924+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:05:51.337924+0000","last_peered":"2024-05-10T14:05:51.337924+0000","last_clean":"2024-05-10T14:05:51.337924+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:05:51.337924+0000","last_undegraded":"2024-05-10T14:05:51.337924+0000","last_fullsized":"2024-05-10T14:05:51.337924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340385+0000","last_change":"2024-05-10T14:05:17.301444+0000","last_active":"2024-05-10T14:05:51.340385+0000","last_peered":"2024-05-10T14:05:51.340385+0000","last_clean":"2024-05-10T14:05:51.340385+0000","last_became_active":"2024-05-10T14:05:17.300629+0000","last_became_peered":"2024-05-10T14:05:17.300629+0000","last_unstale":"2024-05-10T14:05:51.340385+0000","last_undegraded":"2024-05-10T14:05:51.340385+0000","last_fullsized":"2024-05-10T14:05:51.340385+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:10.457996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316423+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:05:48.316423+0000","last_peered":"2024-05-10T14:05:48.316423+0000","last_clean":"2024-05-10T14:05:48.316423+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:05:48.316423+0000","last_undegraded":"2024-05-10T14:05:48.316423+0000","last_fullsized":"2024-05-10T14:05:48.316423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340017+0000","last_change":"2024-05-10T14:05:17.302494+0000","last_active":"2024-05-10T14:05:51.340017+0000","last_peered":"2024-05-10T14:05:51.340017+0000","last_clean":"2024-05-10T14:05:51.340017+0000","last_became_active":"2024-05-10T14:05:17.302183+0000","last_became_peered":"2024-05-10T14:05:17.302183+0000","last_unstale":"2024-05-10T14:05:51.340017+0000","last_undegraded":"2024-05-10T14:05:51.340017+0000","last_fullsized":"2024-05-10T14:05:51.340017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:00:37.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338842+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:05:51.338842+0000","last_peered":"2024-05-10T14:05:51.338842+0000","last_clean":"2024-05-10T14:05:51.338842+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:05:51.338842+0000","last_undegraded":"2024-05-10T14:05:51.338842+0000","last_fullsized":"2024-05-10T14:05:51.338842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658286+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:05:51.658286+0000","last_peered":"2024-05-10T14:05:51.658286+0000","last_clean":"2024-05-10T14:05:51.658286+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:05:51.658286+0000","last_undegraded":"2024-05-10T14:05:51.658286+0000","last_fullsized":"2024-05-10T14:05:51.658286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660229+0000","last_change":"2024-05-10T14:05:17.326908+0000","last_active":"2024-05-10T14:05:51.660229+0000","last_peered":"2024-05-10T14:05:51.660229+0000","last_clean":"2024-05-10T14:05:51.660229+0000","last_became_active":"2024-05-10T14:05:17.326038+0000","last_became_peered":"2024-05-10T14:05:17.326038+0000","last_unstale":"2024-05-10T14:05:51.660229+0000","last_undegraded":"2024-05-10T14:05:51.660229+0000","last_fullsized":"2024-05-10T14:05:51.660229+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:30.900773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659646+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:05:51.659646+0000","last_peered":"2024-05-10T14:05:51.659646+0000","last_clean":"2024-05-10T14:05:51.659646+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:05:51.659646+0000","last_undegraded":"2024-05-10T14:05:51.659646+0000","last_fullsized":"2024-05-10T14:05:51.659646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338422+0000","last_change":"2024-05-10T14:05:17.389023+0000","last_active":"2024-05-10T14:05:51.338422+0000","last_peered":"2024-05-10T14:05:51.338422+0000","last_clean":"2024-05-10T14:05:51.338422+0000","last_became_active":"2024-05-10T14:05:17.328793+0000","last_became_peered":"2024-05-10T14:05:17.328793+0000","last_unstale":"2024-05-10T14:05:51.338422+0000","last_undegraded":"2024-05-10T14:05:51.338422+0000","last_fullsized":"2024-05-10T14:05:51.338422+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:01.641999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590681+0000","last_change":"2024-05-10T14:05:17.297623+0000","last_active":"2024-05-10T14:05:48.590681+0000","last_peered":"2024-05-10T14:05:48.590681+0000","last_clean":"2024-05-10T14:05:48.590681+0000","last_became_active":"2024-05-10T14:05:17.292479+0000","last_became_peered":"2024-05-10T14:05:17.292479+0000","last_unstale":"2024-05-10T14:05:48.590681+0000","last_undegraded":"2024-05-10T14:05:48.590681+0000","last_fullsized":"2024-05-10T14:05:48.590681+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:35.280501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339831+0000","last_change":"2024-05-10T14:05:17.316646+0000","last_active":"2024-05-10T14:05:51.339831+0000","last_peered":"2024-05-10T14:05:51.339831+0000","last_clean":"2024-05-10T14:05:51.339831+0000","last_became_active":"2024-05-10T14:05:17.315392+0000","last_became_peered":"2024-05-10T14:05:17.315392+0000","last_unstale":"2024-05-10T14:05:51.339831+0000","last_undegraded":"2024-05-10T14:05:51.339831+0000","last_fullsized":"2024-05-10T14:05:51.339831+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:43.312219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338644+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:05:51.338644+0000","last_peered":"2024-05-10T14:05:51.338644+0000","last_clean":"2024-05-10T14:05:51.338644+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:05:51.338644+0000","last_undegraded":"2024-05-10T14:05:51.338644+0000","last_fullsized":"2024-05-10T14:05:51.338644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660279+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:05:51.660279+0000","last_peered":"2024-05-10T14:05:51.660279+0000","last_clean":"2024-05-10T14:05:51.660279+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:05:51.660279+0000","last_undegraded":"2024-05-10T14:05:51.660279+0000","last_fullsized":"2024-05-10T14:05:51.660279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591936+0000","last_change":"2024-05-10T14:05:17.308941+0000","last_active":"2024-05-10T14:05:48.591936+0000","last_peered":"2024-05-10T14:05:48.591936+0000","last_clean":"2024-05-10T14:05:48.591936+0000","last_became_active":"2024-05-10T14:05:17.307845+0000","last_became_peered":"2024-05-10T14:05:17.307845+0000","last_unstale":"2024-05-10T14:05:48.591936+0000","last_undegraded":"2024-05-10T14:05:48.591936+0000","last_fullsized":"2024-05-10T14:05:48.591936+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.273750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337403+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:05:51.337403+0000","last_peered":"2024-05-10T14:05:51.337403+0000","last_clean":"2024-05-10T14:05:51.337403+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:05:51.337403+0000","last_undegraded":"2024-05-10T14:05:51.337403+0000","last_fullsized":"2024-05-10T14:05:51.337403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660561+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:05:51.660561+0000","last_peered":"2024-05-10T14:05:51.660561+0000","last_clean":"2024-05-10T14:05:51.660561+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:05:51.660561+0000","last_undegraded":"2024-05-10T14:05:51.660561+0000","last_fullsized":"2024-05-10T14:05:51.660561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661218+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:05:51.661218+0000","last_peered":"2024-05-10T14:05:51.661218+0000","last_clean":"2024-05-10T14:05:51.661218+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:05:51.661218+0000","last_undegraded":"2024-05-10T14:05:51.661218+0000","last_fullsized":"2024-05-10T14:05:51.661218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338891+0000","last_change":"2024-05-10T14:05:17.356428+0000","last_active":"2024-05-10T14:05:51.338891+0000","last_peered":"2024-05-10T14:05:51.338891+0000","last_clean":"2024-05-10T14:05:51.338891+0000","last_became_active":"2024-05-10T14:05:17.322206+0000","last_became_peered":"2024-05-10T14:05:17.322206+0000","last_unstale":"2024-05-10T14:05:51.338891+0000","last_undegraded":"2024-05-10T14:05:51.338891+0000","last_fullsized":"2024-05-10T14:05:51.338891+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:56:24.255861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659218+0000","last_change":"2024-05-10T14:05:17.290150+0000","last_active":"2024-05-10T14:05:51.659218+0000","last_peered":"2024-05-10T14:05:51.659218+0000","last_clean":"2024-05-10T14:05:51.659218+0000","last_became_active":"2024-05-10T14:05:17.289889+0000","last_became_peered":"2024-05-10T14:05:17.289889+0000","last_unstale":"2024-05-10T14:05:51.659218+0000","last_undegraded":"2024-05-10T14:05:51.659218+0000","last_fullsized":"2024-05-10T14:05:51.659218+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:26:01.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665071+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:05:51.665071+0000","last_peered":"2024-05-10T14:05:51.665071+0000","last_clean":"2024-05-10T14:05:51.665071+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:05:51.665071+0000","last_undegraded":"2024-05-10T14:05:51.665071+0000","last_fullsized":"2024-05-10T14:05:51.665071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337245+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:05:51.337245+0000","last_peered":"2024-05-10T14:05:51.337245+0000","last_clean":"2024-05-10T14:05:51.337245+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:05:51.337245+0000","last_undegraded":"2024-05-10T14:05:51.337245+0000","last_fullsized":"2024-05-10T14:05:51.337245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660109+0000","last_change":"2024-05-10T14:05:17.290271+0000","last_active":"2024-05-10T14:05:51.660109+0000","last_peered":"2024-05-10T14:05:51.660109+0000","last_clean":"2024-05-10T14:05:51.660109+0000","last_became_active":"2024-05-10T14:05:17.289795+0000","last_became_peered":"2024-05-10T14:05:17.289795+0000","last_unstale":"2024-05-10T14:05:51.660109+0000","last_undegraded":"2024-05-10T14:05:51.660109+0000","last_fullsized":"2024-05-10T14:05:51.660109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:36.010565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316628+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:05:48.316628+0000","last_peered":"2024-05-10T14:05:48.316628+0000","last_clean":"2024-05-10T14:05:48.316628+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:05:48.316628+0000","last_undegraded":"2024-05-10T14:05:48.316628+0000","last_fullsized":"2024-05-10T14:05:48.316628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591595+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:05:48.591595+0000","last_peered":"2024-05-10T14:05:48.591595+0000","last_clean":"2024-05-10T14:05:48.591595+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:05:48.591595+0000","last_undegraded":"2024-05-10T14:05:48.591595+0000","last_fullsized":"2024-05-10T14:05:48.591595+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338261+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:05:51.338261+0000","last_peered":"2024-05-10T14:05:51.338261+0000","last_clean":"2024-05-10T14:05:51.338261+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:05:51.338261+0000","last_undegraded":"2024-05-10T14:05:51.338261+0000","last_fullsized":"2024-05-10T14:05:51.338261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660397+0000","last_change":"2024-05-10T14:05:17.299613+0000","last_active":"2024-05-10T14:05:51.660397+0000","last_peered":"2024-05-10T14:05:51.660397+0000","last_clean":"2024-05-10T14:05:51.660397+0000","last_became_active":"2024-05-10T14:05:17.299295+0000","last_became_peered":"2024-05-10T14:05:17.299295+0000","last_unstale":"2024-05-10T14:05:51.660397+0000","last_undegraded":"2024-05-10T14:05:51.660397+0000","last_fullsized":"2024-05-10T14:05:51.660397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:00.221896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316466+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:05:48.316466+0000","last_peered":"2024-05-10T14:05:48.316466+0000","last_clean":"2024-05-10T14:05:48.316466+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:05:48.316466+0000","last_undegraded":"2024-05-10T14:05:48.316466+0000","last_fullsized":"2024-05-10T14:05:48.316466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664790+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:05:51.664790+0000","last_peered":"2024-05-10T14:05:51.664790+0000","last_clean":"2024-05-10T14:05:51.664790+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:05:51.664790+0000","last_undegraded":"2024-05-10T14:05:51.664790+0000","last_fullsized":"2024-05-10T14:05:51.664790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589975+0000","last_change":"2024-05-10T14:05:17.342315+0000","last_active":"2024-05-10T14:05:48.589975+0000","last_peered":"2024-05-10T14:05:48.589975+0000","last_clean":"2024-05-10T14:05:48.589975+0000","last_became_active":"2024-05-10T14:05:17.306666+0000","last_became_peered":"2024-05-10T14:05:17.306666+0000","last_unstale":"2024-05-10T14:05:48.589975+0000","last_undegraded":"2024-05-10T14:05:48.589975+0000","last_fullsized":"2024-05-10T14:05:48.589975+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:48.468176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":171,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317038+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:05:48.317038+0000","last_peered":"2024-05-10T14:05:48.317038+0000","last_clean":"2024-05-10T14:05:48.317038+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:05:48.317038+0000","last_undegraded":"2024-05-10T14:05:48.317038+0000","last_fullsized":"2024-05-10T14:05:48.317038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660677+0000","last_change":"2024-05-10T14:05:17.325443+0000","last_active":"2024-05-10T14:05:51.660677+0000","last_peered":"2024-05-10T14:05:51.660677+0000","last_clean":"2024-05-10T14:05:51.660677+0000","last_became_active":"2024-05-10T14:05:17.319097+0000","last_became_peered":"2024-05-10T14:05:17.319097+0000","last_unstale":"2024-05-10T14:05:51.660677+0000","last_undegraded":"2024-05-10T14:05:51.660677+0000","last_fullsized":"2024-05-10T14:05:51.660677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:22.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340177+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:05:51.340177+0000","last_peered":"2024-05-10T14:05:51.340177+0000","last_clean":"2024-05-10T14:05:51.340177+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:05:51.340177+0000","last_undegraded":"2024-05-10T14:05:51.340177+0000","last_fullsized":"2024-05-10T14:05:51.340177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342595+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:05:51.342595+0000","last_peered":"2024-05-10T14:05:51.342595+0000","last_clean":"2024-05-10T14:05:51.342595+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:05:51.342595+0000","last_undegraded":"2024-05-10T14:05:51.342595+0000","last_fullsized":"2024-05-10T14:05:51.342595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343142+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:05:51.343142+0000","last_peered":"2024-05-10T14:05:51.343142+0000","last_clean":"2024-05-10T14:05:51.343142+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:05:51.343142+0000","last_undegraded":"2024-05-10T14:05:51.343142+0000","last_fullsized":"2024-05-10T14:05:51.343142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339227+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:05:51.339227+0000","last_peered":"2024-05-10T14:05:51.339227+0000","last_clean":"2024-05-10T14:05:51.339227+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:05:51.339227+0000","last_undegraded":"2024-05-10T14:05:51.339227+0000","last_fullsized":"2024-05-10T14:05:51.339227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":171,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316203+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:05:48.316203+0000","last_peered":"2024-05-10T14:05:48.316203+0000","last_clean":"2024-05-10T14:05:48.316203+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:05:48.316203+0000","last_undegraded":"2024-05-10T14:05:48.316203+0000","last_fullsized":"2024-05-10T14:05:48.316203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588552+0000","last_change":"2024-05-10T14:05:17.329828+0000","last_active":"2024-05-10T14:05:48.588552+0000","last_peered":"2024-05-10T14:05:48.588552+0000","last_clean":"2024-05-10T14:05:48.588552+0000","last_became_active":"2024-05-10T14:05:17.329143+0000","last_became_peered":"2024-05-10T14:05:17.329143+0000","last_unstale":"2024-05-10T14:05:48.588552+0000","last_undegraded":"2024-05-10T14:05:48.588552+0000","last_fullsized":"2024-05-10T14:05:48.588552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:33.149265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338778+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:05:51.338778+0000","last_peered":"2024-05-10T14:05:51.338778+0000","last_clean":"2024-05-10T14:05:51.338778+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:05:51.338778+0000","last_undegraded":"2024-05-10T14:05:51.338778+0000","last_fullsized":"2024-05-10T14:05:51.338778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659323+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:05:51.659323+0000","last_peered":"2024-05-10T14:05:51.659323+0000","last_clean":"2024-05-10T14:05:51.659323+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:05:51.659323+0000","last_undegraded":"2024-05-10T14:05:51.659323+0000","last_fullsized":"2024-05-10T14:05:51.659323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317735+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:05:48.317735+0000","last_peered":"2024-05-10T14:05:48.317735+0000","last_clean":"2024-05-10T14:05:48.317735+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:05:48.317735+0000","last_undegraded":"2024-05-10T14:05:48.317735+0000","last_fullsized":"2024-05-10T14:05:48.317735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342815+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:05:51.342815+0000","last_peered":"2024-05-10T14:05:51.342815+0000","last_clean":"2024-05-10T14:05:51.342815+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:05:51.342815+0000","last_undegraded":"2024-05-10T14:05:51.342815+0000","last_fullsized":"2024-05-10T14:05:51.342815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664067+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:05:51.664067+0000","last_peered":"2024-05-10T14:05:51.664067+0000","last_clean":"2024-05-10T14:05:51.664067+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:05:51.664067+0000","last_undegraded":"2024-05-10T14:05:51.664067+0000","last_fullsized":"2024-05-10T14:05:51.664067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":116,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589496+0000","last_change":"2024-05-10T14:05:17.321018+0000","last_active":"2024-05-10T14:05:48.589496+0000","last_peered":"2024-05-10T14:05:48.589496+0000","last_clean":"2024-05-10T14:05:48.589496+0000","last_became_active":"2024-05-10T14:05:17.320295+0000","last_became_peered":"2024-05-10T14:05:17.320295+0000","last_unstale":"2024-05-10T14:05:48.589496+0000","last_undegraded":"2024-05-10T14:05:48.589496+0000","last_fullsized":"2024-05-10T14:05:48.589496+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:57.713909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340786+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:05:51.340786+0000","last_peered":"2024-05-10T14:05:51.340786+0000","last_clean":"2024-05-10T14:05:51.340786+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:05:51.340786+0000","last_undegraded":"2024-05-10T14:05:51.340786+0000","last_fullsized":"2024-05-10T14:05:51.340786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586168+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:05:48.586168+0000","last_peered":"2024-05-10T14:05:48.586168+0000","last_clean":"2024-05-10T14:05:48.586168+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:05:48.586168+0000","last_undegraded":"2024-05-10T14:05:48.586168+0000","last_fullsized":"2024-05-10T14:05:48.586168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340551+0000","last_change":"2024-05-10T14:05:17.308154+0000","last_active":"2024-05-10T14:05:51.340551+0000","last_peered":"2024-05-10T14:05:51.340551+0000","last_clean":"2024-05-10T14:05:51.340551+0000","last_became_active":"2024-05-10T14:05:17.306642+0000","last_became_peered":"2024-05-10T14:05:17.306642+0000","last_unstale":"2024-05-10T14:05:51.340551+0000","last_undegraded":"2024-05-10T14:05:51.340551+0000","last_fullsized":"2024-05-10T14:05:51.340551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:17:32.949040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":139,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584813+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:05:48.584813+0000","last_peered":"2024-05-10T14:05:48.584813+0000","last_clean":"2024-05-10T14:05:48.584813+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:05:48.584813+0000","last_undegraded":"2024-05-10T14:05:48.584813+0000","last_fullsized":"2024-05-10T14:05:48.584813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658493+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:05:51.658493+0000","last_peered":"2024-05-10T14:05:51.658493+0000","last_clean":"2024-05-10T14:05:51.658493+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:05:51.658493+0000","last_undegraded":"2024-05-10T14:05:51.658493+0000","last_fullsized":"2024-05-10T14:05:51.658493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659635+0000","last_change":"2024-05-10T14:05:17.291271+0000","last_active":"2024-05-10T14:05:51.659635+0000","last_peered":"2024-05-10T14:05:51.659635+0000","last_clean":"2024-05-10T14:05:51.659635+0000","last_became_active":"2024-05-10T14:05:17.290828+0000","last_became_peered":"2024-05-10T14:05:17.290828+0000","last_unstale":"2024-05-10T14:05:51.659635+0000","last_undegraded":"2024-05-10T14:05:51.659635+0000","last_fullsized":"2024-05-10T14:05:51.659635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:28.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341911+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:05:51.341911+0000","last_peered":"2024-05-10T14:05:51.341911+0000","last_clean":"2024-05-10T14:05:51.341911+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:05:51.341911+0000","last_undegraded":"2024-05-10T14:05:51.341911+0000","last_fullsized":"2024-05-10T14:05:51.341911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590447+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:05:48.590447+0000","last_peered":"2024-05-10T14:05:48.590447+0000","last_clean":"2024-05-10T14:05:48.590447+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:05:48.590447+0000","last_undegraded":"2024-05-10T14:05:48.590447+0000","last_fullsized":"2024-05-10T14:05:48.590447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586819+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:05:48.586819+0000","last_peered":"2024-05-10T14:05:48.586819+0000","last_clean":"2024-05-10T14:05:48.586819+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:05:48.586819+0000","last_undegraded":"2024-05-10T14:05:48.586819+0000","last_fullsized":"2024-05-10T14:05:48.586819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658390+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:05:51.658390+0000","last_peered":"2024-05-10T14:05:51.658390+0000","last_clean":"2024-05-10T14:05:51.658390+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:05:51.658390+0000","last_undegraded":"2024-05-10T14:05:51.658390+0000","last_fullsized":"2024-05-10T14:05:51.658390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660338+0000","last_change":"2024-05-10T14:05:17.318418+0000","last_active":"2024-05-10T14:05:51.660338+0000","last_peered":"2024-05-10T14:05:51.660338+0000","last_clean":"2024-05-10T14:05:51.660338+0000","last_became_active":"2024-05-10T14:05:17.317436+0000","last_became_peered":"2024-05-10T14:05:17.317436+0000","last_unstale":"2024-05-10T14:05:51.660338+0000","last_undegraded":"2024-05-10T14:05:51.660338+0000","last_fullsized":"2024-05-10T14:05:51.660338+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:35.182032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340453+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:05:51.340453+0000","last_peered":"2024-05-10T14:05:51.340453+0000","last_clean":"2024-05-10T14:05:51.340453+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:05:51.340453+0000","last_undegraded":"2024-05-10T14:05:51.340453+0000","last_fullsized":"2024-05-10T14:05:51.340453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339614+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:05:51.339614+0000","last_peered":"2024-05-10T14:05:51.339614+0000","last_clean":"2024-05-10T14:05:51.339614+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:05:51.339614+0000","last_undegraded":"2024-05-10T14:05:51.339614+0000","last_fullsized":"2024-05-10T14:05:51.339614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341007+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:05:51.341007+0000","last_peered":"2024-05-10T14:05:51.341007+0000","last_clean":"2024-05-10T14:05:51.341007+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:05:51.341007+0000","last_undegraded":"2024-05-10T14:05:51.341007+0000","last_fullsized":"2024-05-10T14:05:51.341007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339558+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:05:51.339558+0000","last_peered":"2024-05-10T14:05:51.339558+0000","last_clean":"2024-05-10T14:05:51.339558+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:05:51.339558+0000","last_undegraded":"2024-05-10T14:05:51.339558+0000","last_fullsized":"2024-05-10T14:05:51.339558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340622+0000","last_change":"2024-05-10T14:05:17.359796+0000","last_active":"2024-05-10T14:05:51.340622+0000","last_peered":"2024-05-10T14:05:51.340622+0000","last_clean":"2024-05-10T14:05:51.340622+0000","last_became_active":"2024-05-10T14:05:17.313620+0000","last_became_peered":"2024-05-10T14:05:17.313620+0000","last_unstale":"2024-05-10T14:05:51.340622+0000","last_undegraded":"2024-05-10T14:05:51.340622+0000","last_fullsized":"2024-05-10T14:05:51.340622+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:16.709452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340306+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:05:51.340306+0000","last_peered":"2024-05-10T14:05:51.340306+0000","last_clean":"2024-05-10T14:05:51.340306+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:05:51.340306+0000","last_undegraded":"2024-05-10T14:05:51.340306+0000","last_fullsized":"2024-05-10T14:05:51.340306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":34,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316795+0000","last_change":"2024-05-10T14:05:17.329847+0000","last_active":"2024-05-10T14:05:48.316795+0000","last_peered":"2024-05-10T14:05:48.316795+0000","last_clean":"2024-05-10T14:05:48.316795+0000","last_became_active":"2024-05-10T14:05:17.329439+0000","last_became_peered":"2024-05-10T14:05:17.329439+0000","last_unstale":"2024-05-10T14:05:48.316795+0000","last_undegraded":"2024-05-10T14:05:48.316795+0000","last_fullsized":"2024-05-10T14:05:48.316795+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:10.877312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340268+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:05:51.340268+0000","last_peered":"2024-05-10T14:05:51.340268+0000","last_clean":"2024-05-10T14:05:51.340268+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:05:51.340268+0000","last_undegraded":"2024-05-10T14:05:51.340268+0000","last_fullsized":"2024-05-10T14:05:51.340268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660475+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:05:51.660475+0000","last_peered":"2024-05-10T14:05:51.660475+0000","last_clean":"2024-05-10T14:05:51.660475+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:05:51.660475+0000","last_undegraded":"2024-05-10T14:05:51.660475+0000","last_fullsized":"2024-05-10T14:05:51.660475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315103+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:05:48.315103+0000","last_peered":"2024-05-10T14:05:48.315103+0000","last_clean":"2024-05-10T14:05:48.315103+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:05:48.315103+0000","last_undegraded":"2024-05-10T14:05:48.315103+0000","last_fullsized":"2024-05-10T14:05:48.315103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340710+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:05:51.340710+0000","last_peered":"2024-05-10T14:05:51.340710+0000","last_clean":"2024-05-10T14:05:51.340710+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:05:51.340710+0000","last_undegraded":"2024-05-10T14:05:51.340710+0000","last_fullsized":"2024-05-10T14:05:51.340710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659115+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:05:51.659115+0000","last_peered":"2024-05-10T14:05:51.659115+0000","last_clean":"2024-05-10T14:05:51.659115+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:05:51.659115+0000","last_undegraded":"2024-05-10T14:05:51.659115+0000","last_fullsized":"2024-05-10T14:05:51.659115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343399+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:05:51.343399+0000","last_peered":"2024-05-10T14:05:51.343399+0000","last_clean":"2024-05-10T14:05:51.343399+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:05:51.343399+0000","last_undegraded":"2024-05-10T14:05:51.343399+0000","last_fullsized":"2024-05-10T14:05:51.343399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317551+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:05:48.317551+0000","last_peered":"2024-05-10T14:05:48.317551+0000","last_clean":"2024-05-10T14:05:48.317551+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:05:48.317551+0000","last_undegraded":"2024-05-10T14:05:48.317551+0000","last_fullsized":"2024-05-10T14:05:48.317551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660917+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:05:51.660917+0000","last_peered":"2024-05-10T14:05:51.660917+0000","last_clean":"2024-05-10T14:05:51.660917+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:05:51.660917+0000","last_undegraded":"2024-05-10T14:05:51.660917+0000","last_fullsized":"2024-05-10T14:05:51.660917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317630+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:05:48.317630+0000","last_peered":"2024-05-10T14:05:48.317630+0000","last_clean":"2024-05-10T14:05:48.317630+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:05:48.317630+0000","last_undegraded":"2024-05-10T14:05:48.317630+0000","last_fullsized":"2024-05-10T14:05:48.317630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338523+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:05:51.338523+0000","last_peered":"2024-05-10T14:05:51.338523+0000","last_clean":"2024-05-10T14:05:51.338523+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:05:51.338523+0000","last_undegraded":"2024-05-10T14:05:51.338523+0000","last_fullsized":"2024-05-10T14:05:51.338523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591686+0000","last_change":"2024-05-10T14:05:17.317395+0000","last_active":"2024-05-10T14:05:48.591686+0000","last_peered":"2024-05-10T14:05:48.591686+0000","last_clean":"2024-05-10T14:05:48.591686+0000","last_became_active":"2024-05-10T14:05:17.315496+0000","last_became_peered":"2024-05-10T14:05:17.315496+0000","last_unstale":"2024-05-10T14:05:48.591686+0000","last_undegraded":"2024-05-10T14:05:48.591686+0000","last_fullsized":"2024-05-10T14:05:48.591686+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:06:24.935635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584820+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:05:48.584820+0000","last_peered":"2024-05-10T14:05:48.584820+0000","last_clean":"2024-05-10T14:05:48.584820+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:05:48.584820+0000","last_undegraded":"2024-05-10T14:05:48.584820+0000","last_fullsized":"2024-05-10T14:05:48.584820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":188,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316665+0000","last_change":"2024-05-10T14:05:17.288941+0000","last_active":"2024-05-10T14:05:48.316665+0000","last_peered":"2024-05-10T14:05:48.316665+0000","last_clean":"2024-05-10T14:05:48.316665+0000","last_became_active":"2024-05-10T14:05:17.286289+0000","last_became_peered":"2024-05-10T14:05:17.286289+0000","last_unstale":"2024-05-10T14:05:48.316665+0000","last_undegraded":"2024-05-10T14:05:48.316665+0000","last_fullsized":"2024-05-10T14:05:48.316665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:37.303535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659519+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:05:51.659519+0000","last_peered":"2024-05-10T14:05:51.659519+0000","last_clean":"2024-05-10T14:05:51.659519+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:05:51.659519+0000","last_undegraded":"2024-05-10T14:05:51.659519+0000","last_fullsized":"2024-05-10T14:05:51.659519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340095+0000","last_change":"2024-05-10T14:05:17.291835+0000","last_active":"2024-05-10T14:05:51.340095+0000","last_peered":"2024-05-10T14:05:51.340095+0000","last_clean":"2024-05-10T14:05:51.340095+0000","last_became_active":"2024-05-10T14:05:17.291059+0000","last_became_peered":"2024-05-10T14:05:17.291059+0000","last_unstale":"2024-05-10T14:05:51.340095+0000","last_undegraded":"2024-05-10T14:05:51.340095+0000","last_fullsized":"2024-05-10T14:05:51.340095+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:50.766804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339859+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:05:51.339859+0000","last_peered":"2024-05-10T14:05:51.339859+0000","last_clean":"2024-05-10T14:05:51.339859+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:05:51.339859+0000","last_undegraded":"2024-05-10T14:05:51.339859+0000","last_fullsized":"2024-05-10T14:05:51.339859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342327+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:05:51.342327+0000","last_peered":"2024-05-10T14:05:51.342327+0000","last_clean":"2024-05-10T14:05:51.342327+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:05:51.342327+0000","last_undegraded":"2024-05-10T14:05:51.342327+0000","last_fullsized":"2024-05-10T14:05:51.342327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317528+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:05:48.317528+0000","last_peered":"2024-05-10T14:05:48.317528+0000","last_clean":"2024-05-10T14:05:48.317528+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:05:48.317528+0000","last_undegraded":"2024-05-10T14:05:48.317528+0000","last_fullsized":"2024-05-10T14:05:48.317528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339453+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:05:51.339453+0000","last_peered":"2024-05-10T14:05:51.339453+0000","last_clean":"2024-05-10T14:05:51.339453+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:05:51.339453+0000","last_undegraded":"2024-05-10T14:05:51.339453+0000","last_fullsized":"2024-05-10T14:05:51.339453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664293+0000","last_change":"2024-05-10T14:05:17.308151+0000","last_active":"2024-05-10T14:05:51.664293+0000","last_peered":"2024-05-10T14:05:51.664293+0000","last_clean":"2024-05-10T14:05:51.664293+0000","last_became_active":"2024-05-10T14:05:17.307278+0000","last_became_peered":"2024-05-10T14:05:17.307278+0000","last_unstale":"2024-05-10T14:05:51.664293+0000","last_undegraded":"2024-05-10T14:05:51.664293+0000","last_fullsized":"2024-05-10T14:05:51.664293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:08.196085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660666+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:05:51.660666+0000","last_peered":"2024-05-10T14:05:51.660666+0000","last_clean":"2024-05-10T14:05:51.660666+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:05:51.660666+0000","last_undegraded":"2024-05-10T14:05:51.660666+0000","last_fullsized":"2024-05-10T14:05:51.660666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338810+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:05:51.338810+0000","last_peered":"2024-05-10T14:05:51.338810+0000","last_clean":"2024-05-10T14:05:51.338810+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:05:51.338810+0000","last_undegraded":"2024-05-10T14:05:51.338810+0000","last_fullsized":"2024-05-10T14:05:51.338810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660373+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:05:51.660373+0000","last_peered":"2024-05-10T14:05:51.660373+0000","last_clean":"2024-05-10T14:05:51.660373+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:05:51.660373+0000","last_undegraded":"2024-05-10T14:05:51.660373+0000","last_fullsized":"2024-05-10T14:05:51.660373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.583855+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:05:48.583855+0000","last_peered":"2024-05-10T14:05:48.583855+0000","last_clean":"2024-05-10T14:05:48.583855+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:05:48.583855+0000","last_undegraded":"2024-05-10T14:05:48.583855+0000","last_fullsized":"2024-05-10T14:05:48.583855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343077+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:05:51.343077+0000","last_peered":"2024-05-10T14:05:51.343077+0000","last_clean":"2024-05-10T14:05:51.343077+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:05:51.343077+0000","last_undegraded":"2024-05-10T14:05:51.343077+0000","last_fullsized":"2024-05-10T14:05:51.343077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339711+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:05:51.339711+0000","last_peered":"2024-05-10T14:05:51.339711+0000","last_clean":"2024-05-10T14:05:51.339711+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:05:51.339711+0000","last_undegraded":"2024-05-10T14:05:51.339711+0000","last_fullsized":"2024-05-10T14:05:51.339711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340698+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:05:51.340698+0000","last_peered":"2024-05-10T14:05:51.340698+0000","last_clean":"2024-05-10T14:05:51.340698+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:05:51.340698+0000","last_undegraded":"2024-05-10T14:05:51.340698+0000","last_fullsized":"2024-05-10T14:05:51.340698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338989+0000","last_change":"2024-05-10T14:05:17.347404+0000","last_active":"2024-05-10T14:05:51.338989+0000","last_peered":"2024-05-10T14:05:51.338989+0000","last_clean":"2024-05-10T14:05:51.338989+0000","last_became_active":"2024-05-10T14:05:17.312136+0000","last_became_peered":"2024-05-10T14:05:17.312136+0000","last_unstale":"2024-05-10T14:05:51.338989+0000","last_undegraded":"2024-05-10T14:05:51.338989+0000","last_fullsized":"2024-05-10T14:05:51.338989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:31.387274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342540+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:05:51.342540+0000","last_peered":"2024-05-10T14:05:51.342540+0000","last_clean":"2024-05-10T14:05:51.342540+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:05:51.342540+0000","last_undegraded":"2024-05-10T14:05:51.342540+0000","last_fullsized":"2024-05-10T14:05:51.342540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659673+0000","last_change":"2024-05-10T14:05:17.287670+0000","last_active":"2024-05-10T14:05:51.659673+0000","last_peered":"2024-05-10T14:05:51.659673+0000","last_clean":"2024-05-10T14:05:51.659673+0000","last_became_active":"2024-05-10T14:05:17.287257+0000","last_became_peered":"2024-05-10T14:05:17.287257+0000","last_unstale":"2024-05-10T14:05:51.659673+0000","last_undegraded":"2024-05-10T14:05:51.659673+0000","last_fullsized":"2024-05-10T14:05:51.659673+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:11:42.174537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338546+0000","last_change":"2024-05-10T14:05:17.301830+0000","last_active":"2024-05-10T14:05:51.338546+0000","last_peered":"2024-05-10T14:05:51.338546+0000","last_clean":"2024-05-10T14:05:51.338546+0000","last_became_active":"2024-05-10T14:05:17.301264+0000","last_became_peered":"2024-05-10T14:05:17.301264+0000","last_unstale":"2024-05-10T14:05:51.338546+0000","last_undegraded":"2024-05-10T14:05:51.338546+0000","last_fullsized":"2024-05-10T14:05:51.338546+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:15.154631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664818+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:05:51.664818+0000","last_peered":"2024-05-10T14:05:51.664818+0000","last_clean":"2024-05-10T14:05:51.664818+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:05:51.664818+0000","last_undegraded":"2024-05-10T14:05:51.664818+0000","last_fullsized":"2024-05-10T14:05:51.664818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659062+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:05:51.659062+0000","last_peered":"2024-05-10T14:05:51.659062+0000","last_clean":"2024-05-10T14:05:51.659062+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:05:51.659062+0000","last_undegraded":"2024-05-10T14:05:51.659062+0000","last_fullsized":"2024-05-10T14:05:51.659062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340799+0000","last_change":"2024-05-10T14:05:17.329021+0000","last_active":"2024-05-10T14:05:51.340799+0000","last_peered":"2024-05-10T14:05:51.340799+0000","last_clean":"2024-05-10T14:05:51.340799+0000","last_became_active":"2024-05-10T14:05:17.328706+0000","last_became_peered":"2024-05-10T14:05:17.328706+0000","last_unstale":"2024-05-10T14:05:51.340799+0000","last_undegraded":"2024-05-10T14:05:51.340799+0000","last_fullsized":"2024-05-10T14:05:51.340799+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:55:21.307180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339361+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:05:51.339361+0000","last_peered":"2024-05-10T14:05:51.339361+0000","last_clean":"2024-05-10T14:05:51.339361+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:05:51.339361+0000","last_undegraded":"2024-05-10T14:05:51.339361+0000","last_fullsized":"2024-05-10T14:05:51.339361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338261+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:05:51.338261+0000","last_peered":"2024-05-10T14:05:51.338261+0000","last_clean":"2024-05-10T14:05:51.338261+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:05:51.338261+0000","last_undegraded":"2024-05-10T14:05:51.338261+0000","last_fullsized":"2024-05-10T14:05:51.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337679+0000","last_change":"2024-05-10T14:05:17.293919+0000","last_active":"2024-05-10T14:05:51.337679+0000","last_peered":"2024-05-10T14:05:51.337679+0000","last_clean":"2024-05-10T14:05:51.337679+0000","last_became_active":"2024-05-10T14:05:17.293576+0000","last_became_peered":"2024-05-10T14:05:17.293576+0000","last_unstale":"2024-05-10T14:05:51.337679+0000","last_undegraded":"2024-05-10T14:05:51.337679+0000","last_fullsized":"2024-05-10T14:05:51.337679+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:58.347022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592856+0000","last_change":"2024-05-10T14:05:17.325095+0000","last_active":"2024-05-10T14:05:48.592856+0000","last_peered":"2024-05-10T14:05:48.592856+0000","last_clean":"2024-05-10T14:05:48.592856+0000","last_became_active":"2024-05-10T14:05:17.324542+0000","last_became_peered":"2024-05-10T14:05:17.324542+0000","last_unstale":"2024-05-10T14:05:48.592856+0000","last_undegraded":"2024-05-10T14:05:48.592856+0000","last_fullsized":"2024-05-10T14:05:48.592856+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:39.185433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584788+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:05:48.584788+0000","last_peered":"2024-05-10T14:05:48.584788+0000","last_clean":"2024-05-10T14:05:48.584788+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:05:48.584788+0000","last_undegraded":"2024-05-10T14:05:48.584788+0000","last_fullsized":"2024-05-10T14:05:48.584788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660217+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:05:51.660217+0000","last_peered":"2024-05-10T14:05:51.660217+0000","last_clean":"2024-05-10T14:05:51.660217+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:05:51.660217+0000","last_undegraded":"2024-05-10T14:05:51.660217+0000","last_fullsized":"2024-05-10T14:05:51.660217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316292+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:05:48.316292+0000","last_peered":"2024-05-10T14:05:48.316292+0000","last_clean":"2024-05-10T14:05:48.316292+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:05:48.316292+0000","last_undegraded":"2024-05-10T14:05:48.316292+0000","last_fullsized":"2024-05-10T14:05:48.316292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":104,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592293+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:05:48.592293+0000","last_peered":"2024-05-10T14:05:48.592293+0000","last_clean":"2024-05-10T14:05:48.592293+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:05:48.592293+0000","last_undegraded":"2024-05-10T14:05:48.592293+0000","last_fullsized":"2024-05-10T14:05:48.592293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":406,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1474,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":8878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":64424509485,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43372,"kb_used_data":12188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328468,"statfs":{"total":96636764160,"available":96592351232,"internally_reserved":0,"allocated":12480512,"data_stored":11875262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710742,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1392,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1425408,"data_stored":785311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36656,"kb_used_data":5468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335184,"statfs":{"total":96636764160,"available":96599228416,"internally_reserved":0,"allocated":5599232,"data_stored":5001451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":5632000,"data_stored":5001902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38788,"kb_used_data":3440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333052,"statfs":{"total":96636764160,"available":96597045248,"internally_reserved":0,"allocated":3522560,"data_stored":2904227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2015232,"data_stored":1397509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36700,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":1392640,"data_stored":783644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:05:53.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:05:53.855 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:53.854+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:53.930 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:53.931+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:53.957 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:53.957 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:53.971 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:54.057 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:54.059+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:54.131 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:54.130+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:54.137 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:54.137 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:54.151 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:54.183 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:05:54.192 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:05:54.208 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-10T14:05:53.365354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6883704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":266764,"kb_used_data":31316,"kb_used_omap":13,"kb_used_meta":235314,"kb_avail":660336116,"statfs":{"total":676457349120,"available":676184182784,"internally_reserved":0,"allocated":32067584,"data_stored":27749306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14125,"internal_metadata":240961747},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665169+0000","last_change":"2024-05-10T14:05:17.308499+0000","last_active":"2024-05-10T14:05:51.665169+0000","last_peered":"2024-05-10T14:05:51.665169+0000","last_clean":"2024-05-10T14:05:51.665169+0000","last_became_active":"2024-05-10T14:05:17.307153+0000","last_became_peered":"2024-05-10T14:05:17.307153+0000","last_unstale":"2024-05-10T14:05:51.665169+0000","last_undegraded":"2024-05-10T14:05:51.665169+0000","last_fullsized":"2024-05-10T14:05:51.665169+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:41.503945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588800+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:05:48.588800+0000","last_peered":"2024-05-10T14:05:48.588800+0000","last_clean":"2024-05-10T14:05:48.588800+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:05:48.588800+0000","last_undegraded":"2024-05-10T14:05:48.588800+0000","last_fullsized":"2024-05-10T14:05:48.588800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317935+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:05:48.317935+0000","last_peered":"2024-05-10T14:05:48.317935+0000","last_clean":"2024-05-10T14:05:48.317935+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:05:48.317935+0000","last_undegraded":"2024-05-10T14:05:48.317935+0000","last_fullsized":"2024-05-10T14:05:48.317935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316034+0000","last_change":"2024-05-10T14:05:17.302016+0000","last_active":"2024-05-10T14:05:48.316034+0000","last_peered":"2024-05-10T14:05:48.316034+0000","last_clean":"2024-05-10T14:05:48.316034+0000","last_became_active":"2024-05-10T14:05:17.301670+0000","last_became_peered":"2024-05-10T14:05:17.301670+0000","last_unstale":"2024-05-10T14:05:48.316034+0000","last_undegraded":"2024-05-10T14:05:48.316034+0000","last_fullsized":"2024-05-10T14:05:48.316034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:45:00.694606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659922+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:05:51.659922+0000","last_peered":"2024-05-10T14:05:51.659922+0000","last_clean":"2024-05-10T14:05:51.659922+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:05:51.659922+0000","last_undegraded":"2024-05-10T14:05:51.659922+0000","last_fullsized":"2024-05-10T14:05:51.659922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341056+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:05:51.341056+0000","last_peered":"2024-05-10T14:05:51.341056+0000","last_clean":"2024-05-10T14:05:51.341056+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:05:51.341056+0000","last_undegraded":"2024-05-10T14:05:51.341056+0000","last_fullsized":"2024-05-10T14:05:51.341056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589242+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:05:48.589242+0000","last_peered":"2024-05-10T14:05:48.589242+0000","last_clean":"2024-05-10T14:05:48.589242+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:05:48.589242+0000","last_undegraded":"2024-05-10T14:05:48.589242+0000","last_fullsized":"2024-05-10T14:05:48.589242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659422+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:05:51.659422+0000","last_peered":"2024-05-10T14:05:51.659422+0000","last_clean":"2024-05-10T14:05:51.659422+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:05:51.659422+0000","last_undegraded":"2024-05-10T14:05:51.659422+0000","last_fullsized":"2024-05-10T14:05:51.659422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339898+0000","last_change":"2024-05-10T14:05:17.288678+0000","last_active":"2024-05-10T14:05:51.339898+0000","last_peered":"2024-05-10T14:05:51.339898+0000","last_clean":"2024-05-10T14:05:51.339898+0000","last_became_active":"2024-05-10T14:05:17.288084+0000","last_became_peered":"2024-05-10T14:05:17.288084+0000","last_unstale":"2024-05-10T14:05:51.339898+0000","last_undegraded":"2024-05-10T14:05:51.339898+0000","last_fullsized":"2024-05-10T14:05:51.339898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:03.103193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664424+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:05:51.664424+0000","last_peered":"2024-05-10T14:05:51.664424+0000","last_clean":"2024-05-10T14:05:51.664424+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:05:51.664424+0000","last_undegraded":"2024-05-10T14:05:51.664424+0000","last_fullsized":"2024-05-10T14:05:51.664424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.585584+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:05:48.585584+0000","last_peered":"2024-05-10T14:05:48.585584+0000","last_clean":"2024-05-10T14:05:48.585584+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:05:48.585584+0000","last_undegraded":"2024-05-10T14:05:48.585584+0000","last_fullsized":"2024-05-10T14:05:48.585584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343885+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:05:51.343885+0000","last_peered":"2024-05-10T14:05:51.343885+0000","last_clean":"2024-05-10T14:05:51.343885+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:05:51.343885+0000","last_undegraded":"2024-05-10T14:05:51.343885+0000","last_fullsized":"2024-05-10T14:05:51.343885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658723+0000","last_change":"2024-05-10T14:05:17.315837+0000","last_active":"2024-05-10T14:05:51.658723+0000","last_peered":"2024-05-10T14:05:51.658723+0000","last_clean":"2024-05-10T14:05:51.658723+0000","last_became_active":"2024-05-10T14:05:17.315476+0000","last_became_peered":"2024-05-10T14:05:17.315476+0000","last_unstale":"2024-05-10T14:05:51.658723+0000","last_undegraded":"2024-05-10T14:05:51.658723+0000","last_fullsized":"2024-05-10T14:05:51.658723+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:37.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590703+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:05:48.590703+0000","last_peered":"2024-05-10T14:05:48.590703+0000","last_clean":"2024-05-10T14:05:48.590703+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:05:48.590703+0000","last_undegraded":"2024-05-10T14:05:48.590703+0000","last_fullsized":"2024-05-10T14:05:48.590703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337326+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:05:51.337326+0000","last_peered":"2024-05-10T14:05:51.337326+0000","last_clean":"2024-05-10T14:05:51.337326+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:05:51.337326+0000","last_undegraded":"2024-05-10T14:05:51.337326+0000","last_fullsized":"2024-05-10T14:05:51.337326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341281+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:05:51.341281+0000","last_peered":"2024-05-10T14:05:51.341281+0000","last_clean":"2024-05-10T14:05:51.341281+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:05:51.341281+0000","last_undegraded":"2024-05-10T14:05:51.341281+0000","last_fullsized":"2024-05-10T14:05:51.341281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340025+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:05:51.340025+0000","last_peered":"2024-05-10T14:05:51.340025+0000","last_clean":"2024-05-10T14:05:51.340025+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:05:51.340025+0000","last_undegraded":"2024-05-10T14:05:51.340025+0000","last_fullsized":"2024-05-10T14:05:51.340025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593178+0000","last_change":"2024-05-10T14:05:17.307897+0000","last_active":"2024-05-10T14:05:48.593178+0000","last_peered":"2024-05-10T14:05:48.593178+0000","last_clean":"2024-05-10T14:05:48.593178+0000","last_became_active":"2024-05-10T14:05:17.307124+0000","last_became_peered":"2024-05-10T14:05:17.307124+0000","last_unstale":"2024-05-10T14:05:48.593178+0000","last_undegraded":"2024-05-10T14:05:48.593178+0000","last_fullsized":"2024-05-10T14:05:48.593178+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:29.087558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":153,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315611+0000","last_change":"2024-05-10T14:05:17.306970+0000","last_active":"2024-05-10T14:05:48.315611+0000","last_peered":"2024-05-10T14:05:48.315611+0000","last_clean":"2024-05-10T14:05:48.315611+0000","last_became_active":"2024-05-10T14:05:17.291013+0000","last_became_peered":"2024-05-10T14:05:17.291013+0000","last_unstale":"2024-05-10T14:05:48.315611+0000","last_undegraded":"2024-05-10T14:05:48.315611+0000","last_fullsized":"2024-05-10T14:05:48.315611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:27.227907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663934+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:05:51.663934+0000","last_peered":"2024-05-10T14:05:51.663934+0000","last_clean":"2024-05-10T14:05:51.663934+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:05:51.663934+0000","last_undegraded":"2024-05-10T14:05:51.663934+0000","last_fullsized":"2024-05-10T14:05:51.663934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":102,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586597+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:05:48.586597+0000","last_peered":"2024-05-10T14:05:48.586597+0000","last_clean":"2024-05-10T14:05:48.586597+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:05:48.586597+0000","last_undegraded":"2024-05-10T14:05:48.586597+0000","last_fullsized":"2024-05-10T14:05:48.586597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664581+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:05:51.664581+0000","last_peered":"2024-05-10T14:05:51.664581+0000","last_clean":"2024-05-10T14:05:51.664581+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:05:51.664581+0000","last_undegraded":"2024-05-10T14:05:51.664581+0000","last_fullsized":"2024-05-10T14:05:51.664581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339719+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:05:51.339719+0000","last_peered":"2024-05-10T14:05:51.339719+0000","last_clean":"2024-05-10T14:05:51.339719+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:05:51.339719+0000","last_undegraded":"2024-05-10T14:05:51.339719+0000","last_fullsized":"2024-05-10T14:05:51.339719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341931+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:05:51.341931+0000","last_peered":"2024-05-10T14:05:51.341931+0000","last_clean":"2024-05-10T14:05:51.341931+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:05:51.341931+0000","last_undegraded":"2024-05-10T14:05:51.341931+0000","last_fullsized":"2024-05-10T14:05:51.341931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338688+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:05:51.338688+0000","last_peered":"2024-05-10T14:05:51.338688+0000","last_clean":"2024-05-10T14:05:51.338688+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:05:51.338688+0000","last_undegraded":"2024-05-10T14:05:51.338688+0000","last_fullsized":"2024-05-10T14:05:51.338688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338750+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:05:51.338750+0000","last_peered":"2024-05-10T14:05:51.338750+0000","last_clean":"2024-05-10T14:05:51.338750+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:05:51.338750+0000","last_undegraded":"2024-05-10T14:05:51.338750+0000","last_fullsized":"2024-05-10T14:05:51.338750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342998+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:05:51.342998+0000","last_peered":"2024-05-10T14:05:51.342998+0000","last_clean":"2024-05-10T14:05:51.342998+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:05:51.342998+0000","last_undegraded":"2024-05-10T14:05:51.342998+0000","last_fullsized":"2024-05-10T14:05:51.342998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659564+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:05:51.659564+0000","last_peered":"2024-05-10T14:05:51.659564+0000","last_clean":"2024-05-10T14:05:51.659564+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:05:51.659564+0000","last_undegraded":"2024-05-10T14:05:51.659564+0000","last_fullsized":"2024-05-10T14:05:51.659564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339399+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:05:51.339399+0000","last_peered":"2024-05-10T14:05:51.339399+0000","last_clean":"2024-05-10T14:05:51.339399+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:05:51.339399+0000","last_undegraded":"2024-05-10T14:05:51.339399+0000","last_fullsized":"2024-05-10T14:05:51.339399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339678+0000","last_change":"2024-05-10T14:02:32.682975+0000","last_active":"2024-05-10T14:05:51.339678+0000","last_peered":"2024-05-10T14:05:51.339678+0000","last_clean":"2024-05-10T14:05:51.339678+0000","last_became_active":"2024-05-10T14:02:32.682682+0000","last_became_peered":"2024-05-10T14:02:32.682682+0000","last_unstale":"2024-05-10T14:05:51.339678+0000","last_undegraded":"2024-05-10T14:05:51.339678+0000","last_fullsized":"2024-05-10T14:05:51.339678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341370+0000","last_change":"2024-05-10T14:05:17.290958+0000","last_active":"2024-05-10T14:05:51.341370+0000","last_peered":"2024-05-10T14:05:51.341370+0000","last_clean":"2024-05-10T14:05:51.341370+0000","last_became_active":"2024-05-10T14:05:17.290101+0000","last_became_peered":"2024-05-10T14:05:17.290101+0000","last_unstale":"2024-05-10T14:05:51.341370+0000","last_undegraded":"2024-05-10T14:05:51.341370+0000","last_fullsized":"2024-05-10T14:05:51.341370+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:27.117104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592019+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:05:48.592019+0000","last_peered":"2024-05-10T14:05:48.592019+0000","last_clean":"2024-05-10T14:05:48.592019+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:05:48.592019+0000","last_undegraded":"2024-05-10T14:05:48.592019+0000","last_fullsized":"2024-05-10T14:05:48.592019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659528+0000","last_change":"2024-05-10T14:05:17.323385+0000","last_active":"2024-05-10T14:05:51.659528+0000","last_peered":"2024-05-10T14:05:51.659528+0000","last_clean":"2024-05-10T14:05:51.659528+0000","last_became_active":"2024-05-10T14:05:17.300528+0000","last_became_peered":"2024-05-10T14:05:17.300528+0000","last_unstale":"2024-05-10T14:05:51.659528+0000","last_undegraded":"2024-05-10T14:05:51.659528+0000","last_fullsized":"2024-05-10T14:05:51.659528+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:52:04.169092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":120,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593847+0000","last_change":"2024-05-10T14:05:17.310099+0000","last_active":"2024-05-10T14:05:48.593847+0000","last_peered":"2024-05-10T14:05:48.593847+0000","last_clean":"2024-05-10T14:05:48.593847+0000","last_became_active":"2024-05-10T14:05:17.308694+0000","last_became_peered":"2024-05-10T14:05:17.308694+0000","last_unstale":"2024-05-10T14:05:48.593847+0000","last_undegraded":"2024-05-10T14:05:48.593847+0000","last_fullsized":"2024-05-10T14:05:48.593847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:10.446308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":103,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584166+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:05:48.584166+0000","last_peered":"2024-05-10T14:05:48.584166+0000","last_clean":"2024-05-10T14:05:48.584166+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:05:48.584166+0000","last_undegraded":"2024-05-10T14:05:48.584166+0000","last_fullsized":"2024-05-10T14:05:48.584166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590576+0000","last_change":"2024-05-10T14:05:17.316524+0000","last_active":"2024-05-10T14:05:48.590576+0000","last_peered":"2024-05-10T14:05:48.590576+0000","last_clean":"2024-05-10T14:05:48.590576+0000","last_became_active":"2024-05-10T14:05:17.315121+0000","last_became_peered":"2024-05-10T14:05:17.315121+0000","last_unstale":"2024-05-10T14:05:48.590576+0000","last_undegraded":"2024-05-10T14:05:48.590576+0000","last_fullsized":"2024-05-10T14:05:48.590576+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:01:20.607843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":142,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315866+0000","last_change":"2024-05-10T14:05:17.289297+0000","last_active":"2024-05-10T14:05:48.315866+0000","last_peered":"2024-05-10T14:05:48.315866+0000","last_clean":"2024-05-10T14:05:48.315866+0000","last_became_active":"2024-05-10T14:05:17.286429+0000","last_became_peered":"2024-05-10T14:05:17.286429+0000","last_unstale":"2024-05-10T14:05:48.315866+0000","last_undegraded":"2024-05-10T14:05:48.315866+0000","last_fullsized":"2024-05-10T14:05:48.315866+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:38.676231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339487+0000","last_change":"2024-05-10T14:05:17.286410+0000","last_active":"2024-05-10T14:05:51.339487+0000","last_peered":"2024-05-10T14:05:51.339487+0000","last_clean":"2024-05-10T14:05:51.339487+0000","last_became_active":"2024-05-10T14:05:17.285957+0000","last_became_peered":"2024-05-10T14:05:17.285957+0000","last_unstale":"2024-05-10T14:05:51.339487+0000","last_undegraded":"2024-05-10T14:05:51.339487+0000","last_fullsized":"2024-05-10T14:05:51.339487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:52:02.150804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342934+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:05:51.342934+0000","last_peered":"2024-05-10T14:05:51.342934+0000","last_clean":"2024-05-10T14:05:51.342934+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:05:51.342934+0000","last_undegraded":"2024-05-10T14:05:51.342934+0000","last_fullsized":"2024-05-10T14:05:51.342934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342380+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:05:51.342380+0000","last_peered":"2024-05-10T14:05:51.342380+0000","last_clean":"2024-05-10T14:05:51.342380+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:05:51.342380+0000","last_undegraded":"2024-05-10T14:05:51.342380+0000","last_fullsized":"2024-05-10T14:05:51.342380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659157+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:05:51.659157+0000","last_peered":"2024-05-10T14:05:51.659157+0000","last_clean":"2024-05-10T14:05:51.659157+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:05:51.659157+0000","last_undegraded":"2024-05-10T14:05:51.659157+0000","last_fullsized":"2024-05-10T14:05:51.659157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660374+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:05:51.660374+0000","last_peered":"2024-05-10T14:05:51.660374+0000","last_clean":"2024-05-10T14:05:51.660374+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:05:51.660374+0000","last_undegraded":"2024-05-10T14:05:51.660374+0000","last_fullsized":"2024-05-10T14:05:51.660374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340508+0000","last_change":"2024-05-10T14:05:17.329005+0000","last_active":"2024-05-10T14:05:51.340508+0000","last_peered":"2024-05-10T14:05:51.340508+0000","last_clean":"2024-05-10T14:05:51.340508+0000","last_became_active":"2024-05-10T14:05:17.328500+0000","last_became_peered":"2024-05-10T14:05:17.328500+0000","last_unstale":"2024-05-10T14:05:51.340508+0000","last_undegraded":"2024-05-10T14:05:51.340508+0000","last_fullsized":"2024-05-10T14:05:51.340508+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:18.918351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339335+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:05:51.339335+0000","last_peered":"2024-05-10T14:05:51.339335+0000","last_clean":"2024-05-10T14:05:51.339335+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:05:51.339335+0000","last_undegraded":"2024-05-10T14:05:51.339335+0000","last_fullsized":"2024-05-10T14:05:51.339335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338384+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:05:51.338384+0000","last_peered":"2024-05-10T14:05:51.338384+0000","last_clean":"2024-05-10T14:05:51.338384+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:05:51.338384+0000","last_undegraded":"2024-05-10T14:05:51.338384+0000","last_fullsized":"2024-05-10T14:05:51.338384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":196,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316448+0000","last_change":"2024-05-10T14:05:17.319512+0000","last_active":"2024-05-10T14:05:48.316448+0000","last_peered":"2024-05-10T14:05:48.316448+0000","last_clean":"2024-05-10T14:05:48.316448+0000","last_became_active":"2024-05-10T14:05:17.294295+0000","last_became_peered":"2024-05-10T14:05:17.294295+0000","last_unstale":"2024-05-10T14:05:48.316448+0000","last_undegraded":"2024-05-10T14:05:48.316448+0000","last_fullsized":"2024-05-10T14:05:48.316448+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:59.079415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340703+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:05:51.340703+0000","last_peered":"2024-05-10T14:05:51.340703+0000","last_clean":"2024-05-10T14:05:51.340703+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:05:51.340703+0000","last_undegraded":"2024-05-10T14:05:51.340703+0000","last_fullsized":"2024-05-10T14:05:51.340703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338718+0000","last_change":"2024-05-10T14:05:17.290164+0000","last_active":"2024-05-10T14:05:51.338718+0000","last_peered":"2024-05-10T14:05:51.338718+0000","last_clean":"2024-05-10T14:05:51.338718+0000","last_became_active":"2024-05-10T14:05:17.286857+0000","last_became_peered":"2024-05-10T14:05:17.286857+0000","last_unstale":"2024-05-10T14:05:51.338718+0000","last_undegraded":"2024-05-10T14:05:51.338718+0000","last_fullsized":"2024-05-10T14:05:51.338718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:11:20.969931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661156+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:05:51.661156+0000","last_peered":"2024-05-10T14:05:51.661156+0000","last_clean":"2024-05-10T14:05:51.661156+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:05:51.661156+0000","last_undegraded":"2024-05-10T14:05:51.661156+0000","last_fullsized":"2024-05-10T14:05:51.661156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592579+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:05:48.592579+0000","last_peered":"2024-05-10T14:05:48.592579+0000","last_clean":"2024-05-10T14:05:48.592579+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:05:48.592579+0000","last_undegraded":"2024-05-10T14:05:48.592579+0000","last_fullsized":"2024-05-10T14:05:48.592579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663809+0000","last_change":"2024-05-10T14:05:17.382411+0000","last_active":"2024-05-10T14:05:51.663809+0000","last_peered":"2024-05-10T14:05:51.663809+0000","last_clean":"2024-05-10T14:05:51.663809+0000","last_became_active":"2024-05-10T14:05:17.331609+0000","last_became_peered":"2024-05-10T14:05:17.331609+0000","last_unstale":"2024-05-10T14:05:51.663809+0000","last_undegraded":"2024-05-10T14:05:51.663809+0000","last_fullsized":"2024-05-10T14:05:51.663809+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:40.242859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339132+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:05:51.339132+0000","last_peered":"2024-05-10T14:05:51.339132+0000","last_clean":"2024-05-10T14:05:51.339132+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:05:51.339132+0000","last_undegraded":"2024-05-10T14:05:51.339132+0000","last_fullsized":"2024-05-10T14:05:51.339132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.585297+0000","last_change":"2024-05-10T14:05:17.329953+0000","last_active":"2024-05-10T14:05:48.585297+0000","last_peered":"2024-05-10T14:05:48.585297+0000","last_clean":"2024-05-10T14:05:48.585297+0000","last_became_active":"2024-05-10T14:05:17.329389+0000","last_became_peered":"2024-05-10T14:05:17.329389+0000","last_unstale":"2024-05-10T14:05:48.585297+0000","last_undegraded":"2024-05-10T14:05:48.585297+0000","last_fullsized":"2024-05-10T14:05:48.585297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:41:52.177733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343497+0000","last_change":"2024-05-10T14:05:17.307196+0000","last_active":"2024-05-10T14:05:51.343497+0000","last_peered":"2024-05-10T14:05:51.343497+0000","last_clean":"2024-05-10T14:05:51.343497+0000","last_became_active":"2024-05-10T14:05:17.300975+0000","last_became_peered":"2024-05-10T14:05:17.300975+0000","last_unstale":"2024-05-10T14:05:51.343497+0000","last_undegraded":"2024-05-10T14:05:51.343497+0000","last_fullsized":"2024-05-10T14:05:51.343497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:54:50.675218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660787+0000","last_change":"2024-05-10T14:05:17.325788+0000","last_active":"2024-05-10T14:05:51.660787+0000","last_peered":"2024-05-10T14:05:51.660787+0000","last_clean":"2024-05-10T14:05:51.660787+0000","last_became_active":"2024-05-10T14:05:17.318528+0000","last_became_peered":"2024-05-10T14:05:17.318528+0000","last_unstale":"2024-05-10T14:05:51.660787+0000","last_undegraded":"2024-05-10T14:05:51.660787+0000","last_fullsized":"2024-05-10T14:05:51.660787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:19.277081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":145,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586730+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:05:48.586730+0000","last_peered":"2024-05-10T14:05:48.586730+0000","last_clean":"2024-05-10T14:05:48.586730+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:05:48.586730+0000","last_undegraded":"2024-05-10T14:05:48.586730+0000","last_fullsized":"2024-05-10T14:05:48.586730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":178,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316571+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:05:48.316571+0000","last_peered":"2024-05-10T14:05:48.316571+0000","last_clean":"2024-05-10T14:05:48.316571+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:05:48.316571+0000","last_undegraded":"2024-05-10T14:05:48.316571+0000","last_fullsized":"2024-05-10T14:05:48.316571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592060+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:05:48.592060+0000","last_peered":"2024-05-10T14:05:48.592060+0000","last_clean":"2024-05-10T14:05:48.592060+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:05:48.592060+0000","last_undegraded":"2024-05-10T14:05:48.592060+0000","last_fullsized":"2024-05-10T14:05:48.592060+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340761+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:05:51.340761+0000","last_peered":"2024-05-10T14:05:51.340761+0000","last_clean":"2024-05-10T14:05:51.340761+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:05:51.340761+0000","last_undegraded":"2024-05-10T14:05:51.340761+0000","last_fullsized":"2024-05-10T14:05:51.340761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343502+0000","last_change":"2024-05-10T14:05:17.307271+0000","last_active":"2024-05-10T14:05:51.343502+0000","last_peered":"2024-05-10T14:05:51.343502+0000","last_clean":"2024-05-10T14:05:51.343502+0000","last_became_active":"2024-05-10T14:05:17.300871+0000","last_became_peered":"2024-05-10T14:05:17.300871+0000","last_unstale":"2024-05-10T14:05:51.343502+0000","last_undegraded":"2024-05-10T14:05:51.343502+0000","last_fullsized":"2024-05-10T14:05:51.343502+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:48.902158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337963+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:05:51.337963+0000","last_peered":"2024-05-10T14:05:51.337963+0000","last_clean":"2024-05-10T14:05:51.337963+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:05:51.337963+0000","last_undegraded":"2024-05-10T14:05:51.337963+0000","last_fullsized":"2024-05-10T14:05:51.337963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340254+0000","last_change":"2024-05-10T14:05:17.304071+0000","last_active":"2024-05-10T14:05:51.340254+0000","last_peered":"2024-05-10T14:05:51.340254+0000","last_clean":"2024-05-10T14:05:51.340254+0000","last_became_active":"2024-05-10T14:05:17.293002+0000","last_became_peered":"2024-05-10T14:05:17.293002+0000","last_unstale":"2024-05-10T14:05:51.340254+0000","last_undegraded":"2024-05-10T14:05:51.340254+0000","last_fullsized":"2024-05-10T14:05:51.340254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:34.033853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337726+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:05:51.337726+0000","last_peered":"2024-05-10T14:05:51.337726+0000","last_clean":"2024-05-10T14:05:51.337726+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:05:51.337726+0000","last_undegraded":"2024-05-10T14:05:51.337726+0000","last_fullsized":"2024-05-10T14:05:51.337726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661106+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:05:51.661106+0000","last_peered":"2024-05-10T14:05:51.661106+0000","last_clean":"2024-05-10T14:05:51.661106+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:05:51.661106+0000","last_undegraded":"2024-05-10T14:05:51.661106+0000","last_fullsized":"2024-05-10T14:05:51.661106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661000+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:05:51.661000+0000","last_peered":"2024-05-10T14:05:51.661000+0000","last_clean":"2024-05-10T14:05:51.661000+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:05:51.661000+0000","last_undegraded":"2024-05-10T14:05:51.661000+0000","last_fullsized":"2024-05-10T14:05:51.661000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591002+0000","last_change":"2024-05-10T14:05:17.336003+0000","last_active":"2024-05-10T14:05:48.591002+0000","last_peered":"2024-05-10T14:05:48.591002+0000","last_clean":"2024-05-10T14:05:48.591002+0000","last_became_active":"2024-05-10T14:05:17.335538+0000","last_became_peered":"2024-05-10T14:05:17.335538+0000","last_unstale":"2024-05-10T14:05:48.591002+0000","last_undegraded":"2024-05-10T14:05:48.591002+0000","last_fullsized":"2024-05-10T14:05:48.591002+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:34.119071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340062+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:05:51.340062+0000","last_peered":"2024-05-10T14:05:51.340062+0000","last_clean":"2024-05-10T14:05:51.340062+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:05:51.340062+0000","last_undegraded":"2024-05-10T14:05:51.340062+0000","last_fullsized":"2024-05-10T14:05:51.340062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":99,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337865+0000","last_change":"2024-05-10T14:05:17.314577+0000","last_active":"2024-05-10T14:05:51.337865+0000","last_peered":"2024-05-10T14:05:51.337865+0000","last_clean":"2024-05-10T14:05:51.337865+0000","last_became_active":"2024-05-10T14:05:17.296146+0000","last_became_peered":"2024-05-10T14:05:17.296146+0000","last_unstale":"2024-05-10T14:05:51.337865+0000","last_undegraded":"2024-05-10T14:05:51.337865+0000","last_fullsized":"2024-05-10T14:05:51.337865+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:16.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658497+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:05:51.658497+0000","last_peered":"2024-05-10T14:05:51.658497+0000","last_clean":"2024-05-10T14:05:51.658497+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:05:51.658497+0000","last_undegraded":"2024-05-10T14:05:51.658497+0000","last_fullsized":"2024-05-10T14:05:51.658497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659814+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:05:51.659814+0000","last_peered":"2024-05-10T14:05:51.659814+0000","last_clean":"2024-05-10T14:05:51.659814+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:05:51.659814+0000","last_undegraded":"2024-05-10T14:05:51.659814+0000","last_fullsized":"2024-05-10T14:05:51.659814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660051+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:05:51.660051+0000","last_peered":"2024-05-10T14:05:51.660051+0000","last_clean":"2024-05-10T14:05:51.660051+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:05:51.660051+0000","last_undegraded":"2024-05-10T14:05:51.660051+0000","last_fullsized":"2024-05-10T14:05:51.660051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590546+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:05:48.590546+0000","last_peered":"2024-05-10T14:05:48.590546+0000","last_clean":"2024-05-10T14:05:48.590546+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:05:48.590546+0000","last_undegraded":"2024-05-10T14:05:48.590546+0000","last_fullsized":"2024-05-10T14:05:48.590546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339148+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:05:51.339148+0000","last_peered":"2024-05-10T14:05:51.339148+0000","last_clean":"2024-05-10T14:05:51.339148+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:05:51.339148+0000","last_undegraded":"2024-05-10T14:05:51.339148+0000","last_fullsized":"2024-05-10T14:05:51.339148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658828+0000","last_change":"2024-05-10T14:05:17.316461+0000","last_active":"2024-05-10T14:05:51.658828+0000","last_peered":"2024-05-10T14:05:51.658828+0000","last_clean":"2024-05-10T14:05:51.658828+0000","last_became_active":"2024-05-10T14:05:17.291102+0000","last_became_peered":"2024-05-10T14:05:17.291102+0000","last_unstale":"2024-05-10T14:05:51.658828+0000","last_undegraded":"2024-05-10T14:05:51.658828+0000","last_fullsized":"2024-05-10T14:05:51.658828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:36.011027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337755+0000","last_change":"2024-05-10T14:05:17.286796+0000","last_active":"2024-05-10T14:05:51.337755+0000","last_peered":"2024-05-10T14:05:51.337755+0000","last_clean":"2024-05-10T14:05:51.337755+0000","last_became_active":"2024-05-10T14:05:17.286392+0000","last_became_peered":"2024-05-10T14:05:17.286392+0000","last_unstale":"2024-05-10T14:05:51.337755+0000","last_undegraded":"2024-05-10T14:05:51.337755+0000","last_fullsized":"2024-05-10T14:05:51.337755+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:53.061423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":169,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317260+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:05:48.317260+0000","last_peered":"2024-05-10T14:05:48.317260+0000","last_clean":"2024-05-10T14:05:48.317260+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:05:48.317260+0000","last_undegraded":"2024-05-10T14:05:48.317260+0000","last_fullsized":"2024-05-10T14:05:48.317260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343743+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:05:51.343743+0000","last_peered":"2024-05-10T14:05:51.343743+0000","last_clean":"2024-05-10T14:05:51.343743+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:05:51.343743+0000","last_undegraded":"2024-05-10T14:05:51.343743+0000","last_fullsized":"2024-05-10T14:05:51.343743+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338435+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:05:51.338435+0000","last_peered":"2024-05-10T14:05:51.338435+0000","last_clean":"2024-05-10T14:05:51.338435+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:05:51.338435+0000","last_undegraded":"2024-05-10T14:05:51.338435+0000","last_fullsized":"2024-05-10T14:05:51.338435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340475+0000","last_change":"2024-05-10T14:05:17.317624+0000","last_active":"2024-05-10T14:05:51.340475+0000","last_peered":"2024-05-10T14:05:51.340475+0000","last_clean":"2024-05-10T14:05:51.340475+0000","last_became_active":"2024-05-10T14:05:17.317305+0000","last_became_peered":"2024-05-10T14:05:17.317305+0000","last_unstale":"2024-05-10T14:05:51.340475+0000","last_undegraded":"2024-05-10T14:05:51.340475+0000","last_fullsized":"2024-05-10T14:05:51.340475+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:43.831375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342666+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:05:51.342666+0000","last_peered":"2024-05-10T14:05:51.342666+0000","last_clean":"2024-05-10T14:05:51.342666+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:05:51.342666+0000","last_undegraded":"2024-05-10T14:05:51.342666+0000","last_fullsized":"2024-05-10T14:05:51.342666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660057+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:05:51.660057+0000","last_peered":"2024-05-10T14:05:51.660057+0000","last_clean":"2024-05-10T14:05:51.660057+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:05:51.660057+0000","last_undegraded":"2024-05-10T14:05:51.660057+0000","last_fullsized":"2024-05-10T14:05:51.660057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338014+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:05:51.338014+0000","last_peered":"2024-05-10T14:05:51.338014+0000","last_clean":"2024-05-10T14:05:51.338014+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:05:51.338014+0000","last_undegraded":"2024-05-10T14:05:51.338014+0000","last_fullsized":"2024-05-10T14:05:51.338014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343439+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:05:51.343439+0000","last_peered":"2024-05-10T14:05:51.343439+0000","last_clean":"2024-05-10T14:05:51.343439+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:05:51.343439+0000","last_undegraded":"2024-05-10T14:05:51.343439+0000","last_fullsized":"2024-05-10T14:05:51.343439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661279+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:05:51.661279+0000","last_peered":"2024-05-10T14:05:51.661279+0000","last_clean":"2024-05-10T14:05:51.661279+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:05:51.661279+0000","last_undegraded":"2024-05-10T14:05:51.661279+0000","last_fullsized":"2024-05-10T14:05:51.661279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316155+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:05:48.316155+0000","last_peered":"2024-05-10T14:05:48.316155+0000","last_clean":"2024-05-10T14:05:48.316155+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:05:48.316155+0000","last_undegraded":"2024-05-10T14:05:48.316155+0000","last_fullsized":"2024-05-10T14:05:48.316155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341117+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:05:51.341117+0000","last_peered":"2024-05-10T14:05:51.341117+0000","last_clean":"2024-05-10T14:05:51.341117+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:05:51.341117+0000","last_undegraded":"2024-05-10T14:05:51.341117+0000","last_fullsized":"2024-05-10T14:05:51.341117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337871+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:05:51.337871+0000","last_peered":"2024-05-10T14:05:51.337871+0000","last_clean":"2024-05-10T14:05:51.337871+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:05:51.337871+0000","last_undegraded":"2024-05-10T14:05:51.337871+0000","last_fullsized":"2024-05-10T14:05:51.337871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315964+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:05:48.315964+0000","last_peered":"2024-05-10T14:05:48.315964+0000","last_clean":"2024-05-10T14:05:48.315964+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:05:48.315964+0000","last_undegraded":"2024-05-10T14:05:48.315964+0000","last_fullsized":"2024-05-10T14:05:48.315964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343219+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:05:51.343219+0000","last_peered":"2024-05-10T14:05:51.343219+0000","last_clean":"2024-05-10T14:05:51.343219+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:05:51.343219+0000","last_undegraded":"2024-05-10T14:05:51.343219+0000","last_fullsized":"2024-05-10T14:05:51.343219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339808+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:05:51.339808+0000","last_peered":"2024-05-10T14:05:51.339808+0000","last_clean":"2024-05-10T14:05:51.339808+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:05:51.339808+0000","last_undegraded":"2024-05-10T14:05:51.339808+0000","last_fullsized":"2024-05-10T14:05:51.339808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":128,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.594071+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:05:48.594071+0000","last_peered":"2024-05-10T14:05:48.594071+0000","last_clean":"2024-05-10T14:05:48.594071+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:05:48.594071+0000","last_undegraded":"2024-05-10T14:05:48.594071+0000","last_fullsized":"2024-05-10T14:05:48.594071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339181+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:05:51.339181+0000","last_peered":"2024-05-10T14:05:51.339181+0000","last_clean":"2024-05-10T14:05:51.339181+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:05:51.339181+0000","last_undegraded":"2024-05-10T14:05:51.339181+0000","last_fullsized":"2024-05-10T14:05:51.339181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663753+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:05:51.663753+0000","last_peered":"2024-05-10T14:05:51.663753+0000","last_clean":"2024-05-10T14:05:51.663753+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:05:51.663753+0000","last_undegraded":"2024-05-10T14:05:51.663753+0000","last_fullsized":"2024-05-10T14:05:51.663753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341496+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:05:51.341496+0000","last_peered":"2024-05-10T14:05:51.341496+0000","last_clean":"2024-05-10T14:05:51.341496+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:05:51.341496+0000","last_undegraded":"2024-05-10T14:05:51.341496+0000","last_fullsized":"2024-05-10T14:05:51.341496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317581+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:05:48.317581+0000","last_peered":"2024-05-10T14:05:48.317581+0000","last_clean":"2024-05-10T14:05:48.317581+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:05:48.317581+0000","last_undegraded":"2024-05-10T14:05:48.317581+0000","last_fullsized":"2024-05-10T14:05:48.317581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337139+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:05:51.337139+0000","last_peered":"2024-05-10T14:05:51.337139+0000","last_clean":"2024-05-10T14:05:51.337139+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:05:51.337139+0000","last_undegraded":"2024-05-10T14:05:51.337139+0000","last_fullsized":"2024-05-10T14:05:51.337139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342957+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:05:51.342957+0000","last_peered":"2024-05-10T14:05:51.342957+0000","last_clean":"2024-05-10T14:05:51.342957+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:05:51.342957+0000","last_undegraded":"2024-05-10T14:05:51.342957+0000","last_fullsized":"2024-05-10T14:05:51.342957+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":142,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592376+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:05:48.592376+0000","last_peered":"2024-05-10T14:05:48.592376+0000","last_clean":"2024-05-10T14:05:48.592376+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:05:48.592376+0000","last_undegraded":"2024-05-10T14:05:48.592376+0000","last_fullsized":"2024-05-10T14:05:48.592376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.663631+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:05:51.663631+0000","last_peered":"2024-05-10T14:05:51.663631+0000","last_clean":"2024-05-10T14:05:51.663631+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:05:51.663631+0000","last_undegraded":"2024-05-10T14:05:51.663631+0000","last_fullsized":"2024-05-10T14:05:51.663631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":174,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315837+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:05:48.315837+0000","last_peered":"2024-05-10T14:05:48.315837+0000","last_clean":"2024-05-10T14:05:48.315837+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:05:48.315837+0000","last_undegraded":"2024-05-10T14:05:48.315837+0000","last_fullsized":"2024-05-10T14:05:48.315837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664342+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:05:51.664342+0000","last_peered":"2024-05-10T14:05:51.664342+0000","last_clean":"2024-05-10T14:05:51.664342+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:05:51.664342+0000","last_undegraded":"2024-05-10T14:05:51.664342+0000","last_fullsized":"2024-05-10T14:05:51.664342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658264+0000","last_change":"2024-05-10T14:05:17.354857+0000","last_active":"2024-05-10T14:05:51.658264+0000","last_peered":"2024-05-10T14:05:51.658264+0000","last_clean":"2024-05-10T14:05:51.658264+0000","last_became_active":"2024-05-10T14:05:17.320795+0000","last_became_peered":"2024-05-10T14:05:17.320795+0000","last_unstale":"2024-05-10T14:05:51.658264+0000","last_undegraded":"2024-05-10T14:05:51.658264+0000","last_fullsized":"2024-05-10T14:05:51.658264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:11:07.864891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586343+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:05:48.586343+0000","last_peered":"2024-05-10T14:05:48.586343+0000","last_clean":"2024-05-10T14:05:48.586343+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:05:48.586343+0000","last_undegraded":"2024-05-10T14:05:48.586343+0000","last_fullsized":"2024-05-10T14:05:48.586343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338151+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:05:51.338151+0000","last_peered":"2024-05-10T14:05:51.338151+0000","last_clean":"2024-05-10T14:05:51.338151+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:05:51.338151+0000","last_undegraded":"2024-05-10T14:05:51.338151+0000","last_fullsized":"2024-05-10T14:05:51.338151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338486+0000","last_change":"2024-05-10T14:05:17.313576+0000","last_active":"2024-05-10T14:05:51.338486+0000","last_peered":"2024-05-10T14:05:51.338486+0000","last_clean":"2024-05-10T14:05:51.338486+0000","last_became_active":"2024-05-10T14:05:17.313245+0000","last_became_peered":"2024-05-10T14:05:17.313245+0000","last_unstale":"2024-05-10T14:05:51.338486+0000","last_undegraded":"2024-05-10T14:05:51.338486+0000","last_fullsized":"2024-05-10T14:05:51.338486+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:22.410591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593386+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:05:48.593386+0000","last_peered":"2024-05-10T14:05:48.593386+0000","last_clean":"2024-05-10T14:05:48.593386+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:05:48.593386+0000","last_undegraded":"2024-05-10T14:05:48.593386+0000","last_fullsized":"2024-05-10T14:05:48.593386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659998+0000","last_change":"2024-05-10T14:05:17.299690+0000","last_active":"2024-05-10T14:05:51.659998+0000","last_peered":"2024-05-10T14:05:51.659998+0000","last_clean":"2024-05-10T14:05:51.659998+0000","last_became_active":"2024-05-10T14:05:17.299332+0000","last_became_peered":"2024-05-10T14:05:17.299332+0000","last_unstale":"2024-05-10T14:05:51.659998+0000","last_undegraded":"2024-05-10T14:05:51.659998+0000","last_fullsized":"2024-05-10T14:05:51.659998+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:32.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659964+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:05:51.659964+0000","last_peered":"2024-05-10T14:05:51.659964+0000","last_clean":"2024-05-10T14:05:51.659964+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:05:51.659964+0000","last_undegraded":"2024-05-10T14:05:51.659964+0000","last_fullsized":"2024-05-10T14:05:51.659964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660226+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:05:51.660226+0000","last_peered":"2024-05-10T14:05:51.660226+0000","last_clean":"2024-05-10T14:05:51.660226+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:05:51.660226+0000","last_undegraded":"2024-05-10T14:05:51.660226+0000","last_fullsized":"2024-05-10T14:05:51.660226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315201+0000","last_change":"2024-05-10T14:05:17.289458+0000","last_active":"2024-05-10T14:05:48.315201+0000","last_peered":"2024-05-10T14:05:48.315201+0000","last_clean":"2024-05-10T14:05:48.315201+0000","last_became_active":"2024-05-10T14:05:17.289122+0000","last_became_peered":"2024-05-10T14:05:17.289122+0000","last_unstale":"2024-05-10T14:05:48.315201+0000","last_undegraded":"2024-05-10T14:05:48.315201+0000","last_fullsized":"2024-05-10T14:05:48.315201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:46.862871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658936+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:05:51.658936+0000","last_peered":"2024-05-10T14:05:51.658936+0000","last_clean":"2024-05-10T14:05:51.658936+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:05:51.658936+0000","last_undegraded":"2024-05-10T14:05:51.658936+0000","last_fullsized":"2024-05-10T14:05:51.658936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.593577+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:05:48.593577+0000","last_peered":"2024-05-10T14:05:48.593577+0000","last_clean":"2024-05-10T14:05:48.593577+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:05:48.593577+0000","last_undegraded":"2024-05-10T14:05:48.593577+0000","last_fullsized":"2024-05-10T14:05:48.593577+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":262,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316099+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:05:48.316099+0000","last_peered":"2024-05-10T14:05:48.316099+0000","last_clean":"2024-05-10T14:05:48.316099+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:05:48.316099+0000","last_undegraded":"2024-05-10T14:05:48.316099+0000","last_fullsized":"2024-05-10T14:05:48.316099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340617+0000","last_change":"2024-05-10T14:05:17.288435+0000","last_active":"2024-05-10T14:05:51.340617+0000","last_peered":"2024-05-10T14:05:51.340617+0000","last_clean":"2024-05-10T14:05:51.340617+0000","last_became_active":"2024-05-10T14:05:17.287979+0000","last_became_peered":"2024-05-10T14:05:17.287979+0000","last_unstale":"2024-05-10T14:05:51.340617+0000","last_undegraded":"2024-05-10T14:05:51.340617+0000","last_fullsized":"2024-05-10T14:05:51.340617+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315837+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:05:48.315837+0000","last_peered":"2024-05-10T14:05:48.315837+0000","last_clean":"2024-05-10T14:05:48.315837+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:05:48.315837+0000","last_undegraded":"2024-05-10T14:05:48.315837+0000","last_fullsized":"2024-05-10T14:05:48.315837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":192,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317674+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:05:48.317674+0000","last_peered":"2024-05-10T14:05:48.317674+0000","last_clean":"2024-05-10T14:05:48.317674+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:05:48.317674+0000","last_undegraded":"2024-05-10T14:05:48.317674+0000","last_fullsized":"2024-05-10T14:05:48.317674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338666+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:05:51.338666+0000","last_peered":"2024-05-10T14:05:51.338666+0000","last_clean":"2024-05-10T14:05:51.338666+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:05:51.338666+0000","last_undegraded":"2024-05-10T14:05:51.338666+0000","last_fullsized":"2024-05-10T14:05:51.338666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315224+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:05:48.315224+0000","last_peered":"2024-05-10T14:05:48.315224+0000","last_clean":"2024-05-10T14:05:48.315224+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:05:48.315224+0000","last_undegraded":"2024-05-10T14:05:48.315224+0000","last_fullsized":"2024-05-10T14:05:48.315224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338033+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:05:51.338033+0000","last_peered":"2024-05-10T14:05:51.338033+0000","last_clean":"2024-05-10T14:05:51.338033+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:05:51.338033+0000","last_undegraded":"2024-05-10T14:05:51.338033+0000","last_fullsized":"2024-05-10T14:05:51.338033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664108+0000","last_change":"2024-05-10T14:05:17.370707+0000","last_active":"2024-05-10T14:05:51.664108+0000","last_peered":"2024-05-10T14:05:51.664108+0000","last_clean":"2024-05-10T14:05:51.664108+0000","last_became_active":"2024-05-10T14:05:17.328233+0000","last_became_peered":"2024-05-10T14:05:17.328233+0000","last_unstale":"2024-05-10T14:05:51.664108+0000","last_undegraded":"2024-05-10T14:05:51.664108+0000","last_fullsized":"2024-05-10T14:05:51.664108+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:04:11.721159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659359+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:05:51.659359+0000","last_peered":"2024-05-10T14:05:51.659359+0000","last_clean":"2024-05-10T14:05:51.659359+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:05:51.659359+0000","last_undegraded":"2024-05-10T14:05:51.659359+0000","last_fullsized":"2024-05-10T14:05:51.659359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338940+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:05:51.338940+0000","last_peered":"2024-05-10T14:05:51.338940+0000","last_clean":"2024-05-10T14:05:51.338940+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:05:51.338940+0000","last_undegraded":"2024-05-10T14:05:51.338940+0000","last_fullsized":"2024-05-10T14:05:51.338940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316440+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:05:48.316440+0000","last_peered":"2024-05-10T14:05:48.316440+0000","last_clean":"2024-05-10T14:05:48.316440+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:05:48.316440+0000","last_undegraded":"2024-05-10T14:05:48.316440+0000","last_fullsized":"2024-05-10T14:05:48.316440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584279+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:05:48.584279+0000","last_peered":"2024-05-10T14:05:48.584279+0000","last_clean":"2024-05-10T14:05:48.584279+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:05:48.584279+0000","last_undegraded":"2024-05-10T14:05:48.584279+0000","last_fullsized":"2024-05-10T14:05:48.584279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341641+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:05:51.341641+0000","last_peered":"2024-05-10T14:05:51.341641+0000","last_clean":"2024-05-10T14:05:51.341641+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:05:51.341641+0000","last_undegraded":"2024-05-10T14:05:51.341641+0000","last_fullsized":"2024-05-10T14:05:51.341641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659805+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:05:51.659805+0000","last_peered":"2024-05-10T14:05:51.659805+0000","last_clean":"2024-05-10T14:05:51.659805+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:05:51.659805+0000","last_undegraded":"2024-05-10T14:05:51.659805+0000","last_fullsized":"2024-05-10T14:05:51.659805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340834+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:05:51.340834+0000","last_peered":"2024-05-10T14:05:51.340834+0000","last_clean":"2024-05-10T14:05:51.340834+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:05:51.340834+0000","last_undegraded":"2024-05-10T14:05:51.340834+0000","last_fullsized":"2024-05-10T14:05:51.340834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664549+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:05:51.664549+0000","last_peered":"2024-05-10T14:05:51.664549+0000","last_clean":"2024-05-10T14:05:51.664549+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:05:51.664549+0000","last_undegraded":"2024-05-10T14:05:51.664549+0000","last_fullsized":"2024-05-10T14:05:51.664549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589776+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:05:48.589776+0000","last_peered":"2024-05-10T14:05:48.589776+0000","last_clean":"2024-05-10T14:05:48.589776+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:05:48.589776+0000","last_undegraded":"2024-05-10T14:05:48.589776+0000","last_fullsized":"2024-05-10T14:05:48.589776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":192,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316710+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:05:48.316710+0000","last_peered":"2024-05-10T14:05:48.316710+0000","last_clean":"2024-05-10T14:05:48.316710+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:05:48.316710+0000","last_undegraded":"2024-05-10T14:05:48.316710+0000","last_fullsized":"2024-05-10T14:05:48.316710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340376+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:05:51.340376+0000","last_peered":"2024-05-10T14:05:51.340376+0000","last_clean":"2024-05-10T14:05:51.340376+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:05:51.340376+0000","last_undegraded":"2024-05-10T14:05:51.340376+0000","last_fullsized":"2024-05-10T14:05:51.340376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316775+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:05:48.316775+0000","last_peered":"2024-05-10T14:05:48.316775+0000","last_clean":"2024-05-10T14:05:48.316775+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:05:48.316775+0000","last_undegraded":"2024-05-10T14:05:48.316775+0000","last_fullsized":"2024-05-10T14:05:48.316775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659611+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:05:51.659611+0000","last_peered":"2024-05-10T14:05:51.659611+0000","last_clean":"2024-05-10T14:05:51.659611+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:05:51.659611+0000","last_undegraded":"2024-05-10T14:05:51.659611+0000","last_fullsized":"2024-05-10T14:05:51.659611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658029+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:05:51.658029+0000","last_peered":"2024-05-10T14:05:51.658029+0000","last_clean":"2024-05-10T14:05:51.658029+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:05:51.658029+0000","last_undegraded":"2024-05-10T14:05:51.658029+0000","last_fullsized":"2024-05-10T14:05:51.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341429+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:05:51.341429+0000","last_peered":"2024-05-10T14:05:51.341429+0000","last_clean":"2024-05-10T14:05:51.341429+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:05:51.341429+0000","last_undegraded":"2024-05-10T14:05:51.341429+0000","last_fullsized":"2024-05-10T14:05:51.341429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659356+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:05:51.659356+0000","last_peered":"2024-05-10T14:05:51.659356+0000","last_clean":"2024-05-10T14:05:51.659356+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:05:51.659356+0000","last_undegraded":"2024-05-10T14:05:51.659356+0000","last_fullsized":"2024-05-10T14:05:51.659356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659938+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:05:51.659938+0000","last_peered":"2024-05-10T14:05:51.659938+0000","last_clean":"2024-05-10T14:05:51.659938+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:05:51.659938+0000","last_undegraded":"2024-05-10T14:05:51.659938+0000","last_fullsized":"2024-05-10T14:05:51.659938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316560+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:05:48.316560+0000","last_peered":"2024-05-10T14:05:48.316560+0000","last_clean":"2024-05-10T14:05:48.316560+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:05:48.316560+0000","last_undegraded":"2024-05-10T14:05:48.316560+0000","last_fullsized":"2024-05-10T14:05:48.316560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660026+0000","last_change":"2024-05-10T14:05:17.305129+0000","last_active":"2024-05-10T14:05:51.660026+0000","last_peered":"2024-05-10T14:05:51.660026+0000","last_clean":"2024-05-10T14:05:51.660026+0000","last_became_active":"2024-05-10T14:05:17.304295+0000","last_became_peered":"2024-05-10T14:05:17.304295+0000","last_unstale":"2024-05-10T14:05:51.660026+0000","last_undegraded":"2024-05-10T14:05:51.660026+0000","last_fullsized":"2024-05-10T14:05:51.660026+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:58.234019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660534+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:05:51.660534+0000","last_peered":"2024-05-10T14:05:51.660534+0000","last_clean":"2024-05-10T14:05:51.660534+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:05:51.660534+0000","last_undegraded":"2024-05-10T14:05:51.660534+0000","last_fullsized":"2024-05-10T14:05:51.660534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":196,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.314975+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:05:48.314975+0000","last_peered":"2024-05-10T14:05:48.314975+0000","last_clean":"2024-05-10T14:05:48.314975+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:05:48.314975+0000","last_undegraded":"2024-05-10T14:05:48.314975+0000","last_fullsized":"2024-05-10T14:05:48.314975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":119,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588463+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:05:48.588463+0000","last_peered":"2024-05-10T14:05:48.588463+0000","last_clean":"2024-05-10T14:05:48.588463+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:05:48.588463+0000","last_undegraded":"2024-05-10T14:05:48.588463+0000","last_fullsized":"2024-05-10T14:05:48.588463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338902+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:05:51.338902+0000","last_peered":"2024-05-10T14:05:51.338902+0000","last_clean":"2024-05-10T14:05:51.338902+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:05:51.338902+0000","last_undegraded":"2024-05-10T14:05:51.338902+0000","last_fullsized":"2024-05-10T14:05:51.338902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337582+0000","last_change":"2024-05-10T14:05:17.294354+0000","last_active":"2024-05-10T14:05:51.337582+0000","last_peered":"2024-05-10T14:05:51.337582+0000","last_clean":"2024-05-10T14:05:51.337582+0000","last_became_active":"2024-05-10T14:05:17.293930+0000","last_became_peered":"2024-05-10T14:05:17.293930+0000","last_unstale":"2024-05-10T14:05:51.337582+0000","last_undegraded":"2024-05-10T14:05:51.337582+0000","last_fullsized":"2024-05-10T14:05:51.337582+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:44:28.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338568+0000","last_change":"2024-05-10T14:05:17.293374+0000","last_active":"2024-05-10T14:05:51.338568+0000","last_peered":"2024-05-10T14:05:51.338568+0000","last_clean":"2024-05-10T14:05:51.338568+0000","last_became_active":"2024-05-10T14:05:17.293062+0000","last_became_peered":"2024-05-10T14:05:17.293062+0000","last_unstale":"2024-05-10T14:05:51.338568+0000","last_undegraded":"2024-05-10T14:05:51.338568+0000","last_fullsized":"2024-05-10T14:05:51.338568+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:21.545080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.318060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:05:48.318060+0000","last_peered":"2024-05-10T14:05:48.318060+0000","last_clean":"2024-05-10T14:05:48.318060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:05:48.318060+0000","last_undegraded":"2024-05-10T14:05:48.318060+0000","last_fullsized":"2024-05-10T14:05:48.318060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341050+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:05:51.341050+0000","last_peered":"2024-05-10T14:05:51.341050+0000","last_clean":"2024-05-10T14:05:51.341050+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:05:51.341050+0000","last_undegraded":"2024-05-10T14:05:51.341050+0000","last_fullsized":"2024-05-10T14:05:51.341050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341302+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:05:51.341302+0000","last_peered":"2024-05-10T14:05:51.341302+0000","last_clean":"2024-05-10T14:05:51.341302+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:05:51.341302+0000","last_undegraded":"2024-05-10T14:05:51.341302+0000","last_fullsized":"2024-05-10T14:05:51.341302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340710+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:05:51.340710+0000","last_peered":"2024-05-10T14:05:51.340710+0000","last_clean":"2024-05-10T14:05:51.340710+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:05:51.340710+0000","last_undegraded":"2024-05-10T14:05:51.340710+0000","last_fullsized":"2024-05-10T14:05:51.340710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659464+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:05:51.659464+0000","last_peered":"2024-05-10T14:05:51.659464+0000","last_clean":"2024-05-10T14:05:51.659464+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:05:51.659464+0000","last_undegraded":"2024-05-10T14:05:51.659464+0000","last_fullsized":"2024-05-10T14:05:51.659464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340208+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:05:51.340208+0000","last_peered":"2024-05-10T14:05:51.340208+0000","last_clean":"2024-05-10T14:05:51.340208+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:05:51.340208+0000","last_undegraded":"2024-05-10T14:05:51.340208+0000","last_fullsized":"2024-05-10T14:05:51.340208+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660492+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:05:51.660492+0000","last_peered":"2024-05-10T14:05:51.660492+0000","last_clean":"2024-05-10T14:05:51.660492+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:05:51.660492+0000","last_undegraded":"2024-05-10T14:05:51.660492+0000","last_fullsized":"2024-05-10T14:05:51.660492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665396+0000","last_change":"2024-05-10T14:05:17.325615+0000","last_active":"2024-05-10T14:05:51.665396+0000","last_peered":"2024-05-10T14:05:51.665396+0000","last_clean":"2024-05-10T14:05:51.665396+0000","last_became_active":"2024-05-10T14:05:17.318529+0000","last_became_peered":"2024-05-10T14:05:17.318529+0000","last_unstale":"2024-05-10T14:05:51.665396+0000","last_undegraded":"2024-05-10T14:05:51.665396+0000","last_fullsized":"2024-05-10T14:05:51.665396+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:36.085486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337766+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:05:51.337766+0000","last_peered":"2024-05-10T14:05:51.337766+0000","last_clean":"2024-05-10T14:05:51.337766+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:05:51.337766+0000","last_undegraded":"2024-05-10T14:05:51.337766+0000","last_fullsized":"2024-05-10T14:05:51.337766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":112,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661590+0000","last_change":"2024-05-10T14:05:17.358122+0000","last_active":"2024-05-10T14:05:51.661590+0000","last_peered":"2024-05-10T14:05:51.661590+0000","last_clean":"2024-05-10T14:05:51.661590+0000","last_became_active":"2024-05-10T14:05:17.318464+0000","last_became_peered":"2024-05-10T14:05:17.318464+0000","last_unstale":"2024-05-10T14:05:51.661590+0000","last_undegraded":"2024-05-10T14:05:51.661590+0000","last_fullsized":"2024-05-10T14:05:51.661590+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:30:24.279780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337826+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:05:51.337826+0000","last_peered":"2024-05-10T14:05:51.337826+0000","last_clean":"2024-05-10T14:05:51.337826+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:05:51.337826+0000","last_undegraded":"2024-05-10T14:05:51.337826+0000","last_fullsized":"2024-05-10T14:05:51.337826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":115,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591978+0000","last_change":"2024-05-10T14:05:17.361139+0000","last_active":"2024-05-10T14:05:48.591978+0000","last_peered":"2024-05-10T14:05:48.591978+0000","last_clean":"2024-05-10T14:05:48.591978+0000","last_became_active":"2024-05-10T14:05:17.298778+0000","last_became_peered":"2024-05-10T14:05:17.298778+0000","last_unstale":"2024-05-10T14:05:48.591978+0000","last_undegraded":"2024-05-10T14:05:48.591978+0000","last_fullsized":"2024-05-10T14:05:48.591978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:06.452122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":406,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659744+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:05:51.659744+0000","last_peered":"2024-05-10T14:05:51.659744+0000","last_clean":"2024-05-10T14:05:51.659744+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:05:51.659744+0000","last_undegraded":"2024-05-10T14:05:51.659744+0000","last_fullsized":"2024-05-10T14:05:51.659744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341102+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:05:51.341102+0000","last_peered":"2024-05-10T14:05:51.341102+0000","last_clean":"2024-05-10T14:05:51.341102+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:05:51.341102+0000","last_undegraded":"2024-05-10T14:05:51.341102+0000","last_fullsized":"2024-05-10T14:05:51.341102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341731+0000","last_change":"2024-05-10T14:05:17.382896+0000","last_active":"2024-05-10T14:05:51.341731+0000","last_peered":"2024-05-10T14:05:51.341731+0000","last_clean":"2024-05-10T14:05:51.341731+0000","last_became_active":"2024-05-10T14:05:17.328643+0000","last_became_peered":"2024-05-10T14:05:17.328643+0000","last_unstale":"2024-05-10T14:05:51.341731+0000","last_undegraded":"2024-05-10T14:05:51.341731+0000","last_fullsized":"2024-05-10T14:05:51.341731+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:59.031951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":186,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316796+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:05:48.316796+0000","last_peered":"2024-05-10T14:05:48.316796+0000","last_clean":"2024-05-10T14:05:48.316796+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:05:48.316796+0000","last_undegraded":"2024-05-10T14:05:48.316796+0000","last_fullsized":"2024-05-10T14:05:48.316796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338385+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:05:51.338385+0000","last_peered":"2024-05-10T14:05:51.338385+0000","last_clean":"2024-05-10T14:05:51.338385+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:05:51.338385+0000","last_undegraded":"2024-05-10T14:05:51.338385+0000","last_fullsized":"2024-05-10T14:05:51.338385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337924+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:05:51.337924+0000","last_peered":"2024-05-10T14:05:51.337924+0000","last_clean":"2024-05-10T14:05:51.337924+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:05:51.337924+0000","last_undegraded":"2024-05-10T14:05:51.337924+0000","last_fullsized":"2024-05-10T14:05:51.337924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340385+0000","last_change":"2024-05-10T14:05:17.301444+0000","last_active":"2024-05-10T14:05:51.340385+0000","last_peered":"2024-05-10T14:05:51.340385+0000","last_clean":"2024-05-10T14:05:51.340385+0000","last_became_active":"2024-05-10T14:05:17.300629+0000","last_became_peered":"2024-05-10T14:05:17.300629+0000","last_unstale":"2024-05-10T14:05:51.340385+0000","last_undegraded":"2024-05-10T14:05:51.340385+0000","last_fullsized":"2024-05-10T14:05:51.340385+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:10.457996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316423+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:05:48.316423+0000","last_peered":"2024-05-10T14:05:48.316423+0000","last_clean":"2024-05-10T14:05:48.316423+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:05:48.316423+0000","last_undegraded":"2024-05-10T14:05:48.316423+0000","last_fullsized":"2024-05-10T14:05:48.316423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340017+0000","last_change":"2024-05-10T14:05:17.302494+0000","last_active":"2024-05-10T14:05:51.340017+0000","last_peered":"2024-05-10T14:05:51.340017+0000","last_clean":"2024-05-10T14:05:51.340017+0000","last_became_active":"2024-05-10T14:05:17.302183+0000","last_became_peered":"2024-05-10T14:05:17.302183+0000","last_unstale":"2024-05-10T14:05:51.340017+0000","last_undegraded":"2024-05-10T14:05:51.340017+0000","last_fullsized":"2024-05-10T14:05:51.340017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:00:37.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338842+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:05:51.338842+0000","last_peered":"2024-05-10T14:05:51.338842+0000","last_clean":"2024-05-10T14:05:51.338842+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:05:51.338842+0000","last_undegraded":"2024-05-10T14:05:51.338842+0000","last_fullsized":"2024-05-10T14:05:51.338842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658286+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:05:51.658286+0000","last_peered":"2024-05-10T14:05:51.658286+0000","last_clean":"2024-05-10T14:05:51.658286+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:05:51.658286+0000","last_undegraded":"2024-05-10T14:05:51.658286+0000","last_fullsized":"2024-05-10T14:05:51.658286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660229+0000","last_change":"2024-05-10T14:05:17.326908+0000","last_active":"2024-05-10T14:05:51.660229+0000","last_peered":"2024-05-10T14:05:51.660229+0000","last_clean":"2024-05-10T14:05:51.660229+0000","last_became_active":"2024-05-10T14:05:17.326038+0000","last_became_peered":"2024-05-10T14:05:17.326038+0000","last_unstale":"2024-05-10T14:05:51.660229+0000","last_undegraded":"2024-05-10T14:05:51.660229+0000","last_fullsized":"2024-05-10T14:05:51.660229+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:30.900773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659646+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:05:51.659646+0000","last_peered":"2024-05-10T14:05:51.659646+0000","last_clean":"2024-05-10T14:05:51.659646+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:05:51.659646+0000","last_undegraded":"2024-05-10T14:05:51.659646+0000","last_fullsized":"2024-05-10T14:05:51.659646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338422+0000","last_change":"2024-05-10T14:05:17.389023+0000","last_active":"2024-05-10T14:05:51.338422+0000","last_peered":"2024-05-10T14:05:51.338422+0000","last_clean":"2024-05-10T14:05:51.338422+0000","last_became_active":"2024-05-10T14:05:17.328793+0000","last_became_peered":"2024-05-10T14:05:17.328793+0000","last_unstale":"2024-05-10T14:05:51.338422+0000","last_undegraded":"2024-05-10T14:05:51.338422+0000","last_fullsized":"2024-05-10T14:05:51.338422+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:01.641999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590681+0000","last_change":"2024-05-10T14:05:17.297623+0000","last_active":"2024-05-10T14:05:48.590681+0000","last_peered":"2024-05-10T14:05:48.590681+0000","last_clean":"2024-05-10T14:05:48.590681+0000","last_became_active":"2024-05-10T14:05:17.292479+0000","last_became_peered":"2024-05-10T14:05:17.292479+0000","last_unstale":"2024-05-10T14:05:48.590681+0000","last_undegraded":"2024-05-10T14:05:48.590681+0000","last_fullsized":"2024-05-10T14:05:48.590681+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:35.280501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339831+0000","last_change":"2024-05-10T14:05:17.316646+0000","last_active":"2024-05-10T14:05:51.339831+0000","last_peered":"2024-05-10T14:05:51.339831+0000","last_clean":"2024-05-10T14:05:51.339831+0000","last_became_active":"2024-05-10T14:05:17.315392+0000","last_became_peered":"2024-05-10T14:05:17.315392+0000","last_unstale":"2024-05-10T14:05:51.339831+0000","last_undegraded":"2024-05-10T14:05:51.339831+0000","last_fullsized":"2024-05-10T14:05:51.339831+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:43.312219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338644+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:05:51.338644+0000","last_peered":"2024-05-10T14:05:51.338644+0000","last_clean":"2024-05-10T14:05:51.338644+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:05:51.338644+0000","last_undegraded":"2024-05-10T14:05:51.338644+0000","last_fullsized":"2024-05-10T14:05:51.338644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660279+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:05:51.660279+0000","last_peered":"2024-05-10T14:05:51.660279+0000","last_clean":"2024-05-10T14:05:51.660279+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:05:51.660279+0000","last_undegraded":"2024-05-10T14:05:51.660279+0000","last_fullsized":"2024-05-10T14:05:51.660279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591936+0000","last_change":"2024-05-10T14:05:17.308941+0000","last_active":"2024-05-10T14:05:48.591936+0000","last_peered":"2024-05-10T14:05:48.591936+0000","last_clean":"2024-05-10T14:05:48.591936+0000","last_became_active":"2024-05-10T14:05:17.307845+0000","last_became_peered":"2024-05-10T14:05:17.307845+0000","last_unstale":"2024-05-10T14:05:48.591936+0000","last_undegraded":"2024-05-10T14:05:48.591936+0000","last_fullsized":"2024-05-10T14:05:48.591936+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.273750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337403+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:05:51.337403+0000","last_peered":"2024-05-10T14:05:51.337403+0000","last_clean":"2024-05-10T14:05:51.337403+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:05:51.337403+0000","last_undegraded":"2024-05-10T14:05:51.337403+0000","last_fullsized":"2024-05-10T14:05:51.337403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660561+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:05:51.660561+0000","last_peered":"2024-05-10T14:05:51.660561+0000","last_clean":"2024-05-10T14:05:51.660561+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:05:51.660561+0000","last_undegraded":"2024-05-10T14:05:51.660561+0000","last_fullsized":"2024-05-10T14:05:51.660561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.661218+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:05:51.661218+0000","last_peered":"2024-05-10T14:05:51.661218+0000","last_clean":"2024-05-10T14:05:51.661218+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:05:51.661218+0000","last_undegraded":"2024-05-10T14:05:51.661218+0000","last_fullsized":"2024-05-10T14:05:51.661218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338891+0000","last_change":"2024-05-10T14:05:17.356428+0000","last_active":"2024-05-10T14:05:51.338891+0000","last_peered":"2024-05-10T14:05:51.338891+0000","last_clean":"2024-05-10T14:05:51.338891+0000","last_became_active":"2024-05-10T14:05:17.322206+0000","last_became_peered":"2024-05-10T14:05:17.322206+0000","last_unstale":"2024-05-10T14:05:51.338891+0000","last_undegraded":"2024-05-10T14:05:51.338891+0000","last_fullsized":"2024-05-10T14:05:51.338891+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:56:24.255861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659218+0000","last_change":"2024-05-10T14:05:17.290150+0000","last_active":"2024-05-10T14:05:51.659218+0000","last_peered":"2024-05-10T14:05:51.659218+0000","last_clean":"2024-05-10T14:05:51.659218+0000","last_became_active":"2024-05-10T14:05:17.289889+0000","last_became_peered":"2024-05-10T14:05:17.289889+0000","last_unstale":"2024-05-10T14:05:51.659218+0000","last_undegraded":"2024-05-10T14:05:51.659218+0000","last_fullsized":"2024-05-10T14:05:51.659218+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:26:01.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.665071+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:05:51.665071+0000","last_peered":"2024-05-10T14:05:51.665071+0000","last_clean":"2024-05-10T14:05:51.665071+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:05:51.665071+0000","last_undegraded":"2024-05-10T14:05:51.665071+0000","last_fullsized":"2024-05-10T14:05:51.665071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337245+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:05:51.337245+0000","last_peered":"2024-05-10T14:05:51.337245+0000","last_clean":"2024-05-10T14:05:51.337245+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:05:51.337245+0000","last_undegraded":"2024-05-10T14:05:51.337245+0000","last_fullsized":"2024-05-10T14:05:51.337245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660109+0000","last_change":"2024-05-10T14:05:17.290271+0000","last_active":"2024-05-10T14:05:51.660109+0000","last_peered":"2024-05-10T14:05:51.660109+0000","last_clean":"2024-05-10T14:05:51.660109+0000","last_became_active":"2024-05-10T14:05:17.289795+0000","last_became_peered":"2024-05-10T14:05:17.289795+0000","last_unstale":"2024-05-10T14:05:51.660109+0000","last_undegraded":"2024-05-10T14:05:51.660109+0000","last_fullsized":"2024-05-10T14:05:51.660109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:36.010565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316628+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:05:48.316628+0000","last_peered":"2024-05-10T14:05:48.316628+0000","last_clean":"2024-05-10T14:05:48.316628+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:05:48.316628+0000","last_undegraded":"2024-05-10T14:05:48.316628+0000","last_fullsized":"2024-05-10T14:05:48.316628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591595+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:05:48.591595+0000","last_peered":"2024-05-10T14:05:48.591595+0000","last_clean":"2024-05-10T14:05:48.591595+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:05:48.591595+0000","last_undegraded":"2024-05-10T14:05:48.591595+0000","last_fullsized":"2024-05-10T14:05:48.591595+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338261+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:05:51.338261+0000","last_peered":"2024-05-10T14:05:51.338261+0000","last_clean":"2024-05-10T14:05:51.338261+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:05:51.338261+0000","last_undegraded":"2024-05-10T14:05:51.338261+0000","last_fullsized":"2024-05-10T14:05:51.338261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660397+0000","last_change":"2024-05-10T14:05:17.299613+0000","last_active":"2024-05-10T14:05:51.660397+0000","last_peered":"2024-05-10T14:05:51.660397+0000","last_clean":"2024-05-10T14:05:51.660397+0000","last_became_active":"2024-05-10T14:05:17.299295+0000","last_became_peered":"2024-05-10T14:05:17.299295+0000","last_unstale":"2024-05-10T14:05:51.660397+0000","last_undegraded":"2024-05-10T14:05:51.660397+0000","last_fullsized":"2024-05-10T14:05:51.660397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:00.221896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316466+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:05:48.316466+0000","last_peered":"2024-05-10T14:05:48.316466+0000","last_clean":"2024-05-10T14:05:48.316466+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:05:48.316466+0000","last_undegraded":"2024-05-10T14:05:48.316466+0000","last_fullsized":"2024-05-10T14:05:48.316466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664790+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:05:51.664790+0000","last_peered":"2024-05-10T14:05:51.664790+0000","last_clean":"2024-05-10T14:05:51.664790+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:05:51.664790+0000","last_undegraded":"2024-05-10T14:05:51.664790+0000","last_fullsized":"2024-05-10T14:05:51.664790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589975+0000","last_change":"2024-05-10T14:05:17.342315+0000","last_active":"2024-05-10T14:05:48.589975+0000","last_peered":"2024-05-10T14:05:48.589975+0000","last_clean":"2024-05-10T14:05:48.589975+0000","last_became_active":"2024-05-10T14:05:17.306666+0000","last_became_peered":"2024-05-10T14:05:17.306666+0000","last_unstale":"2024-05-10T14:05:48.589975+0000","last_undegraded":"2024-05-10T14:05:48.589975+0000","last_fullsized":"2024-05-10T14:05:48.589975+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:48.468176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":171,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317038+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:05:48.317038+0000","last_peered":"2024-05-10T14:05:48.317038+0000","last_clean":"2024-05-10T14:05:48.317038+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:05:48.317038+0000","last_undegraded":"2024-05-10T14:05:48.317038+0000","last_fullsized":"2024-05-10T14:05:48.317038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660677+0000","last_change":"2024-05-10T14:05:17.325443+0000","last_active":"2024-05-10T14:05:51.660677+0000","last_peered":"2024-05-10T14:05:51.660677+0000","last_clean":"2024-05-10T14:05:51.660677+0000","last_became_active":"2024-05-10T14:05:17.319097+0000","last_became_peered":"2024-05-10T14:05:17.319097+0000","last_unstale":"2024-05-10T14:05:51.660677+0000","last_undegraded":"2024-05-10T14:05:51.660677+0000","last_fullsized":"2024-05-10T14:05:51.660677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:22.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340177+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:05:51.340177+0000","last_peered":"2024-05-10T14:05:51.340177+0000","last_clean":"2024-05-10T14:05:51.340177+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:05:51.340177+0000","last_undegraded":"2024-05-10T14:05:51.340177+0000","last_fullsized":"2024-05-10T14:05:51.340177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342595+0000","last_change":"2024-05-10T14:02:30.649249+0000","last_active":"2024-05-10T14:05:51.342595+0000","last_peered":"2024-05-10T14:05:51.342595+0000","last_clean":"2024-05-10T14:05:51.342595+0000","last_became_active":"2024-05-10T14:02:30.648529+0000","last_became_peered":"2024-05-10T14:02:30.648529+0000","last_unstale":"2024-05-10T14:05:51.342595+0000","last_undegraded":"2024-05-10T14:05:51.342595+0000","last_fullsized":"2024-05-10T14:05:51.342595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:46.016168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343142+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:05:51.343142+0000","last_peered":"2024-05-10T14:05:51.343142+0000","last_clean":"2024-05-10T14:05:51.343142+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:05:51.343142+0000","last_undegraded":"2024-05-10T14:05:51.343142+0000","last_fullsized":"2024-05-10T14:05:51.343142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339227+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:05:51.339227+0000","last_peered":"2024-05-10T14:05:51.339227+0000","last_clean":"2024-05-10T14:05:51.339227+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:05:51.339227+0000","last_undegraded":"2024-05-10T14:05:51.339227+0000","last_fullsized":"2024-05-10T14:05:51.339227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":171,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316203+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:05:48.316203+0000","last_peered":"2024-05-10T14:05:48.316203+0000","last_clean":"2024-05-10T14:05:48.316203+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:05:48.316203+0000","last_undegraded":"2024-05-10T14:05:48.316203+0000","last_fullsized":"2024-05-10T14:05:48.316203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.588552+0000","last_change":"2024-05-10T14:05:17.329828+0000","last_active":"2024-05-10T14:05:48.588552+0000","last_peered":"2024-05-10T14:05:48.588552+0000","last_clean":"2024-05-10T14:05:48.588552+0000","last_became_active":"2024-05-10T14:05:17.329143+0000","last_became_peered":"2024-05-10T14:05:17.329143+0000","last_unstale":"2024-05-10T14:05:48.588552+0000","last_undegraded":"2024-05-10T14:05:48.588552+0000","last_fullsized":"2024-05-10T14:05:48.588552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:33.149265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338778+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:05:51.338778+0000","last_peered":"2024-05-10T14:05:51.338778+0000","last_clean":"2024-05-10T14:05:51.338778+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:05:51.338778+0000","last_undegraded":"2024-05-10T14:05:51.338778+0000","last_fullsized":"2024-05-10T14:05:51.338778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659323+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:05:51.659323+0000","last_peered":"2024-05-10T14:05:51.659323+0000","last_clean":"2024-05-10T14:05:51.659323+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:05:51.659323+0000","last_undegraded":"2024-05-10T14:05:51.659323+0000","last_fullsized":"2024-05-10T14:05:51.659323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317735+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:05:48.317735+0000","last_peered":"2024-05-10T14:05:48.317735+0000","last_clean":"2024-05-10T14:05:48.317735+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:05:48.317735+0000","last_undegraded":"2024-05-10T14:05:48.317735+0000","last_fullsized":"2024-05-10T14:05:48.317735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342815+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:05:51.342815+0000","last_peered":"2024-05-10T14:05:51.342815+0000","last_clean":"2024-05-10T14:05:51.342815+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:05:51.342815+0000","last_undegraded":"2024-05-10T14:05:51.342815+0000","last_fullsized":"2024-05-10T14:05:51.342815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664067+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:05:51.664067+0000","last_peered":"2024-05-10T14:05:51.664067+0000","last_clean":"2024-05-10T14:05:51.664067+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:05:51.664067+0000","last_undegraded":"2024-05-10T14:05:51.664067+0000","last_fullsized":"2024-05-10T14:05:51.664067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":116,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.589496+0000","last_change":"2024-05-10T14:05:17.321018+0000","last_active":"2024-05-10T14:05:48.589496+0000","last_peered":"2024-05-10T14:05:48.589496+0000","last_clean":"2024-05-10T14:05:48.589496+0000","last_became_active":"2024-05-10T14:05:17.320295+0000","last_became_peered":"2024-05-10T14:05:17.320295+0000","last_unstale":"2024-05-10T14:05:48.589496+0000","last_undegraded":"2024-05-10T14:05:48.589496+0000","last_fullsized":"2024-05-10T14:05:48.589496+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:57.713909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340786+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:05:51.340786+0000","last_peered":"2024-05-10T14:05:51.340786+0000","last_clean":"2024-05-10T14:05:51.340786+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:05:51.340786+0000","last_undegraded":"2024-05-10T14:05:51.340786+0000","last_fullsized":"2024-05-10T14:05:51.340786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586168+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:05:48.586168+0000","last_peered":"2024-05-10T14:05:48.586168+0000","last_clean":"2024-05-10T14:05:48.586168+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:05:48.586168+0000","last_undegraded":"2024-05-10T14:05:48.586168+0000","last_fullsized":"2024-05-10T14:05:48.586168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340551+0000","last_change":"2024-05-10T14:05:17.308154+0000","last_active":"2024-05-10T14:05:51.340551+0000","last_peered":"2024-05-10T14:05:51.340551+0000","last_clean":"2024-05-10T14:05:51.340551+0000","last_became_active":"2024-05-10T14:05:17.306642+0000","last_became_peered":"2024-05-10T14:05:17.306642+0000","last_unstale":"2024-05-10T14:05:51.340551+0000","last_undegraded":"2024-05-10T14:05:51.340551+0000","last_fullsized":"2024-05-10T14:05:51.340551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:17:32.949040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":139,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584813+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:05:48.584813+0000","last_peered":"2024-05-10T14:05:48.584813+0000","last_clean":"2024-05-10T14:05:48.584813+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:05:48.584813+0000","last_undegraded":"2024-05-10T14:05:48.584813+0000","last_fullsized":"2024-05-10T14:05:48.584813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658493+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:05:51.658493+0000","last_peered":"2024-05-10T14:05:51.658493+0000","last_clean":"2024-05-10T14:05:51.658493+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:05:51.658493+0000","last_undegraded":"2024-05-10T14:05:51.658493+0000","last_fullsized":"2024-05-10T14:05:51.658493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659635+0000","last_change":"2024-05-10T14:05:17.291271+0000","last_active":"2024-05-10T14:05:51.659635+0000","last_peered":"2024-05-10T14:05:51.659635+0000","last_clean":"2024-05-10T14:05:51.659635+0000","last_became_active":"2024-05-10T14:05:17.290828+0000","last_became_peered":"2024-05-10T14:05:17.290828+0000","last_unstale":"2024-05-10T14:05:51.659635+0000","last_undegraded":"2024-05-10T14:05:51.659635+0000","last_fullsized":"2024-05-10T14:05:51.659635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:28.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341911+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:05:51.341911+0000","last_peered":"2024-05-10T14:05:51.341911+0000","last_clean":"2024-05-10T14:05:51.341911+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:05:51.341911+0000","last_undegraded":"2024-05-10T14:05:51.341911+0000","last_fullsized":"2024-05-10T14:05:51.341911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.590447+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:05:48.590447+0000","last_peered":"2024-05-10T14:05:48.590447+0000","last_clean":"2024-05-10T14:05:48.590447+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:05:48.590447+0000","last_undegraded":"2024-05-10T14:05:48.590447+0000","last_fullsized":"2024-05-10T14:05:48.590447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.586819+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:05:48.586819+0000","last_peered":"2024-05-10T14:05:48.586819+0000","last_clean":"2024-05-10T14:05:48.586819+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:05:48.586819+0000","last_undegraded":"2024-05-10T14:05:48.586819+0000","last_fullsized":"2024-05-10T14:05:48.586819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.658390+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:05:51.658390+0000","last_peered":"2024-05-10T14:05:51.658390+0000","last_clean":"2024-05-10T14:05:51.658390+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:05:51.658390+0000","last_undegraded":"2024-05-10T14:05:51.658390+0000","last_fullsized":"2024-05-10T14:05:51.658390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660338+0000","last_change":"2024-05-10T14:05:17.318418+0000","last_active":"2024-05-10T14:05:51.660338+0000","last_peered":"2024-05-10T14:05:51.660338+0000","last_clean":"2024-05-10T14:05:51.660338+0000","last_became_active":"2024-05-10T14:05:17.317436+0000","last_became_peered":"2024-05-10T14:05:17.317436+0000","last_unstale":"2024-05-10T14:05:51.660338+0000","last_undegraded":"2024-05-10T14:05:51.660338+0000","last_fullsized":"2024-05-10T14:05:51.660338+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:55:35.182032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340453+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:05:51.340453+0000","last_peered":"2024-05-10T14:05:51.340453+0000","last_clean":"2024-05-10T14:05:51.340453+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:05:51.340453+0000","last_undegraded":"2024-05-10T14:05:51.340453+0000","last_fullsized":"2024-05-10T14:05:51.340453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339614+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:05:51.339614+0000","last_peered":"2024-05-10T14:05:51.339614+0000","last_clean":"2024-05-10T14:05:51.339614+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:05:51.339614+0000","last_undegraded":"2024-05-10T14:05:51.339614+0000","last_fullsized":"2024-05-10T14:05:51.339614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.341007+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:05:51.341007+0000","last_peered":"2024-05-10T14:05:51.341007+0000","last_clean":"2024-05-10T14:05:51.341007+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:05:51.341007+0000","last_undegraded":"2024-05-10T14:05:51.341007+0000","last_fullsized":"2024-05-10T14:05:51.341007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339558+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:05:51.339558+0000","last_peered":"2024-05-10T14:05:51.339558+0000","last_clean":"2024-05-10T14:05:51.339558+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:05:51.339558+0000","last_undegraded":"2024-05-10T14:05:51.339558+0000","last_fullsized":"2024-05-10T14:05:51.339558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340622+0000","last_change":"2024-05-10T14:05:17.359796+0000","last_active":"2024-05-10T14:05:51.340622+0000","last_peered":"2024-05-10T14:05:51.340622+0000","last_clean":"2024-05-10T14:05:51.340622+0000","last_became_active":"2024-05-10T14:05:17.313620+0000","last_became_peered":"2024-05-10T14:05:17.313620+0000","last_unstale":"2024-05-10T14:05:51.340622+0000","last_undegraded":"2024-05-10T14:05:51.340622+0000","last_fullsized":"2024-05-10T14:05:51.340622+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:16.709452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340306+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:05:51.340306+0000","last_peered":"2024-05-10T14:05:51.340306+0000","last_clean":"2024-05-10T14:05:51.340306+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:05:51.340306+0000","last_undegraded":"2024-05-10T14:05:51.340306+0000","last_fullsized":"2024-05-10T14:05:51.340306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":34,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316795+0000","last_change":"2024-05-10T14:05:17.329847+0000","last_active":"2024-05-10T14:05:48.316795+0000","last_peered":"2024-05-10T14:05:48.316795+0000","last_clean":"2024-05-10T14:05:48.316795+0000","last_became_active":"2024-05-10T14:05:17.329439+0000","last_became_peered":"2024-05-10T14:05:17.329439+0000","last_unstale":"2024-05-10T14:05:48.316795+0000","last_undegraded":"2024-05-10T14:05:48.316795+0000","last_fullsized":"2024-05-10T14:05:48.316795+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:10.877312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340268+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:05:51.340268+0000","last_peered":"2024-05-10T14:05:51.340268+0000","last_clean":"2024-05-10T14:05:51.340268+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:05:51.340268+0000","last_undegraded":"2024-05-10T14:05:51.340268+0000","last_fullsized":"2024-05-10T14:05:51.340268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660475+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:05:51.660475+0000","last_peered":"2024-05-10T14:05:51.660475+0000","last_clean":"2024-05-10T14:05:51.660475+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:05:51.660475+0000","last_undegraded":"2024-05-10T14:05:51.660475+0000","last_fullsized":"2024-05-10T14:05:51.660475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.315103+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:05:48.315103+0000","last_peered":"2024-05-10T14:05:48.315103+0000","last_clean":"2024-05-10T14:05:48.315103+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:05:48.315103+0000","last_undegraded":"2024-05-10T14:05:48.315103+0000","last_fullsized":"2024-05-10T14:05:48.315103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340710+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:05:51.340710+0000","last_peered":"2024-05-10T14:05:51.340710+0000","last_clean":"2024-05-10T14:05:51.340710+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:05:51.340710+0000","last_undegraded":"2024-05-10T14:05:51.340710+0000","last_fullsized":"2024-05-10T14:05:51.340710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659115+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:05:51.659115+0000","last_peered":"2024-05-10T14:05:51.659115+0000","last_clean":"2024-05-10T14:05:51.659115+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:05:51.659115+0000","last_undegraded":"2024-05-10T14:05:51.659115+0000","last_fullsized":"2024-05-10T14:05:51.659115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343399+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:05:51.343399+0000","last_peered":"2024-05-10T14:05:51.343399+0000","last_clean":"2024-05-10T14:05:51.343399+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:05:51.343399+0000","last_undegraded":"2024-05-10T14:05:51.343399+0000","last_fullsized":"2024-05-10T14:05:51.343399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317551+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:05:48.317551+0000","last_peered":"2024-05-10T14:05:48.317551+0000","last_clean":"2024-05-10T14:05:48.317551+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:05:48.317551+0000","last_undegraded":"2024-05-10T14:05:48.317551+0000","last_fullsized":"2024-05-10T14:05:48.317551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660917+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:05:51.660917+0000","last_peered":"2024-05-10T14:05:51.660917+0000","last_clean":"2024-05-10T14:05:51.660917+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:05:51.660917+0000","last_undegraded":"2024-05-10T14:05:51.660917+0000","last_fullsized":"2024-05-10T14:05:51.660917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317630+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:05:48.317630+0000","last_peered":"2024-05-10T14:05:48.317630+0000","last_clean":"2024-05-10T14:05:48.317630+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:05:48.317630+0000","last_undegraded":"2024-05-10T14:05:48.317630+0000","last_fullsized":"2024-05-10T14:05:48.317630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338523+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:05:51.338523+0000","last_peered":"2024-05-10T14:05:51.338523+0000","last_clean":"2024-05-10T14:05:51.338523+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:05:51.338523+0000","last_undegraded":"2024-05-10T14:05:51.338523+0000","last_fullsized":"2024-05-10T14:05:51.338523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.591686+0000","last_change":"2024-05-10T14:05:17.317395+0000","last_active":"2024-05-10T14:05:48.591686+0000","last_peered":"2024-05-10T14:05:48.591686+0000","last_clean":"2024-05-10T14:05:48.591686+0000","last_became_active":"2024-05-10T14:05:17.315496+0000","last_became_peered":"2024-05-10T14:05:17.315496+0000","last_unstale":"2024-05-10T14:05:48.591686+0000","last_undegraded":"2024-05-10T14:05:48.591686+0000","last_fullsized":"2024-05-10T14:05:48.591686+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:06:24.935635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584820+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:05:48.584820+0000","last_peered":"2024-05-10T14:05:48.584820+0000","last_clean":"2024-05-10T14:05:48.584820+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:05:48.584820+0000","last_undegraded":"2024-05-10T14:05:48.584820+0000","last_fullsized":"2024-05-10T14:05:48.584820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":188,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316665+0000","last_change":"2024-05-10T14:05:17.288941+0000","last_active":"2024-05-10T14:05:48.316665+0000","last_peered":"2024-05-10T14:05:48.316665+0000","last_clean":"2024-05-10T14:05:48.316665+0000","last_became_active":"2024-05-10T14:05:17.286289+0000","last_became_peered":"2024-05-10T14:05:17.286289+0000","last_unstale":"2024-05-10T14:05:48.316665+0000","last_undegraded":"2024-05-10T14:05:48.316665+0000","last_fullsized":"2024-05-10T14:05:48.316665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:37.303535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659519+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:05:51.659519+0000","last_peered":"2024-05-10T14:05:51.659519+0000","last_clean":"2024-05-10T14:05:51.659519+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:05:51.659519+0000","last_undegraded":"2024-05-10T14:05:51.659519+0000","last_fullsized":"2024-05-10T14:05:51.659519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340095+0000","last_change":"2024-05-10T14:05:17.291835+0000","last_active":"2024-05-10T14:05:51.340095+0000","last_peered":"2024-05-10T14:05:51.340095+0000","last_clean":"2024-05-10T14:05:51.340095+0000","last_became_active":"2024-05-10T14:05:17.291059+0000","last_became_peered":"2024-05-10T14:05:17.291059+0000","last_unstale":"2024-05-10T14:05:51.340095+0000","last_undegraded":"2024-05-10T14:05:51.340095+0000","last_fullsized":"2024-05-10T14:05:51.340095+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:50.766804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339859+0000","last_change":"2024-05-10T14:02:30.626603+0000","last_active":"2024-05-10T14:05:51.339859+0000","last_peered":"2024-05-10T14:05:51.339859+0000","last_clean":"2024-05-10T14:05:51.339859+0000","last_became_active":"2024-05-10T14:02:30.626293+0000","last_became_peered":"2024-05-10T14:02:30.626293+0000","last_unstale":"2024-05-10T14:05:51.339859+0000","last_undegraded":"2024-05-10T14:05:51.339859+0000","last_fullsized":"2024-05-10T14:05:51.339859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:31.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342327+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:05:51.342327+0000","last_peered":"2024-05-10T14:05:51.342327+0000","last_clean":"2024-05-10T14:05:51.342327+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:05:51.342327+0000","last_undegraded":"2024-05-10T14:05:51.342327+0000","last_fullsized":"2024-05-10T14:05:51.342327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.317528+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:05:48.317528+0000","last_peered":"2024-05-10T14:05:48.317528+0000","last_clean":"2024-05-10T14:05:48.317528+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:05:48.317528+0000","last_undegraded":"2024-05-10T14:05:48.317528+0000","last_fullsized":"2024-05-10T14:05:48.317528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339453+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:05:51.339453+0000","last_peered":"2024-05-10T14:05:51.339453+0000","last_clean":"2024-05-10T14:05:51.339453+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:05:51.339453+0000","last_undegraded":"2024-05-10T14:05:51.339453+0000","last_fullsized":"2024-05-10T14:05:51.339453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664293+0000","last_change":"2024-05-10T14:05:17.308151+0000","last_active":"2024-05-10T14:05:51.664293+0000","last_peered":"2024-05-10T14:05:51.664293+0000","last_clean":"2024-05-10T14:05:51.664293+0000","last_became_active":"2024-05-10T14:05:17.307278+0000","last_became_peered":"2024-05-10T14:05:17.307278+0000","last_unstale":"2024-05-10T14:05:51.664293+0000","last_undegraded":"2024-05-10T14:05:51.664293+0000","last_fullsized":"2024-05-10T14:05:51.664293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:08.196085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660666+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:05:51.660666+0000","last_peered":"2024-05-10T14:05:51.660666+0000","last_clean":"2024-05-10T14:05:51.660666+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:05:51.660666+0000","last_undegraded":"2024-05-10T14:05:51.660666+0000","last_fullsized":"2024-05-10T14:05:51.660666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338810+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:05:51.338810+0000","last_peered":"2024-05-10T14:05:51.338810+0000","last_clean":"2024-05-10T14:05:51.338810+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:05:51.338810+0000","last_undegraded":"2024-05-10T14:05:51.338810+0000","last_fullsized":"2024-05-10T14:05:51.338810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660373+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:05:51.660373+0000","last_peered":"2024-05-10T14:05:51.660373+0000","last_clean":"2024-05-10T14:05:51.660373+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:05:51.660373+0000","last_undegraded":"2024-05-10T14:05:51.660373+0000","last_fullsized":"2024-05-10T14:05:51.660373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.583855+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:05:48.583855+0000","last_peered":"2024-05-10T14:05:48.583855+0000","last_clean":"2024-05-10T14:05:48.583855+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:05:48.583855+0000","last_undegraded":"2024-05-10T14:05:48.583855+0000","last_fullsized":"2024-05-10T14:05:48.583855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.343077+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:05:51.343077+0000","last_peered":"2024-05-10T14:05:51.343077+0000","last_clean":"2024-05-10T14:05:51.343077+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:05:51.343077+0000","last_undegraded":"2024-05-10T14:05:51.343077+0000","last_fullsized":"2024-05-10T14:05:51.343077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339711+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:05:51.339711+0000","last_peered":"2024-05-10T14:05:51.339711+0000","last_clean":"2024-05-10T14:05:51.339711+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:05:51.339711+0000","last_undegraded":"2024-05-10T14:05:51.339711+0000","last_fullsized":"2024-05-10T14:05:51.339711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340698+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:05:51.340698+0000","last_peered":"2024-05-10T14:05:51.340698+0000","last_clean":"2024-05-10T14:05:51.340698+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:05:51.340698+0000","last_undegraded":"2024-05-10T14:05:51.340698+0000","last_fullsized":"2024-05-10T14:05:51.340698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338989+0000","last_change":"2024-05-10T14:05:17.347404+0000","last_active":"2024-05-10T14:05:51.338989+0000","last_peered":"2024-05-10T14:05:51.338989+0000","last_clean":"2024-05-10T14:05:51.338989+0000","last_became_active":"2024-05-10T14:05:17.312136+0000","last_became_peered":"2024-05-10T14:05:17.312136+0000","last_unstale":"2024-05-10T14:05:51.338989+0000","last_undegraded":"2024-05-10T14:05:51.338989+0000","last_fullsized":"2024-05-10T14:05:51.338989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:31.387274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.342540+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:05:51.342540+0000","last_peered":"2024-05-10T14:05:51.342540+0000","last_clean":"2024-05-10T14:05:51.342540+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:05:51.342540+0000","last_undegraded":"2024-05-10T14:05:51.342540+0000","last_fullsized":"2024-05-10T14:05:51.342540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659673+0000","last_change":"2024-05-10T14:05:17.287670+0000","last_active":"2024-05-10T14:05:51.659673+0000","last_peered":"2024-05-10T14:05:51.659673+0000","last_clean":"2024-05-10T14:05:51.659673+0000","last_became_active":"2024-05-10T14:05:17.287257+0000","last_became_peered":"2024-05-10T14:05:17.287257+0000","last_unstale":"2024-05-10T14:05:51.659673+0000","last_undegraded":"2024-05-10T14:05:51.659673+0000","last_fullsized":"2024-05-10T14:05:51.659673+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:11:42.174537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338546+0000","last_change":"2024-05-10T14:05:17.301830+0000","last_active":"2024-05-10T14:05:51.338546+0000","last_peered":"2024-05-10T14:05:51.338546+0000","last_clean":"2024-05-10T14:05:51.338546+0000","last_became_active":"2024-05-10T14:05:17.301264+0000","last_became_peered":"2024-05-10T14:05:17.301264+0000","last_unstale":"2024-05-10T14:05:51.338546+0000","last_undegraded":"2024-05-10T14:05:51.338546+0000","last_fullsized":"2024-05-10T14:05:51.338546+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:13:15.154631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.664818+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:05:51.664818+0000","last_peered":"2024-05-10T14:05:51.664818+0000","last_clean":"2024-05-10T14:05:51.664818+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:05:51.664818+0000","last_undegraded":"2024-05-10T14:05:51.664818+0000","last_fullsized":"2024-05-10T14:05:51.664818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.659062+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:05:51.659062+0000","last_peered":"2024-05-10T14:05:51.659062+0000","last_clean":"2024-05-10T14:05:51.659062+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:05:51.659062+0000","last_undegraded":"2024-05-10T14:05:51.659062+0000","last_fullsized":"2024-05-10T14:05:51.659062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.340799+0000","last_change":"2024-05-10T14:05:17.329021+0000","last_active":"2024-05-10T14:05:51.340799+0000","last_peered":"2024-05-10T14:05:51.340799+0000","last_clean":"2024-05-10T14:05:51.340799+0000","last_became_active":"2024-05-10T14:05:17.328706+0000","last_became_peered":"2024-05-10T14:05:17.328706+0000","last_unstale":"2024-05-10T14:05:51.340799+0000","last_undegraded":"2024-05-10T14:05:51.340799+0000","last_fullsized":"2024-05-10T14:05:51.340799+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:55:21.307180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.339361+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:05:51.339361+0000","last_peered":"2024-05-10T14:05:51.339361+0000","last_clean":"2024-05-10T14:05:51.339361+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:05:51.339361+0000","last_undegraded":"2024-05-10T14:05:51.339361+0000","last_fullsized":"2024-05-10T14:05:51.339361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.338261+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:05:51.338261+0000","last_peered":"2024-05-10T14:05:51.338261+0000","last_clean":"2024-05-10T14:05:51.338261+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:05:51.338261+0000","last_undegraded":"2024-05-10T14:05:51.338261+0000","last_fullsized":"2024-05-10T14:05:51.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.337679+0000","last_change":"2024-05-10T14:05:17.293919+0000","last_active":"2024-05-10T14:05:51.337679+0000","last_peered":"2024-05-10T14:05:51.337679+0000","last_clean":"2024-05-10T14:05:51.337679+0000","last_became_active":"2024-05-10T14:05:17.293576+0000","last_became_peered":"2024-05-10T14:05:17.293576+0000","last_unstale":"2024-05-10T14:05:51.337679+0000","last_undegraded":"2024-05-10T14:05:51.337679+0000","last_fullsized":"2024-05-10T14:05:51.337679+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:58.347022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":106,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592856+0000","last_change":"2024-05-10T14:05:17.325095+0000","last_active":"2024-05-10T14:05:48.592856+0000","last_peered":"2024-05-10T14:05:48.592856+0000","last_clean":"2024-05-10T14:05:48.592856+0000","last_became_active":"2024-05-10T14:05:17.324542+0000","last_became_peered":"2024-05-10T14:05:17.324542+0000","last_unstale":"2024-05-10T14:05:48.592856+0000","last_undegraded":"2024-05-10T14:05:48.592856+0000","last_fullsized":"2024-05-10T14:05:48.592856+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:39.185433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.584788+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:05:48.584788+0000","last_peered":"2024-05-10T14:05:48.584788+0000","last_clean":"2024-05-10T14:05:48.584788+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:05:48.584788+0000","last_undegraded":"2024-05-10T14:05:48.584788+0000","last_fullsized":"2024-05-10T14:05:48.584788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-10T14:05:51.660217+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:05:51.660217+0000","last_peered":"2024-05-10T14:05:51.660217+0000","last_clean":"2024-05-10T14:05:51.660217+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:05:51.660217+0000","last_undegraded":"2024-05-10T14:05:51.660217+0000","last_fullsized":"2024-05-10T14:05:51.660217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.316292+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:05:48.316292+0000","last_peered":"2024-05-10T14:05:48.316292+0000","last_clean":"2024-05-10T14:05:48.316292+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:05:48.316292+0000","last_undegraded":"2024-05-10T14:05:48.316292+0000","last_fullsized":"2024-05-10T14:05:48.316292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":104,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-10T14:05:48.592293+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:05:48.592293+0000","last_peered":"2024-05-10T14:05:48.592293+0000","last_clean":"2024-05-10T14:05:48.592293+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:05:48.592293+0000","last_undegraded":"2024-05-10T14:05:48.592293+0000","last_fullsized":"2024-05-10T14:05:48.592293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":406,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1474,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":8878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":64424509485,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43372,"kb_used_data":12188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328468,"statfs":{"total":96636764160,"available":96592351232,"internally_reserved":0,"allocated":12480512,"data_stored":11875262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710742,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1392,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1425408,"data_stored":785311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36656,"kb_used_data":5468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335184,"statfs":{"total":96636764160,"available":96599228416,"internally_reserved":0,"allocated":5599232,"data_stored":5001451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":5632000,"data_stored":5001902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38788,"kb_used_data":3440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333052,"statfs":{"total":96636764160,"available":96597045248,"internally_reserved":0,"allocated":3522560,"data_stored":2904227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2015232,"data_stored":1397509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36700,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":1392640,"data_stored":783644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:05:54.218 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T14:05:54.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:05:54.237 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:54.239+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:54.317 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:54.317 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:54.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:54.373 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:54.375+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:54.434 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:54.435+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:54.494 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:54.494 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:54.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:54.534 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:54.534+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:54.635 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:54.635+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:54.679 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:54.680 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:54.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:54.737 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:54.739+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:54.838 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:54.839+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:54.858 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:54.858 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:54.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:54.957 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:54.959+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:55.037 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:55.037 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:55.040 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:55.038+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:55.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:55.140 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:55.139+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:55.217 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:55.217 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:55.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:55.241 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:55.242+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:55.343 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:55.342+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:55.399 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:55.399 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:55.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:05:55.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:55.443 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:55.443+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:55.544 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:55.542+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:55.580 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:55.580 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:55.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:05:55.645 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:55.647+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:55.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:05:55.746 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:55.742+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:55.765 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:55.765 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:55.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:05:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:05:55.850 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:55.851 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:55.850+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:55.867 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:55.868 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:55.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:55.884 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:55.900 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:55.906 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:55.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:20 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'10, mlcod=18'8)", 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 215.738279541, 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028336350000000001, 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:55.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169323+0000", 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169325+0000", 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7400000000000001e-06 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169705+0000", 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038013400000000002 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169734+0000", 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9635999999999999e-05 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169747+0000", 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.313e-05 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169880+0000", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132182 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.169942+0000", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2349999999999998e-05 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172037+0000", 2024-05-10T14:05:55.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020947040000000002 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.172156+0000", 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119759 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 215.736745856, 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027561420000000001, 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170856+0000", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170858+0000", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.26e-06 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.170987+0000", 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012889600000000001 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171009+0000", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2796e-05 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171021+0000", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1722999999999999e-05 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171148+0000", 2024-05-10T14:05:55.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012670300000000001 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.171200+0000", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2441999999999997e-05 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173538+0000", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023378660000000001 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.173613+0000", 2024-05-10T14:05:55.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4456000000000007e-05 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4163.0:72 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'50, mlcod=18'45)", 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 215.40269554400001, 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036076350000000001, 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504907+0000", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.504909+0000", 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505001+0000", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2288999999999997e-05 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505026+0000", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999998e-05 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505040+0000", 2024-05-10T14:05:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3506000000000001e-05 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505140+0000", 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010054 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.505171+0000", 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0673000000000003e-05 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508411+0000", 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003240284 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:20.508514+0000", 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010315999999999999 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.16057243899999, 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031053169999999998, 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747030+0000", 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747033+0000", 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.96e-06 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747045+0000", 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.201e-05 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747076+0000", 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:05:55.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747093+0000", 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6946999999999999e-05 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747218+0000", 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012488500000000001 2024-05-10T14:05:55.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747413+0000", 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195162 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:55.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.747650+0000", 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000236512 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.748964+0000", 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314326 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.749959+0000", 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099481900000000009 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750046+0000", 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7423000000000006e-05 2024-05-10T14:05:55.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750135+0000", 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9069999999999999e-05 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206011505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.15731768000001, 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026859449999999999, 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.930 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750285+0000", 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750286+0000", 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.463e-06 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750293+0000", 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9630000000000001e-06 2024-05-10T14:05:55.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750314+0000", 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0772e-05 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750325+0000", 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.082e-05 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750458+0000", 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013349600000000001 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.750687+0000", 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022921000000000001 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.751084+0000", 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039706000000000002 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752144+0000", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001059808 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752702+0000", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055737199999999999 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752785+0000", 2024-05-10T14:05:55.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3135999999999998e-05 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.752971+0000", 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018584499999999999 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.198369996, 2024-05-10T14:05:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046197490000000003, 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709232+0000", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709236+0000", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1400000000000002e-06 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709253+0000", 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6986999999999998e-05 2024-05-10T14:05:55.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709296+0000", 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2895999999999997e-05 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709321+0000", 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5012999999999999e-05 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709463+0000", 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014154900000000001 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.709739+0000", 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027559500000000001 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-05-10T14:05:55.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.710458+0000", 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071939699999999998 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.712338+0000", 2024-05-10T14:05:55.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001880486 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713577+0000", 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012388810000000001 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713739+0000", 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162015 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.713852+0000", 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011279 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.18053080999999, 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003428024, 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727072+0000", 2024-05-10T14:05:55.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727075+0000", 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9629999999999998e-06 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727088+0000", 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3427e-05 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727120+0000", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1673e-05 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727134+0000", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727255+0000", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120392 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727475+0000", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022002499999999999 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.727873+0000", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039792400000000002 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.729328+0000", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014549750000000001 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730338+0000", 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010099390000000001 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730428+0000", 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9889999999999995e-05 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.730500+0000", 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2035999999999999e-05 2024-05-10T14:05:55.950 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.14407260799999, 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034822400000000002, 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763530+0000", 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763532+0000", 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5730000000000002e-06 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763544+0000", 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2007e-05 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763576+0000", 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2019e-05 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763591+0000", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5074e-05 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.763769+0000", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177572 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764001+0000", 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023223800000000001 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.764425+0000", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042418700000000002 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.765963+0000", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015371709999999999 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766846+0000", 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088333300000000003 2024-05-10T14:05:55.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.766939+0000", 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3209999999999997e-05 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767012+0000", 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2855999999999995e-05 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.957 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.13022797799999, 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003662588, 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777374+0000", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777377+0000", 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6529999999999998e-06 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777389+0000", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2150000000000001e-05 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777421+0000", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1479999999999997e-05 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777436+0000", 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-05-10T14:05:55.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777570+0000", 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013440500000000001 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.777806+0000", 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023583600000000001 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:55.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.778222+0000", 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041627599999999998 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.779737+0000", 2024-05-10T14:05:55.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015141149999999999 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780822+0000", 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010858490000000001 2024-05-10T14:05:55.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.780912+0000", 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9689000000000001e-05 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.781037+0000", 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124812 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:55.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.101001967, 2024-05-10T14:05:55.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003432114, 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806600+0000", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806603+0000", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806614+0000", 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1593000000000001e-05 2024-05-10T14:05:55.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806646+0000", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1293e-05 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806661+0000", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5713999999999999e-05 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806777+0000", 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115942 2024-05-10T14:05:55.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807008+0000", 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000231198 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.807446+0000", 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043764699999999999 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.808676+0000", 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012297740000000001 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809816+0000", 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001140351 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.809913+0000", 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6979999999999996e-05 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810032+0000", 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119389 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.972 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.083574825, 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030477270000000001, 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-05-10T14:05:55.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.974 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824028+0000", 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824030+0000", 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824041+0000", 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.129e-05 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824072+0000", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1096000000000002e-05 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824087+0000", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824211+0000", 2024-05-10T14:05:55.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012397299999999999 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824436+0000", 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022426799999999999 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.824867+0000", 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043131700000000002 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826502+0000", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001635007 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.826901+0000", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039922699999999999 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827002+0000", 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100512 2024-05-10T14:05:55.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827075+0000", 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3486999999999996e-05 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:422 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.029416357, 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002830964, 2024-05-10T14:05:55.980 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 422 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878186+0000", 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878187+0000", 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6599999999999996e-07 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878192+0000", 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1359999999999996e-06 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878202+0000", 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0009e-05 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878208+0000", 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7019999999999998e-06 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878264+0000", 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6283000000000003e-05 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878317+0000", 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3047999999999998e-05 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878435+0000", 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011792499999999999 2024-05-10T14:05:55.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878994+0000", 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000559666 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880935+0000", 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940507 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.880970+0000", 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5528999999999998e-05 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881017+0000", 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6492999999999997e-05 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:55.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.816525423, 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030559229999999999, 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:55.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 712 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091077+0000", 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091079+0000", 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.052e-06 2024-05-10T14:05:55.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:55.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091090+0000", 2024-05-10T14:05:55.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0961999999999999e-05 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091119+0000", 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9439999999999999e-05 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091134+0000", 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4446e-05 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091254+0000", 2024-05-10T14:05:55.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119926 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091475+0000", 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022113499999999999 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.091818+0000", 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034339700000000001 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.092912+0000", 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010934619999999999 2024-05-10T14:05:55.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.093833+0000", 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000921272 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094007+0000", 2024-05-10T14:05:55.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017350500000000001 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.094133+0000", 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012632600000000001 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:55.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.812137441, 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034249850000000002, 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 714 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:56.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095465+0000", 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095467+0000", 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1050000000000002e-06 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095478+0000", 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097999999999999e-05 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095510+0000", 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2002000000000003e-05 2024-05-10T14:05:56.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095525+0000", 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4657e-05 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095658+0000", 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013296400000000001 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.095896+0000", 2024-05-10T14:05:56.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023857500000000001 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.096381+0000", 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048475599999999998 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.097558+0000", 2024-05-10T14:05:56.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001176898 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098619+0000", 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010606120000000001 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098774+0000", 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015523499999999999 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.098890+0000", 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011608300000000001 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.63863256900001, 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027549720000000001, 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.008 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268970+0000", 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268972+0000", 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.903e-06 2024-05-10T14:05:56.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.268980+0000", 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5040000000000002e-06 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269005+0000", 2024-05-10T14:05:56.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4436000000000001e-05 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269017+0000", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2286999999999999e-05 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269126+0000", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109166 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269272+0000", 2024-05-10T14:05:56.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145959 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.269558+0000", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000285631 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.270937+0000", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013796220000000001 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271509+0000", 2024-05-10T14:05:56.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057129900000000005 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271632+0000", 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123566 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.271725+0000", 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2598999999999999e-05 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.58585778299999, 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034716230000000001, 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321745+0000", 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321747+0000", 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3740000000000001e-06 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321759+0000", 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2146e-05 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321790+0000", 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1024e-05 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321806+0000", 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6076e-05 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.321967+0000", 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016109800000000001 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322346+0000", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000378501 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.322934+0000", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058786199999999998 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.324382+0000", 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014481120000000001 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325003+0000", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062171199999999996 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325094+0000", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0668999999999995e-05 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.325216+0000", 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122049 2024-05-10T14:05:56.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.58109820000001, 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003231172, 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326504+0000", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326506+0000", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326519+0000", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.239e-05 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326552+0000", 2024-05-10T14:05:56.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3670000000000001e-05 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326568+0000", 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5659e-05 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326706+0000", 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013776899999999999 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.326937+0000", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023088899999999999 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.327440+0000", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050348299999999999 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.328557+0000", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011170069999999999 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329481+0000", 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092405999999999999 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329569+0000", 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7628999999999997e-05 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.329735+0000", 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016660899999999999 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.400745895, 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029724069999999998, 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506856+0000", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506859+0000", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506873+0000", 2024-05-10T14:05:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.346e-05 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506904+0000", 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1890000000000001e-05 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.506920+0000", 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5539000000000001e-05 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507043+0000", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012284899999999999 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507278+0000", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000235066 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.507606+0000", 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032819700000000002 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.508831+0000", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012247 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509593+0000", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076235099999999998 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509704+0000", 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011113299999999999 2024-05-10T14:05:56.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.509829+0000", 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012453200000000001 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.39694209800001, 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002925548, 2024-05-10T14:05:56.033 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510660+0000", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510662+0000", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.64e-06 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510672+0000", 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7799999999999995e-06 2024-05-10T14:05:56.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510698+0000", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5922999999999999e-05 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510711+0000", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.510857+0000", 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146692 2024-05-10T14:05:56.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511119+0000", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026211499999999999 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.511627+0000", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050766600000000004 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.512824+0000", 2024-05-10T14:05:56.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011963970000000001 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513433+0000", 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060975299999999999 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513517+0000", 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3669000000000001e-05 2024-05-10T14:05:56.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.513586+0000", 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8875999999999996e-05 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 164.03747729, 2024-05-10T14:05:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036092469999999999, 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:56.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870125+0000", 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870128+0000", 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2729999999999998e-06 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870143+0000", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4846e-05 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870180+0000", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6860000000000003e-05 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870203+0000", 2024-05-10T14:05:56.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3439999999999999e-05 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870389+0000", 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000185391 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.870676+0000", 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028746300000000001 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.871035+0000", 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000358938 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.872623+0000", 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587827 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873556+0000", 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093292500000000003 2024-05-10T14:05:56.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873644+0000", 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7899000000000007e-05 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:11.873734+0000", 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0384999999999996e-05 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.046 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.046 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:56.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:05:56.048 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:56.048 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:56.048 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:56.048 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:56.049 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:56.049 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:56.050 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:56.050 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:56.051 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:56.046+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:56.148 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:56.146+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:56.219 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:56.219 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:56.219 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:56.219 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:56.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:05:56.275 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:56.274+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:56.351 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:56.351+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:56.400 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:56.401 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:56.402 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:56.402 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:56.414 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:05:56.458 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:56.458+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:56.540 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 201.85896482800001, 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:05:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:05:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:05:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.81289577499999, 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:05:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:05:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:05:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.80738542899999, 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:05:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:05:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 197.69712660100001, 2024-05-10T14:05:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:05:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:05:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.820900518, 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:05:56.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.798337635, 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:05:56.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:05:56.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.77200960600001, 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:05:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.754413048, 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:05:56.578 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:05:56.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:05:56.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.72207447100001, 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:05:56.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.589 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.68799780699999, 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:05:56.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.677441397, 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:05:56.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:05:56.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:05:56.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.396478632, 2024-05-10T14:05:56.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:05:56.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:05:56.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.39218945299999, 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:05:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:05:56.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:05:56.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.350742344, 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:05:56.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:05:56.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:05:56.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.25250152500001, 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:05:56.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:05:56.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.231036668, 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:05:56.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.166502982, 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:05:56.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.636 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 193.899188439, 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:05:56.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:05:56.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:05:56.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.23775790100001, 2024-05-10T14:05:56.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:05:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:05:56.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:56.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.23762960799999, 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:56.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:05:56.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:05:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:05:56.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:56.654 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:56.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:05:56.656 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:56.654+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:56.756 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:56.754+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:56.833 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:56.833 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:56.833 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:56.834 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:56.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:05:56.891 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:56.890+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:56.959 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:56.958+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:57.017 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:57.017 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:57.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:05:57.075 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:57.074+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:57.161 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:57.159+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:57.208 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:57.208 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.46910569400001, 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:05:57.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:05:57.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:05:57.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.38013060899999, 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:05:57.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:05:57.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:05:57.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.36686321600001, 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:05:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.361267774, 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.04325448899999, 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:05:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:05:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.03920122299999, 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:05:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:05:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.00157632599999, 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:05:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:05:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.87040372999999, 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:05:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:05:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.866395407, 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.813481096, 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:05:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:05:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.79987142100001, 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:05:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.795782909, 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.74944667599999, 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:05:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:05:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:05:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.74568602599999, 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:05:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:05:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.658391747, 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:05:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.65455212200001, 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:05:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:05:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.56042212599999, 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:05:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:05:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.546263012, 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:05:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 194.54246171400001, 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:05:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:05:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 146.906968108, 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.329 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:57.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:05:57.331 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:57.330+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:57.432 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:57.430+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:57.508 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:05:57.509 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:57.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:05:57.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~89s 2024-05-10T14:05:57.533 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:57.531+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:57.634 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:57.635+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:57.697 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:05:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:05:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:05:57.697 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:57.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:05:57.735 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:57.735+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:57.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:05:57.835 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:05:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.091743915, 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:05:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:05:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:05:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.09165144400001, 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:05:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 196.12140658499999, 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:05:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 196.079164464, 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:05:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 196.03986499800001, 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:05:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:05:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 196.03286058200001, 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:05:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:05:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 196.0252548, 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:05:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:05:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.96797879299999, 2024-05-10T14:05:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.95686121700001, 2024-05-10T14:05:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:05:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:05:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:05:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.832021688, 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:05:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.736366527, 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:05:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.732228255, 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:05:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.69947653200001, 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:05:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.53479433300001, 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:05:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.47758762500001, 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:05:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.33541091800001, 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.31472529199999, 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:05:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:05:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.308169152, 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:05:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:05:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:05:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.223224684, 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 195.216301845, 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:05:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:05:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:05:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:05:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:05:57.956 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:05:57.957 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:05:57.958 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:57.959+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:58.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:05:58.088 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:58.088 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:58.088 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:05:58.088 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:58.098 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:05:58.098+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:05:58.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:05:58.159 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:58.158+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:58.183 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:05:58.208 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:05:58.209 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:05:58.227 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:05:58.228 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:05:58.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:05:58.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:05:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:05:58.260 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:58.258+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:58.260 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:05:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:05:58.277 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:05:58.278 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:05:58.295 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:05:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:05:58.314 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:05:58.314 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:05:58.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:05:58.333 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:05:58.360 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:58.359+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:58.366 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:58.366 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:58.381 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:05:58.461 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:58.458+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:58.546 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:58.546 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:58.561 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:05:58.562 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:58.563+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:58.664 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:58.662+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:58.683 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:58.683 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:58.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:05:58.765 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:58.763+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:58.813 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:58.813 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:58.827 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:05:58.866 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:58.862+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:58.967 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:58.967+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:58.996 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:58.996 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.010 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:05:59.097 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:05:59.099+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:05:59.169 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:59.170+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:59.178 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.178 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.193 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:05:59.281 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:59.283+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:59.360 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.361 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.370 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:05:59.371+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:05:59.375 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:05:59.472 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:05:59.471+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:05:59.540 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.540 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.554 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:05:59.572 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:05:59.570+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:05:59.673 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:05:59.670+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:05:59.714 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.714 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.728 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:05:59.775 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:05:59.774+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:05:59.844 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.844 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:05:59.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:05:59.874 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:59.875+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:59.975 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:05:59.975+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:05:59.993 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:05:59.993 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:00.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:00.077 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:00.074+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:00.135 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:00.135 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:00.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:00.177 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:00.179+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:00.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:06:00.286 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:00.286+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:00.322 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:00.322 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:00.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:00.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:00.383 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:00.382+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:00.481 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:00.479+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:00.501 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:00.501 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:00.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:00.519 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:00.519 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:00.536 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:00.536 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:00.553 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:00.553 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:00.570 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:00.570 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:00.581 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:00.578+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:00.590 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:00.590 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:00.611 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:00.631 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:00.631 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:00.633 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:00.633 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:00.633 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:00.633 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:00.633 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:00.646 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:00.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:00.652 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:00.699 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:00.683+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:00.770 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:00.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.08883819100001, 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:06:00.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:00.775 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.04276913800001, 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:06:00.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:06:00.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:06:00.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.03725879199999, 2024-05-10T14:06:00.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:06:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:06:00.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 201.926999964, 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:06:00.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:06:00.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.050773881, 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:06:00.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:06:00.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.02821099799999, 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:06:00.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:06:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.00188296900001, 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:06:00.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:06:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:06:00.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.984286411, 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:06:00.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:06:00.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:06:00.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:06:00.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:06:00.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:06:00.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:06:00.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.822 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:00.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.95194783400001, 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:06:00.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:06:00.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.91787117000001, 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:06:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:06:00.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:06:00.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.847 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.90731475999999, 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:06:00.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.855 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.62635199499999, 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:00.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:06:00.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.62206281600001, 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:06:00.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.867 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.58061570699999, 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:06:00.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.873 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.48237488800001, 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:06:00.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.460910031, 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:00.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:06:00.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.885 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.39637634499999, 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:06:00.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:06:00.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.129061802, 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:06:00.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:06:00.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:00.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:06:00.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.467631264, 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.898 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:06:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:06:00.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:06:00.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 150.46750297099999, 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:00.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:00.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:00.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:00.911 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:00.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:00.913 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:00.911+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:01.014 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:01.010+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:01.037 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:01.038 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:01.038 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:01.038 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:01.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:01.138 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:01.138+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:01.193 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:06:01.215 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:01.215+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:01.225 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:01.225 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:01.225 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:01.225 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:01.225 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:01.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:01.326 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:01.326+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.67063408199999, 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:06:01.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:06:01.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.58165899700001, 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:06:01.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:06:01.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:06:01.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.568391604, 2024-05-10T14:06:01.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:06:01.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.56279616200001, 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:06:01.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.24478287700001, 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:06:01.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:06:01.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.24072961100001, 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:06:01.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:06:01.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.20310471400001, 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:06:01.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.07193211800001, 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:06:01.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:06:01.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:06:01.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.06792379500001, 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:06:01.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:06:01.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:06:01.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.01500948399999, 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.463 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:06:01.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:06:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.00139980899999, 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:06:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.99731129700001, 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:06:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:06:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:06:01.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.950975064, 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.947214414, 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:06:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:06:01.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:01.491 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.85992013500001, 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:01.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:06:01.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.85608051, 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.502 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.76195051400001, 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:06:01.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.508 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.74779140000001, 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:06:01.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 198.743990102, 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:06:01.514 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.519 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 151.10849649599999, 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:06:01.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:06:01.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:01.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:01.525 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:01.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:01.527 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:01.527+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:01.628 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:01.626+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:01.701 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:01.701 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:01.701 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:01.701 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:01.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:01.759 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:01.758+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:01.829 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:01.831+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:01.884 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:01.884 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:01.884 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:01.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:01.931 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:01.931+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.28409742700001, 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:02.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:02.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.28400495599999, 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:02.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.313760097, 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.041 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:02.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.046 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.27151797600001, 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.047 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.052 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.23221851, 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.22521409399999, 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.21760831200001, 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:02.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:02.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.160332305, 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:02.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:02.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.14921472899999, 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:02.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 200.02437520000001, 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:02.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.92872003900001, 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.92458176700001, 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.89183004399999, 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:02.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.72714784499999, 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:02.108 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.669941137, 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:02.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.52776442999999, 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:02.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:02.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.507078804, 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:02.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.50052266399999, 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.126 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:02.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:02.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:02.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:02.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.41557819600001, 2024-05-10T14:06:02.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:02.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 199.40865535699999, 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:02.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:02.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:02.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:02.143 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:02.143 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:02.144 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:02.145 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:02.142+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:02.245 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:02.242+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:02.274 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:02.274 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:02.287 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:02.346 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:02.346+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:02.408 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:02.409 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:02.409 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:02.409 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:02.409 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:02.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:02.448 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:02.450+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.85327359199999, 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 203.82543542499999, 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.811676702, 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.728773109, 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.70243535, 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.701345299, 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.698458243, 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.69587984, 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.664600544, 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.61296223900001, 2024-05-10T14:06:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.528816089, 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.52477055899999, 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.458505578, 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.42142028999999, 2024-05-10T14:06:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.41428744800001, 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.212546382, 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.056616324, 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.049585845, 2024-05-10T14:06:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 199.95178411699999, 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 199.94447772300001, 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:02.658 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:02.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:02.660 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:02.659+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:02.671 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:02.761 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:02.758+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:02.826 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:02.826 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:02.826 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:02.826 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:02.833 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:02.833 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:02.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:02.849 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:02.866 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:02.866 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:02.882 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:02.883 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:02.885 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:02.887+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:02.899 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:02.917 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:02.917 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:02.936 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:02.954 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:02.954 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:02.963 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:02.963 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:02.964 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:02.963+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:02.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:03.069 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:03.071+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:03.146 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.146 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:03.201 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:03.203+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:03.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:06:03.266 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:03.267+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:03.322 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.322 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:03.382 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:03.383+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:03.468 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:03.467+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:03.508 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.508 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:03.568 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:03.570+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:03.669 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:03.666+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:03.693 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.693 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.708 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:03.770 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:03.770+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:03.831 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.831 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:03.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~96s 2024-05-10T14:06:03.893 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:03.895+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:03.972 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:03.971+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:03.972 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:03.973 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:03.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:04.073 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:04.075+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:04.149 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.149 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:04.205 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:04.207+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:04.222 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:06:04.274 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:04.275+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:04.304 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.304 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:04.375 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:04.375+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:04.444 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.444 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:04.506 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:04.506+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:04.577 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:04.574+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:04.592 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.592 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:04.699 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:04.698+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:04.778 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:04.778+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:04.783 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.783 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:04.891 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:04.890+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:04.970 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:04.971 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:04.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:04.981 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:04.983+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:04.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:05.082 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:05.082+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:05.117 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:05.134 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:05.134 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:05.150 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4461.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:05.160 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 210.48090952800001, 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025910688000000001, 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4461", 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/518619706", 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:05.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680300+0000", 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680302+0000", 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0509999999999999e-06 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680310+0000", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1340000000000004e-06 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680329+0000", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9094999999999999e-05 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680344+0000", 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4426999999999999e-05 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680716+0000", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372297 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.680731+0000", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706033+0000", 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025301901000000002 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:34.706211+0000", 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017771900000000001 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.43484047499999, 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033980569999999999, 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726369+0000", 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726370+0000", 2024-05-10T14:06:05.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4899999999999999e-06 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726385+0000", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4382999999999999e-05 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726411+0000", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6363000000000002e-05 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726434+0000", 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2577000000000001e-05 2024-05-10T14:06:05.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726800+0000", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036651700000000001 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.726846+0000", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5493e-05 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729629+0000", 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027836779999999999 2024-05-10T14:06:05.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.729767+0000", 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137556 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:50 7.15 e32/31 7:a93a5511:::notify.2:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.42933012899999, 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030380110000000002, 2024-05-10T14:06:05.170 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731879+0000", 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731880+0000", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731892+0000", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1612e-05 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731919+0000", 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7759e-05 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.731939+0000", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9683000000000001e-05 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732192+0000", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025257200000000001 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.732234+0000", 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2636999999999999e-05 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734829+0000", 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025945899999999999 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.734917+0000", 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8355000000000004e-05 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 206.31907130100001, 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030205190000000002, 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842138+0000", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842140+0000", 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1619999999999998e-06 2024-05-10T14:06:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842151+0000", 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1097000000000001e-05 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842181+0000", 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289e-05 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842195+0000", 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4337e-05 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842302+0000", 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107086 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842541+0000", 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023841499999999999 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.842812+0000", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027167400000000001 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844201+0000", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00138876 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.844981+0000", 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078016399999999997 2024-05-10T14:06:05.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845083+0000", 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010179300000000001 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.845159+0000", 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5741999999999994e-05 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.442845218, 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043908990000000002, 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.181 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718364+0000", 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718367+0000", 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7130000000000001e-06 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718379+0000", 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2047e-05 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718409+0000", 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9986000000000001e-05 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718428+0000", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8936e-05 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718549+0000", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120936 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718792+0000", 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024292500000000001 2024-05-10T14:06:05.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.719232+0000", 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044024 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.720712+0000", 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014797180000000001 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722584+0000", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001872023 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722682+0000", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7881999999999996e-05 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.722755+0000", 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3492999999999996e-05 2024-05-10T14:06:05.186 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.420282335, 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033225970000000001, 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.187 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740927+0000", 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740930+0000", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5399999999999998e-06 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740942+0000", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2116000000000001e-05 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740972+0000", 2024-05-10T14:06:05.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0636000000000003e-05 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.740989+0000", 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6422999999999998e-05 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741118+0000", 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012934599999999999 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741342+0000", 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022344500000000001 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.741849+0000", 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050753699999999996 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.743311+0000", 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014621339999999999 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744078+0000", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076686799999999998 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744166+0000", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8026000000000001e-05 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.744250+0000", 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3526e-05 2024-05-10T14:06:05.192 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.39395430600001, 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003098197, 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.193 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767255+0000", 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767258+0000", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6029999999999999e-06 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767270+0000", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2106999999999999e-05 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767302+0000", 2024-05-10T14:06:05.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.167e-05 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767318+0000", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6123000000000001e-05 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767439+0000", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121316 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.767670+0000", 2024-05-10T14:06:05.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000230795 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.768123+0000", 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045360600000000001 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.769425+0000", 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013016010000000001 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770196+0000", 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077124699999999997 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770284+0000", 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7745999999999996e-05 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.770353+0000", 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9382999999999996e-05 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.198 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.376357748, 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032001690000000001, 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-05-10T14:06:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784852+0000", 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784854+0000", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1969999999999999e-06 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784865+0000", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1036000000000001e-05 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784894+0000", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9539999999999998e-05 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.784910+0000", 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5636000000000001e-05 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785032+0000", 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121489 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785256+0000", 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022457900000000001 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.785738+0000", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000481986 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787104+0000", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013655989999999999 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787873+0000", 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076882399999999998 2024-05-10T14:06:05.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.787969+0000", 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6762999999999995e-05 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.788052+0000", 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2520000000000003e-05 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.34401917100001, 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003256934, 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.205 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817190+0000", 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817193+0000", 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4600000000000002e-06 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817205+0000", 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1956999999999999e-05 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817236+0000", 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939000000000003e-05 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817252+0000", 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6010000000000001e-05 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817371+0000", 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.817620+0000", 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024896500000000003 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.818079+0000", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045888999999999999 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.819581+0000", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015017279999999999 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820291+0000", 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071040100000000004 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820380+0000", 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9122999999999994e-05 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.820447+0000", 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6982000000000003e-05 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:344 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.211 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.30994250699999, 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002875847, 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 344 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851267+0000", 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851268+0000", 2024-05-10T14:06:05.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.037e-06 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851273+0000", 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4280000000000004e-06 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851294+0000", 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0169999999999998e-05 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851304+0000", 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0496000000000001e-05 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851380+0000", 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6357000000000001e-05 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851483+0000", 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010226900000000001 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851676+0000", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019346500000000001 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.852437+0000", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00076088700000000002 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854056+0000", 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016185170000000001 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854098+0000", 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2645000000000003e-05 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.854143+0000", 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4576000000000001e-05 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.217 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:385 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.299386097, 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030729640000000001, 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 385 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861823+0000", 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861824+0000", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.085e-06 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861832+0000", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9189999999999999e-06 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861845+0000", 2024-05-10T14:06:05.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2828e-05 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861854+0000", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9870000000000005e-06 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.861914+0000", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9823e-05 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862021+0000", 2024-05-10T14:06:05.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107472 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862197+0000", 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017582599999999999 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.862712+0000", 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051494099999999999 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864830+0000", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021173229999999999 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864866+0000", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6888000000000003e-05 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.864896+0000", 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9872000000000001e-05 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.018423332, 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033188390000000001, 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 733 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.224 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142786+0000", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142789+0000", 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.168e-06 2024-05-10T14:06:05.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142806+0000", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7048999999999999e-05 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142839+0000", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2400000000000001e-05 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142855+0000", 2024-05-10T14:06:05.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6311e-05 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.142993+0000", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137615 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143244+0000", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025161500000000001 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.143750+0000", 2024-05-10T14:06:05.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050549999999999998 2024-05-10T14:06:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145051+0000", 2024-05-10T14:06:05.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001301546 2024-05-10T14:06:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145804+0000", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075240799999999998 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.145984+0000", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018023400000000001 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.146105+0000", 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120993 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.230 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.01413415299999, 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030265959999999999, 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.231 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 735 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147075+0000", 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147077+0000", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.649e-06 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147085+0000", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3829999999999992e-06 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147114+0000", 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9133999999999999e-05 2024-05-10T14:06:05.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147136+0000", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1634e-05 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147231+0000", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4695000000000001e-05 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147366+0000", 2024-05-10T14:06:05.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135542 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.147649+0000", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028293799999999999 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.148706+0000", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001057058 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149818+0000", 2024-05-10T14:06:05.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001112125 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.149983+0000", 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016466500000000001 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.150102+0000", 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118773 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.972687044, 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034715430000000001, 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188522+0000", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188526+0000", 2024-05-10T14:06:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2600000000000001e-06 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188538+0000", 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2554e-05 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188569+0000", 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1229000000000002e-05 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188592+0000", 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2883000000000001e-05 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188739+0000", 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014634199999999999 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.188917+0000", 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178219 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.189196+0000", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000278645 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.190183+0000", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098738199999999997 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191786+0000", 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016030510000000001 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191884+0000", 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7619000000000002e-05 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.191994+0000", 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011035900000000001 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.87444622500001, 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031064719999999999, 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286763+0000", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286767+0000", 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3330000000000001e-06 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286781+0000", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3993e-05 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286810+0000", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9203000000000001e-05 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286825+0000", 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.509e-05 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.286947+0000", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122292 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287171+0000", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022357900000000001 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.287489+0000", 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031879100000000002 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.288749+0000", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00125971 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289709+0000", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00095944900000000002 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289800+0000", 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-05-10T14:06:05.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.289870+0000", 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9609000000000004e-05 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.852981368, 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030263769999999998, 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 805 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308228+0000", 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308230+0000", 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1670000000000002e-06 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308241+0000", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0823e-05 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308272+0000", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1257000000000002e-05 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308306+0000", 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3949999999999999e-05 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308461+0000", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015484200000000001 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.308687+0000", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022548499999999999 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.309015+0000", 2024-05-10T14:06:05.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000328124 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.310182+0000", 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011676169999999999 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311093+0000", 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091059699999999997 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311187+0000", 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3589000000000001e-05 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.311254+0000", 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.788447682, 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031345460000000002, 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 832 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:05.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372762+0000", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372765+0000", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7659999999999999e-06 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372797+0000", 2024-05-10T14:06:05.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2546000000000003e-05 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372830+0000", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2586999999999998e-05 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372846+0000", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5909999999999998e-05 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.372969+0000", 2024-05-10T14:06:05.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123795 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373208+0000", 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023895200000000001 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.373555+0000", 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034651000000000001 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.374945+0000", 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001389733 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375718+0000", 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077312099999999999 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375815+0000", 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7472999999999993e-05 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.375896+0000", 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1153e-05 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 202.521133139, 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028987679999999999, 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640076+0000", 2024-05-10T14:06:05.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640078+0000", 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.784e-06 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640086+0000", 2024-05-10T14:06:05.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3459999999999994e-06 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640114+0000", 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640135+0000", 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0380000000000001e-05 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640254+0000", 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119289 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640485+0000", 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023166199999999999 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.640833+0000", 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000347583 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.641899+0000", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010655389999999999 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642814+0000", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091586300000000005 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642905+0000", 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0679000000000004e-05 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.642975+0000", 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9902999999999998e-05 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1063 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94206011492608 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 154.85970260100001, 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0290364270000001, 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1063 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301507+0000", 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301511+0000", 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2479999999999998e-06 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301525+0000", 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4364e-05 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301557+0000", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1860000000000003e-05 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301582+0000", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4890000000000001e-05 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301695+0000", 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011297400000000001 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301702+0000", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.798e-06 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317872+0000", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016169855 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.317881+0000", 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2119999999999992e-06 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324516+0000", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0066344810000001 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.324672+0000", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015618199999999999 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330543+0000", 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058715629999999998 2024-05-10T14:06:05.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1065 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 154.85957430799999, 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.031850575, 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1065 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301635+0000", 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301636+0000", 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2130000000000001e-06 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301642+0000", 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0850000000000002e-06 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301674+0000", 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1349000000000001e-05 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301688+0000", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4453e-05 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301786+0000", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7850000000000007e-05 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.301796+0000", 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5449999999999992e-06 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315828+0000", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014031877 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.315846+0000", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8071999999999999e-05 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.329916+0000", 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0140707929999999 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.330332+0000", 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041523500000000002 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.333486+0000", 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031541030000000001 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:05.278 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:05.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:05.280 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:05.281 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:05.281 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:05.282 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:05.282 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:05.278+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:05.379 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:05.379+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:05.450 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:05.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:05.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:05.451 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:05.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:05.510 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:05.510+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:05.581 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:05.578+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:05.592 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:05.592 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:05.592 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:05.592 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:05.592 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:05.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:05.699 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:05.698+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:05.783 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.04393949199999, 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.784 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:06:05.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:06:05.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.95496440700001, 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:06:05.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:06:05.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:06:05.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:06:05.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.941697014, 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:06:05.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:06:05.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.800 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.93610157200001, 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:06:05.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:06:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:05.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.61808828700001, 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:05.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:06:05.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:06:05.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.61403502100001, 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:06:05.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:06:05.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:06:05.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:06:05.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.57641012400001, 2024-05-10T14:06:05.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:06:05.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:06:05.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:06:05.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:06:05.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.44523752800001, 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.823 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:06:05.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.44122920500001, 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:06:05.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.38831489399999, 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:06:05.834 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:06:05.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:06:05.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.37470521899999, 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:06:05.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.37061670700001, 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:06:05.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:06:05.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.32428047400001, 2024-05-10T14:06:05.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:06:05.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:06:05.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.320519824, 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.859 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.864 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.23322554500001, 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:05.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:06:05.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.22938592, 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.870 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:06:05.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:06:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:06:05.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.13525592400001, 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.12109681000001, 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:05.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:06:05.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:06:05.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:06:05.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.117295512, 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 155.48180190599999, 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:05.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:05.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:06:05.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:05.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:05.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:05.898 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:05.898 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:05.898 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:05.783+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:05.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:05.900 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:05.898+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:06.000 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:05.999+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:06.073 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:06.073 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:06.073 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:06.073 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:06.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:06.134 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:06.134+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:06.201 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:06.198+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:06.207 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:06.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:06.208 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:06.208 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:06.208 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:06.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:06.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:06:06.302 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:06.303+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:06.392 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:06.392 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:06.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:06.392 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.64843721, 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:06.393 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:06.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:06.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:06.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.64834473900001, 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:06.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:06.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.408 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.67809987999999, 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:06.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:06.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:06.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:06.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.635857759, 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:06.419 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:06.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:06.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:06.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.59655829299999, 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:06.426 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:06.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:06.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:06.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.58955387699999, 2024-05-10T14:06:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:06.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:06.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:06.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:06.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:06.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.443 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.581948095, 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:06.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:06.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:06.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:06.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.52467208799999, 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:06.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:06.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:06.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.51355451200001, 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.388714983, 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:06.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.293059822, 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.28892155, 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:06.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:06.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:06.483 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.25616982700001, 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:06.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:06.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.09148762800001, 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:06.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:06.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 204.03428091999999, 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.495 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.500 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.89210421300001, 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.87141858699999, 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.511 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.86486244700001, 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:06.517 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.779917979, 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:06.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:06.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:06.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 203.77299514000001, 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:06.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:06.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:06.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:06.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.528 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:06.529 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:06.529 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:06.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:06.531 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:06.530+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:06.631 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:06.631+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:06.662 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:06.662 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:06.662 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:06.662 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:06.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:06.761 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:06.763+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:06.833 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:06.831+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:06.839 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:06.839 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:06.840 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:06.840 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:06.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:06.945 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:06.947+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:07.025 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:07.025 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.33409633400001, 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.026 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:07.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.30625816700001, 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:07.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.29249944399999, 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:07.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:07.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:07.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:07.042 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.20959585099999, 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:07.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:07.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:07.048 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.18325809199999, 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:07.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:07.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.18216804100001, 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.054 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:07.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:07.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.17928098499999, 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:07.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:07.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.17670258199999, 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:07.064 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:07.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.14542328600001, 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:07.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:07.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:07.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:07.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:07.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:07.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:07.076 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.093784981, 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.081 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.00963883099999, 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:07.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:07.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.005593301, 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.093 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.93932831999999, 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:07.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:07.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.902243032, 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:07.099 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:07.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.105 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.89511019, 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.69336912399999, 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.111 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:07.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.53743906599999, 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.117 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.118 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.119 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.120 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.121 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.122 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.53040858700001, 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.123 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.124 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.125 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.128 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.432606859, 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:07.129 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.130 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.131 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.132 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.133 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 204.42530046499999, 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:07.134 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:07.135 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:07.136 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:07.137 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.139 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.140 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.140 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:07.140 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:07.140 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:07.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:07.142 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:07.143+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:07.242 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:07.243+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:07.244 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:06:07.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:07.314 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:07.314 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:07.314 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:07.314 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:07.329 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:07.373 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:07.375+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:07.444 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:07.442+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:07.486 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:07.496 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:07.496 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:07.505 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:07.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:07.524 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:07.524 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:07.543 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:07.557 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:07.559+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:07.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:07.562 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:07.634 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:07.635 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:07.647 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:07.647+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:07.648 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:07.748 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:07.747+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:07.815 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:07.815 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:07.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:07.873 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:07.875+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:07.951 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:07.954+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:07.994 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:07.994 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:08.057 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:08.059+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:08.130 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.130 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.144 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:08.185 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:08.187+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:08.253 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:08.255+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:08.307 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.308 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.323 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:08.365 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:08.367+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:08.455 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:08.454+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:08.483 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.483 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.498 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:08.556 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:08.558+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:08.621 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.621 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:08.657 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:08.659+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:08.758 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:08.759+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:08.776 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.777 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:08.859 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:08.858+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:08.919 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:08.920 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:08.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:08.960 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:08.959+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:09.061 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:09.058+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:09.106 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:09.107 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:09.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:09.161 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:09.163+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:09.263 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:09.263+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:09.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:06:09.293 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:09.293 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:09.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:09.398 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:09.398+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:09.464 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:09.463+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:09.483 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:09.483 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:09.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:09.565 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:09.567+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:09.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:09.666 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:09.667+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:09.669 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:09.669 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:09.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:09.727 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:09.744 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:09.744 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:09.761 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:09.761 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:09.767 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:09.767+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:09.778 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:09.799 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:09.804 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:09.804 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:09.804 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:09.804 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:09.818 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:09.820 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:09.821 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:09.842 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:09.863 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:09.864 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:09.867 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:09.866+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:09.943 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:09.943 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:09.943 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:09.943 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:09.944 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:09.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:10.002 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:10.002+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:10.069 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:10.071+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:10.080 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.341783671, 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:06:10.081 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:06:10.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:06:10.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:06:10.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.088 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.25280858599999, 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:06:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.23954119300001, 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.096 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:06:10.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.102 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.23394575099999, 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:06:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:06:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:06:10.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.91593246599999, 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.109 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:06:10.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:06:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.91187919999999, 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.116 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:06:10.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.87425430299999, 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.123 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:06:10.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:06:10.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.74308170699999, 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:06:10.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:06:10.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:06:10.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.73907338399999, 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:06:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:06:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.686159073, 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:06:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:06:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:06:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.672549398, 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:06:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.66846088599999, 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:06:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:06:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:06:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.62212465299999, 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:06:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:06:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:06:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.61836400300001, 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:06:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:06:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.53106972399999, 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:06:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:06:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.52723009900001, 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:06:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:06:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.43310010299999, 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:06:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:06:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:06:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:06:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.41894098899999, 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:06:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 207.41513969100001, 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:06:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 159.779646085, 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:06:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.220 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:10.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~102s 2024-05-10T14:06:10.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:10.223 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:10.223+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:06:10.338 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:10.338+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:10.395 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:10.396 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:10.396 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:10.396 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:10.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:10.455 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:10.454+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:10.524 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:10.523+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:10.579 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:10.579 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:10.579 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:10.579 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:10.579 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:10.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:10.638 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:10.638+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:10.715 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.972710527, 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:10.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:10.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.97261805599999, 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:10.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 209.002373197, 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:10.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.96013107600001, 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.92083160999999, 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.91382719399999, 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.90622141200001, 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.84894540499999, 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.83782782899999, 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.71298830000001, 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.61733313900001, 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.613194867, 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.58044314399999, 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.41576094499999, 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.35855423699999, 2024-05-10T14:06:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.21637752999999, 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.195691904, 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.18913576400001, 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.10419129600001, 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 208.09726845700001, 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:10.829 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:10.831 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:10.831 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:10.830+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:10.932 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:10.931+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:10.975 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:11.061 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:11.063+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:11.134 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:11.135+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:11.138 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:11.139 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:11.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:11.235 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:11.234+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:11.324 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:11.324 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:11.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:11.324 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:11.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.632567249, 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 212.60472908200001, 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:11.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.59097035900001, 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:11.336 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:11.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:11.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:11.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:11.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.346 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.50806676600001, 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:11.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:11.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:11.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:11.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.48172900700001, 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:11.359 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:11.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:11.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:11.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:11.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:11.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:11.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.48063895600001, 2024-05-10T14:06:11.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:11.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:11.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:11.378 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.47775189999999, 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:11.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:11.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:11.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.383 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.387 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.47517349699999, 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.388 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.391 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.392 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.44389420100001, 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:11.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.399 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.39225589599999, 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.30810974600001, 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.405 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:11.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:11.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:11.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.412 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.304064216, 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:11.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:11.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.23779923500001, 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.419 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.421 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.424 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.200713947, 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:11.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:11.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.19358110499999, 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.430 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:11.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.99184003900001, 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:11.436 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:11.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:11.442 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.83590998099999, 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.443 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:11.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:11.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.449 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.82887950200001, 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:11.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:11.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.456 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.731077774, 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.457 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:11.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:11.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:11.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 208.72377137999999, 2024-05-10T14:06:11.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:11.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:11.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:11.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.470 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.470 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.470 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.470 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:11.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:11.472 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:11.470+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:11.573 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:11.575+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:11.599 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:11.599 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:11.599 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:11.600 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:11.615 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:11.701 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:11.703+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:11.775 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:11.775+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:11.782 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:11.782 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:11.782 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:11.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:11.876 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:11.874+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:11.881 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:06:11.970 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.223378685, 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:06:11.974 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.27077294399999, 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.975 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:06:11.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:06:11.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:11.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.24332896999999, 2024-05-10T14:06:11.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:06:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:06:11.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.23007151600001, 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:06:11.987 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:06:11.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:06:11.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:06:11.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.22749959999999, 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:11.993 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:11.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:06:11.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:06:11.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:06:11.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:11.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.13088700899999, 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:06:12.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:06:12.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.21477218499999, 2024-05-10T14:06:12.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:12.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:06:12.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:06:12.007 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.175430578, 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:06:12.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:06:12.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.116460614, 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:06:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:06:12.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.10091898100001, 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:06:12.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:06:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:06:12.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.10041294800001, 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:06:12.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:12.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:06:12.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.09619343, 2024-05-10T14:06:12.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:06:12.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:06:12.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.08112843200001, 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:06:12.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.07974240999999, 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:06:12.035 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:06:12.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.039 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.07480094600001, 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:06:12.043 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.07434509800001, 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:06:12.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:06:12.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.05932583200001, 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:06:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 210.05425981100001, 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:12.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.960289711, 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.057 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 192.150677976, 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:12.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:06:12.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:06:12.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:12.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:12.066 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:12.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:12.067 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:12.068 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:12.068 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:12.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:12.069 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:12.067+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:12.075 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:12.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:12.113 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:12.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:12.150 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:12.168 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:12.167+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:12.171 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:12.171 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:12.236 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.236 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:12.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:12.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:06:12.297 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:12.299+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:12.370 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:12.366+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:12.415 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.415 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:12.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:12.473 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:12.475+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:12.545 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.546 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:12.560 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:12.572 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:12.570+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:12.673 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:12.674+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:12.724 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.724 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:12.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:12.774 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:12.770+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:12.863 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.863 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:12.875 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:12.874+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:12.877 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:12.976 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:12.975+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:12.999 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:12.999 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:13.077 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:13.074+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:13.148 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.148 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:13.178 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:13.179+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:13.272 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:06:13.279 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:13.278+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:13.347 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.347 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:13.379 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:13.379+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:13.480 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:13.479+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:13.488 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.488 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:13.581 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:13.578+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:13.624 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.625 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:13.682 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:13.683+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:13.783 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:13.783+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:13.885 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:13.883+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:13.938 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:13.939 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:13.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:13.998 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:13.998+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:14.076 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:14.076 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:14.087 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:14.087+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:14.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:14.187 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:14.186+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:14.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:14.260 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:14.260 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:14.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:14.322 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:14.322+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:14.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:14.351 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:14.368 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:14.368 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:14.384 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:14.385 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:14.389 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:14.386+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:14.401 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:14.401 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:14.402 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206011494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 215.66488300200001, 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029524640000000001, 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 53 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738331+0000", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738333+0000", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.697e-06 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738343+0000", 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0131e-05 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738370+0000", 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7117000000000001e-05 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738391+0000", 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0973999999999999e-05 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738512+0000", 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012009400000000001 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738619+0000", 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010780099999999999 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.738817+0000", 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019721699999999999 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.739994+0000", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001177261 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741103+0000", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001109365 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741188+0000", 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4944999999999994e-05 2024-05-10T14:06:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.741284+0000", 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5861999999999998e-05 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.57590791699999, 2024-05-10T14:06:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033950970000000001, 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827307+0000", 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827309+0000", 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.413e-06 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827322+0000", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3484e-05 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827352+0000", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9578999999999999e-05 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827367+0000", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4800000000000001e-05 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827489+0000", 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121833 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.827700+0000", 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021088500000000001 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.828122+0000", 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042224299999999999 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.829864+0000", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017419460000000001 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830480+0000", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061652899999999999 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830572+0000", 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1636000000000002e-05 2024-05-10T14:06:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.830702+0000", 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012974899999999999 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.56264052399999, 2024-05-10T14:06:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050337120000000001, 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 280 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840574+0000", 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840576+0000", 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.66e-06 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840585+0000", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5910000000000002e-06 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840604+0000", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9032999999999999e-05 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840618+0000", 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.416e-05 2024-05-10T14:06:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840682+0000", 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3758999999999997e-05 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840774+0000", 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1370000000000001e-05 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.840950+0000", 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017611300000000001 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.841610+0000", 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066038800000000003 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845517+0000", 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039065510000000003 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845552+0000", 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5451999999999999e-05 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.845608+0000", 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5634999999999998e-05 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.557045082, 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049094200000000003, 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 316 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846169+0000", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846170+0000", 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8800000000000001e-07 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846177+0000", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7320000000000001e-06 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846191+0000", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.394e-05 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846197+0000", 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7939999999999999e-06 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846250+0000", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3634000000000002e-05 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846310+0000", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9585e-05 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.846451+0000", 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141166 2024-05-10T14:06:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056406700000000002 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851001+0000", 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039856609999999997 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851037+0000", 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6075999999999998e-05 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.851079+0000", 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1876999999999999e-05 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.239031797, 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031643679999999999, 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164183+0000", 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164185+0000", 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164200+0000", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4273e-05 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164232+0000", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2092999999999999e-05 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164248+0000", 2024-05-10T14:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6747000000000001e-05 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164408+0000", 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015933500000000001 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.164783+0000", 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037531400000000002 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.165324+0000", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00054146999999999995 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.166720+0000", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013959980000000001 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167181+0000", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046038399999999999 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167270+0000", 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9139000000000002e-05 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.167347+0000", 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7082000000000005e-05 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.234978531, 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027173050000000002, 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 744 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168236+0000", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168238+0000", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5969999999999999e-06 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168247+0000", 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0459999999999994e-06 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168267+0000", 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9933999999999999e-05 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168279+0000", 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2077e-05 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168391+0000", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112197 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168531+0000", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014061299999999999 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.168819+0000", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028712699999999998 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170012+0000", 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001192965 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170803+0000", 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079100000000000004 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170887+0000", 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4098999999999996e-05 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.170953+0000", 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6649999999999994e-05 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.197353634, 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028905200000000002, 2024-05-10T14:06:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205861+0000", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205863+0000", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.119e-06 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205875+0000", 2024-05-10T14:06:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2398000000000001e-05 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205905+0000", 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9638999999999999e-05 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.205919+0000", 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3652000000000001e-05 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206051+0000", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000132206 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206264+0000", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021331099999999999 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.206661+0000", 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039717099999999998 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208115+0000", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001453932 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208601+0000", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048577899999999999 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208686+0000", 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5283000000000003e-05 2024-05-10T14:06:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.208751+0000", 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5030000000000006e-05 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.066181038, 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896231, 2024-05-10T14:06:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337033+0000", 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337036+0000", 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999998e-06 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337050+0000", 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3540000000000001e-05 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337083+0000", 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2988999999999999e-05 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337098+0000", 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5043e-05 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337281+0000", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000183139 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337500+0000", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021941800000000001 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.337873+0000", 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000372414 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339021+0000", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011480939999999999 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339772+0000", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075145099999999999 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339861+0000", 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8802999999999997e-05 2024-05-10T14:06:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.339930+0000", 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8676000000000005e-05 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.062172715, 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027689709999999998, 2024-05-10T14:06:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341042+0000", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341044+0000", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0030000000000001e-06 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341056+0000", 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2086000000000001e-05 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341087+0000", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0873000000000001e-05 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341104+0000", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7422999999999999e-05 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341285+0000", 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018081600000000001 2024-05-10T14:06:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341427+0000", 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000142452 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.341750+0000", 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032252099999999998 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.342801+0000", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010510949999999999 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343655+0000", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085394699999999997 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343745+0000", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9549000000000006e-05 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.343811+0000", 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6205999999999996e-05 2024-05-10T14:06:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.00925840400001, 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028278779999999998, 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393956+0000", 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393959+0000", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.393972+0000", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394006+0000", 2024-05-10T14:06:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3370000000000001e-05 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394021+0000", 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.594e-05 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394141+0000", 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011961200000000001 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394370+0000", 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000229025 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.394698+0000", 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032808799999999998 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.395971+0000", 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273073 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396572+0000", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00060048499999999999 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396662+0000", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9863000000000003e-05 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.396784+0000", 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122349 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.99564872900001, 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030250870000000001, 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-05-10T14:06:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407566+0000", 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407568+0000", 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407579+0000", 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1206000000000001e-05 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407614+0000", 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4847e-05 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407629+0000", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4883e-05 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407775+0000", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146086 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.407991+0000", 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000216021 2024-05-10T14:06:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.408308+0000", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031719499999999999 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.409372+0000", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010634209999999999 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410434+0000", 2024-05-10T14:06:14.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010628289999999999 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410524+0000", 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9419000000000006e-05 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.410591+0000", 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6979999999999999e-05 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.991560217, 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029580370000000002, 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411654+0000", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411656+0000", 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.57e-06 2024-05-10T14:06:14.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411666+0000", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0366e-05 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411691+0000", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5029999999999999e-05 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411709+0000", 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8050000000000002e-05 2024-05-10T14:06:14.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411820+0000", 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111142 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.411959+0000", 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013818200000000001 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.412233+0000", 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027410500000000002 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.413285+0000", 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010520289999999999 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414454+0000", 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414543+0000", 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9635000000000005e-05 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.414612+0000", 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8817000000000002e-05 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.94522398399999, 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028225910000000002, 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457991+0000", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.457993+0000", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2859999999999998e-06 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458005+0000", 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.205e-05 2024-05-10T14:06:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458036+0000", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1035999999999999e-05 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458054+0000", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8077e-05 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458173+0000", 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458393+0000", 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021984899999999999 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.458716+0000", 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032370400000000002 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.459794+0000", 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001078032 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460654+0000", 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085953600000000005 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460743+0000", 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9242999999999999e-05 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.460813+0000", 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0036000000000005e-05 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.94146333399999, 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026937290000000002, 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 870 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461751+0000", 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461753+0000", 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3300000000000001e-06 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461766+0000", 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2463000000000001e-05 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461797+0000", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1204000000000001e-05 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461812+0000", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4780000000000001e-05 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.461933+0000", 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121169 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462067+0000", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134225 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.462351+0000", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000283221 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.463466+0000", 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001115495 2024-05-10T14:06:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464288+0000", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082209999999999998 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464377+0000", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8393000000000006e-05 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.464445+0000", 2024-05-10T14:06:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8349000000000006e-05 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.854169055, 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002852289, 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549045+0000", 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549048+0000", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5270000000000001e-06 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549060+0000", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2099999999999999e-05 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549092+0000", 2024-05-10T14:06:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549107+0000", 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.489e-05 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549247+0000", 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013993600000000001 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549482+0000", 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023551099999999999 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.549862+0000", 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037918400000000002 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.550938+0000", 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001076498 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551740+0000", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080182799999999998 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551831+0000", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0551999999999996e-05 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.551898+0000", 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7182999999999997e-05 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.85032942999999, 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033252609999999999, 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552885+0000", 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552887+0000", 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.576e-06 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552897+0000", 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0000000000000001e-05 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552921+0000", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4749999999999999e-05 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.552934+0000", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2594e-05 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553040+0000", 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106065 2024-05-10T14:06:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553169+0000", 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012885899999999999 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.553440+0000", 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027147800000000002 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.554469+0000", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010286589999999999 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556052+0000", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015825139999999999 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556141+0000", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9233000000000004e-05 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.556210+0000", 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9533e-05 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.756199434, 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027196920000000001, 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647015+0000", 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647017+0000", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647029+0000", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1793e-05 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647063+0000", 2024-05-10T14:06:14.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3436999999999999e-05 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647087+0000", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4006e-05 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647246+0000", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159302 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647471+0000", 2024-05-10T14:06:14.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022465500000000001 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.647799+0000", 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032812100000000001 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649130+0000", 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013310900000000001 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649552+0000", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042168899999999999 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649641+0000", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9480000000000004e-05 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.649735+0000", 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3719000000000002e-05 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.503 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.74204032, 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002870802, 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661174+0000", 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661176+0000", 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1840000000000002e-06 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661203+0000", 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6923e-05 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661233+0000", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0156000000000001e-05 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661248+0000", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4406000000000001e-05 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661366+0000", 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118103 2024-05-10T14:06:14.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661572+0000", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000205699 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.661915+0000", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000342997 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663101+0000", 2024-05-10T14:06:14.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011865510000000001 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663886+0000", 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078502400000000005 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.663976+0000", 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9845999999999993e-05 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664045+0000", 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8912999999999996e-05 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 211.73823902199999, 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002877545, 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:14.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664975+0000", 2024-05-10T14:06:14.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664978+0000", 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0729999999999999e-06 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.664989+0000", 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1127e-05 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665023+0000", 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4165999999999998e-05 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665041+0000", 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7937000000000001e-05 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665190+0000", 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014942199999999999 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665316+0000", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012597899999999999 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.665589+0000", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027269799999999998 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.666621+0000", 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010325550000000001 2024-05-10T14:06:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667695+0000", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001073425 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667786+0000", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983000000000006e-05 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.667853+0000", 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7180000000000004e-05 2024-05-10T14:06:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:1064 7.e 7:7759931f:::notify.3:head [watch reconnect cookie 94206011494912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 164.102745416, 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.027172422, 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:14.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1064 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300469+0000", 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:14.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300471+0000", 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9889999999999999e-06 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300481+0000", 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6749999999999997e-06 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300507+0000", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6259e-05 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300527+0000", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9575000000000001e-05 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300664+0000", 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137787 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.300681+0000", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6140000000000001e-05 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314020+0000", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013339189 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:30.314030+0000", 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0083e-05 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323587+0000", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.009557646 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.323758+0000", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000170629 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:03:31.327642+0000", 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038834500000000001 2024-05-10T14:06:14.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.522 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:14.522 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:14.522 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:14.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:14.524 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:14.524 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:14.524 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:14.525 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:14.525 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:14.525 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:14.526 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:14.526 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:14.527 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:14.523+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:14.624 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:14.623+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:14.695 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:14.695 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:14.695 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:14.696 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:14.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:14.754 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:14.754+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:14.826 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:14.826+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:14.918 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:14.918 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:14.918 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:14.918 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:14.918 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:14.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:14.927 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:14.927+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:15.029 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:15.026+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.35218800199999, 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.352095531, 2024-05-10T14:06:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.38185067200001, 2024-05-10T14:06:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.339608551, 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.30030908500001, 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.29330466900001, 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.285698887, 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.22842288000001, 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.21730530400001, 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.145 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:15.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.149 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 213.09246577499999, 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:15.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.996810614, 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:15.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:15.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.99267234199999, 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.959920619, 2024-05-10T14:06:15.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:15.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:15.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.79523842, 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:15.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:15.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.179 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.73803171200001, 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:15.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.595855005, 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:15.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.57516937899999, 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.191 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:15.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:15.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.568613239, 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.483668771, 2024-05-10T14:06:15.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 212.476745932, 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:15.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:15.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:15.215 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:15.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:15.217 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:15.215+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:15.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:06:15.317 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:15.319+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:15.349 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:15.349 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:15.349 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:15.349 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:15.363 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:15.449 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:15.451+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:15.519 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:15.518+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:15.528 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:15.529 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:15.529 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:15.543 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:15.620 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:15.618+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:15.713 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 219.02199476000001, 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.714 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:15.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.718 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 216.99415659300001, 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:15.719 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.720 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:15.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:15.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:15.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.98039786999999, 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.724 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:15.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:15.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:15.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.89749427699999, 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:15.731 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.733 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.734 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:15.737 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.87115651799999, 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:15.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:15.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:15.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:15.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:15.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.87006646699999, 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:15.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:15.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:15.748 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.867179411, 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:15.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:15.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:15.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:15.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.86460100799999, 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:15.755 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.83332171199999, 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:15.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:15.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:15.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:15.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:15.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.781683407, 2024-05-10T14:06:15.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:15.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:15.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:15.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:15.772 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.69753725699999, 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:15.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:15.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:15.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.69349172700001, 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.779 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:15.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:15.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:15.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.62722674599999, 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:15.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:15.788 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:15.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.59014145800001, 2024-05-10T14:06:15.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:15.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:15.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.583008616, 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.796 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:15.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:15.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.38126754999999, 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:15.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:15.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.807 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.22533749199999, 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.21830701299999, 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:15.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:15.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:15.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:15.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.12050528500001, 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.822 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.823 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 213.113198891, 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:15.824 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:15.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:15.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:15.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:15.829 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:15.831 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:15.831 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:15.834+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:15.932 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:15.931+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:15.959 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:15.959 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:15.959 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:15.959 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:15.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:16.033 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:16.030+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:16.134 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:16.134+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:16.135 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:16.135 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:16.135 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:16.135 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:16.135 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:16.149 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:16.235 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:16.234+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.52315828100001, 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:06:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.57055253999999, 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:06:16.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:06:16.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:06:16.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:16.282 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.543108566, 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:06:16.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:06:16.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:06:16.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.288 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.52985111199999, 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:06:16.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:06:16.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.296 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.52727919599999, 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:06:16.297 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:06:16.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:06:16.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:06:16.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.430666605, 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.307 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:06:16.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.311 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.51455178099999, 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:06:16.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.47521017400001, 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.316 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:06:16.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.41624021000001, 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:06:16.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:06:16.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.40069857700001, 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:06:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:06:16.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:06:16.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.40019254399999, 2024-05-10T14:06:16.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:16.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:06:16.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:06:16.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.39597302600001, 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.334 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:06:16.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:16.338 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.38090802799999, 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:06:16.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.379522006, 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:06:16.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.37458054199999, 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:16.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.352 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.37412469399999, 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:06:16.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.35910542799999, 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:06:16.357 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:06:16.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.35403940699999, 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:06:16.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 214.26006930700001, 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.370 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 196.450457572, 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:06:16.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:16.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:16.375 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:16.377 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:06:16.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:16.378 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:16.375+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:16.478 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:16.478+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:16.528 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:16.548 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:16.548 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:16.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:16.609 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:16.611+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:16.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~109s 2024-05-10T14:06:16.680 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:16.679+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:16.680 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:16.681 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:16.681 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:16.681 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:16.681 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:16.688 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:16.688 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:16.695 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:16.706 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:16.706 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:16.723 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:16.723 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:16.739 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:16.759 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:16.760 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:16.780 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:16.785 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:16.787+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:16.798 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:16.798 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:16.817 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:16.817 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:16.861 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:16.861 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:16.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:16.882 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:16.878+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:16.983 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:16.982+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:17.043 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.043 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.057 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:17.105 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:17.107+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:17.182 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.182 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.185 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:17.186+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:17.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:17.285 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:17.287+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:17.365 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.366 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:17.425 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:17.427+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:17.487 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:17.486+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:17.516 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.516 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:17.588 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:17.587+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:17.689 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:17.686+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:17.703 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.703 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:17.790 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:17.791+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:17.891 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:17.891 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:17.891 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:17.890+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:17.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:17.994 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:17.994+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:18.078 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.079 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:18.094 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:18.090+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:18.194 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:18.194+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:18.264 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.264 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:18.295 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:18.295+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:18.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:06:18.426 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:18.426+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:18.452 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.453 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:18.496 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:18.495+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:18.598 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:18.599+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:18.626 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.626 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:18.698 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:18.699+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:18.765 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.765 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:18.799 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:18.799+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:18.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:18.901 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:18.898+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:18.905 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:18.905 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:18.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:18.974 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:18.975 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:18.991 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:18.991 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:19.002 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:18.998+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:19.008 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:19.025 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:19.025 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:19.045 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:19.046 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:19.066 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:19.067 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:19.079 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-05-10T14:06:19.080 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:19.087 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:19.087 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:19.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:19.103 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:19.103+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:19.108 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:19.108 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:19.204 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:19.203+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:19.222 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-05-10T14:06:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-05-10T14:06:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-05-10T14:06:19.223 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:19.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:19.305 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:19.302+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:19.347 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:06:19.380 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:19.380 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:19.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:19.380 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 220.63697318499999, 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.381 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.387 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 220.636880714, 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:19.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:19.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:19.393 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.66663585500001, 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:19.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:19.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:19.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:19.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.62439373399999, 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:19.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.58509426800001, 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:19.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:19.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.57808985200001, 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:19.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.57048406999999, 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:19.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:19.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.423 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.51320806300001, 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:19.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:19.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.502090487, 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:19.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:19.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.37725095799999, 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.28159579699999, 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.27745752499999, 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:19.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.244705802, 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:19.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:19.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.080023603, 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:19.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:19.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 217.02281689500001, 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:19.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:19.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.880640188, 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:19.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:19.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:19.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.85995456200001, 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:19.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:19.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.853398422, 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:19.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:19.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.76845395399999, 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 216.761531115, 2024-05-10T14:06:19.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:19.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:19.499 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:19.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:19.501 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:19.499+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:19.602 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:19.603+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:19.631 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:19.631 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:19.631 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:19.646 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:19.733 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:19.735+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:19.804 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:19.802+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:19.814 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:19.814 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:19.814 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:19.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:19.917 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:19.919+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.30321030299999, 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:20.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:20.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.27537213599999, 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.26161341299999, 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.17870981999999, 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.15237206099999, 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.023 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:20.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.028 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.15128200999999, 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.033 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.148394954, 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.034 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:20.039 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.145816551, 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:20.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.11453725499999, 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:20.044 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:20.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.06289895, 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.050 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.052 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:20.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.9787528, 2024-05-10T14:06:20.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:20.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:20.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.97470727000001, 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.063 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:20.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:20.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.90844228899999, 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:20.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:20.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:20.072 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.074 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.87135700100001, 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:20.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:20.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:20.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.864224159, 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.081 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.082 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.083 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.084 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.66248309299999, 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.087 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.088 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.089 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.506553035, 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.093 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.094 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.095 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.096 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.097 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.098 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.49952255599999, 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.099 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.100 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.101 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:20.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.40172082800001, 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.104 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.105 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 217.394414434, 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.110 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.111 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:20.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.115 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:20.117 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:20.117 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:20.118+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:20.218 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:20.218+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:20.292 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:20.292 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:20.307 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:20.319 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:20.318+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:20.420 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:20.419+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:20.433 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:20.433 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:20.447 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:20.533 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:20.535+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 225.86292143599999, 2024-05-10T14:06:20.610 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:06:20.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.613 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.91031569500001, 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:06:20.615 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:06:20.617 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.618 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.619 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.88287172099999, 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:06:20.622 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.625 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:20.628 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.869614267, 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:20.629 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.630 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:06:20.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:06:20.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:06:20.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:06:20.634 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.86704235100001, 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.635 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:06:20.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:06:20.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:06:20.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.640 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.77042976000001, 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.641 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:06:20.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.644 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.85431493600001, 2024-05-10T14:06:20.645 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:20.646 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:06:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.648 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:06:20.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:20.650 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.814973329, 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.651 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:06:20.652 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.653 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.654 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:20.655 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.756003365, 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.657 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:06:20.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.740461732, 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:20.660 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.661 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:06:20.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:20.664 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.73995569900001, 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.665 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:06:20.666 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.667 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:06:20.669 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.671 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.73573618099999, 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:06:20.672 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.673 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.675 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.676 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:06:20.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:06:20.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:20.680 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.72067118300001, 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:20.681 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.682 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.683 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.71928516099999, 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.685 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.686 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.687 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:06:20.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.714343697, 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.691 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:06:20.692 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.693 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.713887849, 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.695 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:06:20.696 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.697 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:20.699 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.69886858300001, 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.700 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:06:20.702 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.693802562, 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.704 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.705 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:06:20.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:06:20.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 218.59983246199999, 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:06:20.708 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.710 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.711 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.712 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 200.79022072699999, 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:20.713 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.714 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:20.716 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:20.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:20.719 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:20.719+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:20.819 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:20.819+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:20.902 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:20.945 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:20.947+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:21.022 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:21.023+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:21.073 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:21.073 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:21.087 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:21.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:21.129 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:21.131+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:21.224 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:21.223+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:21.258 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 241.70965762899999, 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:06:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 241.086753872, 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:06:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:06:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:06:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:06:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.991220226, 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:06:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:06:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:06:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99116602000001, 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:06:21.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:06:21.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99112915000001, 2024-05-10T14:06:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:06:21.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.291 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99096760500001, 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:06:21.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99091426499999, 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:06:21.297 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.300 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.302 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99085634599999, 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:06:21.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:06:21.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:21.308 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99072659699999, 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:06:21.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:06:21.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.99068814, 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.314 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:06:21.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:06:21.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.319 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76356501699999, 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:06:21.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:06:21.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:06:21.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76335757199999, 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.326 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:06:21.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76324368600001, 2024-05-10T14:06:21.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:06:21.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:06:21.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.336 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.763075281, 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:06:21.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:21.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:06:21.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:06:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76303772099999, 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:06:21.342 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:06:21.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.346 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.347 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.762984305, 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.348 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:06:21.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:06:21.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:06:21.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.353 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76285901599999, 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.354 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:06:21.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:06:21.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76281887299999, 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:06:21.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:06:21.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:06:21.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.365 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.76276648999999, 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:06:21.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:06:21.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:21.371 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 240.762582092, 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:06:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:06:21.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:21.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:21.377 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:21.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:06:21.379 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:21.379 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:21.380 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:21.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:21.381 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:21.381 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:21.382 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:21.382 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:21.383 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:21.383 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:21.378+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:21.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:21.397 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:21.418 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:21.418 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:21.482 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:21.482+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:21.553 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:21.553 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:21.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:21.580 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:21.578+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:21.681 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:21.683+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:21.692 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:21.692 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:21.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:21.782 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:21.782+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:21.870 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:21.870 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:21.883 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:21.883+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:21.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:21.984 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:21.983+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:22.014 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:22.084 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:22.083+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:22.155 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.155 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:22.186 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:22.187+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:22.287 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:22.286+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:22.298 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.299 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:22.359 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:06:22.434 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:22.434+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:22.484 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.484 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.488 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:22.487+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:22.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:22.590 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:22.591+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:22.671 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.671 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:22.690 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:22.691+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:22.791 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:22.791+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:22.809 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.809 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:22.894 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:22.891+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:22.952 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:22.952 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:22.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:22.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~115s 2024-05-10T14:06:22.993 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:22.995+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:23.088 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:23.089 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:23.094 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:23.095+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:23.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:23.195 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:23.194+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:23.222 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:23.222 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:23.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:23.295 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:23.295+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:23.396 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:23.394+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:23.401 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:23.401 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:23.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:23.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:23.497 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:23.499+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:23.577 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:23.577 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:23.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:23.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:23.601 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:23.602 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:23.598+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:23.618 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:23.618 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:23.634 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:23.650 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:23.651 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:23.672 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:23.672 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:23.691 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:23.691 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:23.699 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:23.698+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206011502976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 224.959133366, 2024-05-10T14:06:23.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030730390000000001, 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743793+0000", 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743795+0000", 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.745e-06 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743802+0000", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4270000000000002e-06 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743825+0000", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2770000000000001e-05 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743837+0000", 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1559999999999999e-05 2024-05-10T14:06:23.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743914+0000", 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.716e-05 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744066+0000", 2024-05-10T14:06:23.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015187100000000001 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744520+0000", 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045377200000000002 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746409+0000", 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018890560000000001 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746582+0000", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017359299999999999 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746727+0000", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144926 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746866+0000", 2024-05-10T14:06:23.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000139159 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 224.95904089499999, 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029225990000000001, 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 58 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743886+0000", 2024-05-10T14:06:23.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743887+0000", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3600000000000002e-07 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743891+0000", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2069999999999997e-06 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743902+0000", 2024-05-10T14:06:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1432e-05 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.743911+0000", 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2800000000000003e-06 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744010+0000", 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9758000000000003e-05 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744314+0000", 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030361 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.744553+0000", 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023914100000000001 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.745894+0000", 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341346 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746605+0000", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071087600000000004 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746717+0000", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111224 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:38.746808+0000", 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1788999999999998e-05 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.988796036, 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039834359999999999, 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714131+0000", 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714134+0000", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.687e-06 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714151+0000", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6966e-05 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714205+0000", 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3672999999999999e-05 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714232+0000", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.739e-05 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714371+0000", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013856200000000001 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.714596+0000", 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022484800000000001 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.715018+0000", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042182100000000001 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.716619+0000", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001601473 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.717959+0000", 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013395670000000001 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718044+0000", 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5832000000000001e-05 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.718114+0000", 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9616999999999994e-05 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.94655391500001, 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034856290000000001, 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756373+0000", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756376+0000", 2024-05-10T14:06:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2559999999999998e-06 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756392+0000", 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5743000000000002e-05 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756436+0000", 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4002999999999999e-05 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756454+0000", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8490000000000001e-05 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756578+0000", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012374900000000001 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.756817+0000", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023874500000000001 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.757252+0000", 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000435217 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.758708+0000", 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014563709999999999 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759647+0000", 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093893299999999998 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759739+0000", 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1643000000000003e-05 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.759858+0000", 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119479 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.90725444899999, 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032096249999999998, 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795672+0000", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795675+0000", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795686+0000", 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1620000000000001e-05 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795718+0000", 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1659999999999998e-05 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795733+0000", 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5203e-05 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.795861+0000", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012819599999999999 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796103+0000", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000242208 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.796535+0000", 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043195700000000001 2024-05-10T14:06:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798240+0000", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017049700000000001 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798676+0000", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043606299999999999 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798763+0000", 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6732999999999998e-05 2024-05-10T14:06:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.798882+0000", 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118742 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.90025003299999, 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003651582, 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802677+0000", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802679+0000", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2730000000000001e-06 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802690+0000", 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1387e-05 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802721+0000", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1106000000000003e-05 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802737+0000", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.522e-05 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.802855+0000", 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011875900000000001 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803070+0000", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021459199999999999 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.803488+0000", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000418243 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.804770+0000", 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00128141 2024-05-10T14:06:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806041+0000", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012716909999999999 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806202+0000", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016104499999999999 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.806328+0000", 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012585600000000001 2024-05-10T14:06:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.89264425100001, 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031712950000000002, 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810282+0000", 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810285+0000", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810295+0000", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0723000000000001e-05 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810327+0000", 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1442999999999997e-05 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810342+0000", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5213e-05 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810452+0000", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110389 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.810681+0000", 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022832199999999999 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.811113+0000", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043222699999999998 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.812590+0000", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001476652 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813303+0000", 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071363700000000004 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813387+0000", 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3603000000000006e-05 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.813454+0000", 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6872999999999995e-05 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:396 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.83536824399999, 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031813520000000001, 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 396 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867558+0000", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867560+0000", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1689999999999999e-06 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867565+0000", 2024-05-10T14:06:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6189999999999999e-06 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867579+0000", 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3767e-05 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867586+0000", 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6819999999999997e-06 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867644+0000", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8415000000000002e-05 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867737+0000", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3165000000000007e-05 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.867869+0000", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131858 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.868436+0000", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056686499999999995 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870636+0000", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022000740000000002 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870691+0000", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4466999999999999e-05 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.870740+0000", 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9271000000000003e-05 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4379.0:420 6.2 e35/29 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.82425066799999, 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030980000000000001, 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878676+0000", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878677+0000", 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9800000000000002e-07 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878684+0000", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0720000000000002e-06 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878695+0000", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0566e-05 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878702+0000", 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7309999999999993e-06 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878760+0000", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7345000000000001e-05 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.878780+0000", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0072999999999999e-05 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881689+0000", 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029090549999999998 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:41.881774+0000", 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5160000000000005e-05 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:622 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.69941113900001, 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031638320000000001, 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 622 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003516+0000", 2024-05-10T14:06:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003517+0000", 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0809999999999999e-06 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003524+0000", 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0650000000000001e-06 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003537+0000", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3519999999999999e-05 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003544+0000", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5880000000000003e-06 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.003680+0000", 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013635000000000001 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004055+0000", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037450800000000001 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.004632+0000", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057695499999999998 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.005674+0000", 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001042715 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006593+0000", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00091845399999999997 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006630+0000", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7209999999999998e-05 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.006679+0000", 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9385999999999998e-05 2024-05-10T14:06:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.60375597800001, 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003152176, 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099171+0000", 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099173+0000", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.243e-06 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099184+0000", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1403000000000001e-05 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099215+0000", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0923000000000002e-05 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099234+0000", 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8444000000000002e-05 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099383+0000", 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148832 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099598+0000", 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021578499999999999 2024-05-10T14:06:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.099932+0000", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033408400000000001 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.101041+0000", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001108665 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102157+0000", 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011162380000000001 2024-05-10T14:06:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102256+0000", 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8663e-05 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.102323+0000", 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6896000000000005e-05 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:717 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.599617706, 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002864007, 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 717 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103309+0000", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103311+0000", 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6199999999999999e-06 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103319+0000", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000002e-06 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103344+0000", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4369e-05 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103356+0000", 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2303000000000001e-05 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103481+0000", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124876 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103615+0000", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013432200000000001 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.103890+0000", 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027449499999999998 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.104923+0000", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010333079999999999 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.105958+0000", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010350590000000001 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106053+0000", 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5305999999999999e-05 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.106173+0000", 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011951900000000001 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.56686598300001, 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029262839999999999, 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 730 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136061+0000", 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136063+0000", 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6539999999999999e-06 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136075+0000", 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1525999999999999e-05 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136106+0000", 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1596e-05 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136122+0000", 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5943e-05 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136245+0000", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122769 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136468+0000", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222652 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.136802+0000", 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033376100000000002 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.137973+0000", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171381 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138830+0000", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085663000000000004 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138923+0000", 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3195999999999993e-05 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.138987+0000", 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4176000000000004e-05 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.40218378399999, 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003302508, 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300743+0000", 2024-05-10T14:06:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300745+0000", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5239999999999999e-06 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300757+0000", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1499e-05 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300788+0000", 2024-05-10T14:06:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1356000000000003e-05 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300804+0000", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5404e-05 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.300957+0000", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015369200000000001 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301337+0000", 2024-05-10T14:06:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037933699999999999 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.301950+0000", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00061298500000000003 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303228+0000", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012787479999999999 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303760+0000", 2024-05-10T14:06:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00053166900000000002 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.303929+0000", 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016920800000000001 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.304045+0000", 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116086 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.34497707599999, 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028714690000000002, 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 826 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357950+0000", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357952+0000", 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3700000000000002e-06 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357963+0000", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.145e-05 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.357996+0000", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2403999999999997e-05 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358011+0000", 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.524e-05 2024-05-10T14:06:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358127+0000", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116042 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358354+0000", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022640799999999999 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.358708+0000", 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035430699999999999 2024-05-10T14:06:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.359964+0000", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001256348 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360660+0000", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069533099999999999 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360752+0000", 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2799000000000004e-05 2024-05-10T14:06:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.360821+0000", 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8769999999999994e-05 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.20280036899999, 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003165466, 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 886 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500126+0000", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500129+0000", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500143+0000", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.456e-05 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500174+0000", 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1362999999999998e-05 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500190+0000", 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5709000000000002e-05 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500336+0000", 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014568299999999999 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500558+0000", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221998 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.500875+0000", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031709099999999998 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.502044+0000", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001169111 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503115+0000", 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001070898 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503206+0000", 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0969000000000003e-05 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.503292+0000", 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5844e-05 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.182114743, 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028726820000000001, 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 895 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520812+0000", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520814+0000", 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-05-10T14:06:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520826+0000", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1909999999999999e-05 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520858+0000", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2079999999999998e-05 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.520882+0000", 2024-05-10T14:06:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4116000000000001e-05 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521007+0000", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124676 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521227+0000", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021975799999999999 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.521565+0000", 2024-05-10T14:06:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033843399999999998 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.522546+0000", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098081600000000002 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523533+0000", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098728500000000007 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523621+0000", 2024-05-10T14:06:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7709999999999999e-05 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.523685+0000", 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3542999999999998e-05 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.17555860300001, 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031310830000000002, 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527368+0000", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527370+0000", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6899999999999999e-06 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527379+0000", 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2930000000000006e-06 2024-05-10T14:06:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527404+0000", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4963000000000001e-05 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527423+0000", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.944e-05 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527541+0000", 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011790600000000001 2024-05-10T14:06:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.527754+0000", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000212742 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.528079+0000", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032459699999999998 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.529135+0000", 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056099 2024-05-10T14:06:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530355+0000", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012201410000000001 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530437+0000", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2461999999999998e-05 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.530499+0000", 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1749999999999997e-05 2024-05-10T14:06:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.09061413500001, 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030500530000000001, 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 934 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612313+0000", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612315+0000", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612326+0000", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1236999999999999e-05 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612358+0000", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1463e-05 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612373+0000", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5627000000000001e-05 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612519+0000", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146009 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.612741+0000", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000221671 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.613077+0000", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00033646700000000002 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.614262+0000", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001184341 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615181+0000", 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000919303 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615270+0000", 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9256000000000001e-05 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.615363+0000", 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2396000000000001e-05 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4379.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 221.08369129600001, 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030318670000000002, 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4379", 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619235+0000", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619237+0000", 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0540000000000002e-06 2024-05-10T14:06:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619248+0000", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0115999999999999e-05 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619275+0000", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7540000000000001e-05 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619292+0000", 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7033000000000001e-05 2024-05-10T14:06:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619405+0000", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112563 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619632+0000", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022756799999999999 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.619955+0000", 2024-05-10T14:06:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032301399999999999 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.621060+0000", 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001105078 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622109+0000", 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010484590000000001 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-05-10T14:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622203+0000", 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3895999999999997e-05 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-05-10T14:02:42.622267+0000", 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4546000000000002e-05 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-10T14:06:23.815 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:06:23.816 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:23.816 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:23.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:23.818 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:23.818 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:23.819 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:23.815+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:23.918 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:23.918+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:23.950 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:23.950 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:23.950 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:23.950 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:23.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:24.019 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:24.019+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:24.085 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:24.085 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:24.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:24.141 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:24.143+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:24.219 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-05-10T14:06:24.220 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T14:06:24.220 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:24.222+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:24.268 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:24.268 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.57711238799999, 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.269 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.270 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:24.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:24.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 225.54927422099999, 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:24.277 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.535515498, 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.278 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.279 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.281 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.282 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.283 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.452611905, 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.284 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.285 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.286 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.426274146, 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.290 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:24.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:24.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.42518409499999, 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:24.296 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:24.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:24.298 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.299 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.422297039, 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.300 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:24.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:24.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:24.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.419718636, 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:24.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:24.309 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.38843933999999, 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.310 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.311 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:24.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:24.313 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.314 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.315 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.33680103500001, 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.316 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:24.321 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.252654885, 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.322 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:24.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:24.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.326 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.24860935500001, 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.328 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:24.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:24.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.333 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.182344374, 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.334 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.336 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.339 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.14525908600001, 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:24.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:24.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:24.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.13812624400001, 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.346 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:24.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:24.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.93638517799999, 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.353 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:24.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:24.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.356 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:24.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.358 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.78045512, 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.77342464099999, 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.364 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:24.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:24.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:24.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.369 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.67562291300001, 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 221.668316519, 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.375 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:24.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:24.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:24.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.380 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.381 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:24.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:24.383 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:24.382+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:24.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T14:06:24.483 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:24.483+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:24.509 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:24.509 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:24.510 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:24.510 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:24.525 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:24.617 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:24.619+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:24.685 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:24.682+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:24.695 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:24.695 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:24.695 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:24.696 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:24.696 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:24.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:24.786 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:24.782+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:24.876 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.12981969200001, 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.877 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:06:24.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.177213951, 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:06:24.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:06:24.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:06:24.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:06:24.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.14976997700001, 2024-05-10T14:06:24.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:24.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:06:24.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:06:24.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.13651252299999, 2024-05-10T14:06:24.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:06:24.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:06:24.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.133940607, 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:06:24.900 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:06:24.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.037328016, 2024-05-10T14:06:24.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:06:24.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:06:24.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.910 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.121213192, 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:24.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.08187158499999, 2024-05-10T14:06:24.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:06:24.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.918 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.919 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.02290162099999, 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:06:24.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.00735998799999, 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:06:24.924 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:06:24.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:06:24.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.006853955, 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:06:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:06:24.932 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 223.00263443700001, 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:06:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:24.937 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.987569439, 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.938 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.941 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.98618341700001, 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:06:24.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.98124195299999, 2024-05-10T14:06:24.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:06:24.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.950 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.98078610499999, 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:06:24.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:06:24.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.965766839, 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:06:24.955 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:06:24.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:06:24.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.96070081799999, 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:06:24.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:06:24.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 222.86673071800001, 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:24.964 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:06:24.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:06:24.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:06:24.968 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 205.05711898300001, 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:24.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:24.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.972 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:24.973 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:24.973 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:24.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:24.975 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:24.974+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:25.076 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:25.075+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:25.102 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:25.102 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:25.102 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:25.102 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:25.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:25.201 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:25.203+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:25.278 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:25.278+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:25.282 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:25.282 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:25.282 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:25.282 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:25.282 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:25.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:25.382 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-05-10T14:06:25.389 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:25.391+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.919544769, 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.467 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.473 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.29664101200001, 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:25.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:06:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.201107366, 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:06:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:06:25.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:06:25.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:06:25.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:06:25.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20105315999999, 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.485 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20101629000001, 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20085474499999, 2024-05-10T14:06:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:06:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:06:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:06:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20080140499999, 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.503 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:06:25.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:06:25.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:06:25.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.507 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20074348599999, 2024-05-10T14:06:25.508 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:06:25.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:06:25.511 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:06:25.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:06:25.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.200613737, 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.514 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:06:25.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:06:25.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:06:25.518 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:06:25.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 245.20057528000001, 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.520 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:25.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.973452157, 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.526 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:06:25.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:06:25.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:06:25.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:06:25.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.973244712, 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:06:25.531 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:06:25.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:06:25.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97313082599999, 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.537 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:06:25.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:06:25.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.541 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.542 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97296242100001, 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.543 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:06:25.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:06:25.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.548 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.972924861, 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97287144500001, 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:06:25.554 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:06:25.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:06:25.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.972746156, 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.560 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:06:25.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:06:25.564 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.565 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97270601299999, 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.566 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:25.567 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:06:25.568 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.569 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.570 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.571 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97265363, 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:06:25.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.573 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.575 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:25.577 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 244.97246923200001, 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:25.578 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:25.579 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.580 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.581 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:25.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:25.583 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:25.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:25.585 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:25.583+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:25.685 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:25.687+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:25.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:25.786 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:25.786+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:25.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T14:06:25.887 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:25.887+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:25.935 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:25.935 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:25.935 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:25.935 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:25.935 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:25.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:25.978 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:25.979 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:25.988 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-10T14:06:25.986+0000 7fb235e84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25103) UID: 0 2024-05-10T14:06:25.996 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:25.997 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:26.015 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:26.015 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:26.032 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:26.032 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:26.050 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:26.069 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:26.070 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:26.089 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:26.090 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:26.091+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:26.110 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:26.113 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.113 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T14:06:26.214 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:26.214+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:26.291 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:26.291+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T14:06:26.402 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:26.402+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:26.482 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.482 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.493 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:26.490+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:26.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T14:06:26.594 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:26.590+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:26.668 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.668 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T14:06:26.726 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-10T14:06:26.726+0000 7f5eac5b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25107) UID: 0 2024-05-10T14:06:26.796 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:26.795+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:26.846 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.846 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T14:06:26.896 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-05-10T14:06:26.895+0000 7fa7f689a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31310) UID: 0 2024-05-10T14:06:26.985 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:26.986 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:26.997 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-10T14:06:26.994+0000 7f756a874640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25105) UID: 0 2024-05-10T14:06:27.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T14:06:27.098 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-05-10T14:06:27.099+0000 7f5aa35ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25265) UID: 0 2024-05-10T14:06:27.173 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.173 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T14:06:27.200 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.199+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.301 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.299+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.316 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.316 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T14:06:27.401 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.403+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T14:06:27.459 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.459 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T14:06:27.502 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.503+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.596 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.596 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.602 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:27.603+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:27.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T14:06:27.704 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.703+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.733 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.733 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T14:06:27.775 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-05-10T14:06:27.804 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-05-10T14:06:27.803+0000 7f45b2a6c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25270) UID: 0 2024-05-10T14:06:27.810 INFO:tasks.workunit.client.0.smithi016.stderr:Can't call method "err" on an undefined value at /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl line 199. 2024-05-10T14:06:27.810 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-05-10T14:06:27.814 DEBUG:teuthology.orchestra.run:got remote process result: 111 2024-05-10T14:06:27.814 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-05-10T14:06:27.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-10T14:06:27.874 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:27.874 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:27.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T14:06:27.904 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-05-10T14:06:27.903+0000 7f6cf863e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25266) UID: 0 2024-05-10T14:06:28.005 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:28.002+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:28.053 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:28.053 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:28.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T14:06:28.114 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-10T14:06:28.114+0000 7f873d400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25101) UID: 0 2024-05-10T14:06:28.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T14:06:28.180 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rgw/s3_bucket_quota.pl) on smithi016 with status 111: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7ef97a7233c4db41f8dc134b8d64f95427147ce5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl' 2024-05-10T14:06:28.418 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ff12cff891034221b25cdcd960356193 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7ef97a7233c4db41f8dc134b8d64f95427147ce5/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rgw/s3_bucket_quota.pl) on smithi016 with status 111: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7ef97a7233c4db41f8dc134b8d64f95427147ce5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl' 2024-05-10T14:06:28.421 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-10T14:06:28.430 INFO:tasks.thrashosds:joining thrashosds 2024-05-10T14:06:28.435 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-05-10T14:06:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T14:06:28.436 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-05-10T14:06:28.436 INFO:teuthology.orchestra.run.smithi130.stdout:ERROR: (22) Invalid argument 2024-05-10T14:06:28.436 INFO:teuthology.orchestra.run.smithi130.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T14:06:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T14:06:28.437 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T14:06:28.438 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-05-10T14:06:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T14:06:28.438 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-05-10T14:06:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T14:06:28.439 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-05-10T14:06:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T14:06:28.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-05-10T14:06:28.448 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T14:06:28.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-05-10T14:06:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T14:06:28.449 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-05-10T14:06:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T14:06:28.578 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:28.579 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:28.579 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:28.579 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:28.579 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:28.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T14:06:28.716 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:28.716 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 232.02678569899999, 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014130441000000001, 2024-05-10T14:06:28.717 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 43 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.718 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.719 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689622+0000", 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689626+0000", 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0500000000000002e-06 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689662+0000", 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6455999999999998e-05 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689702+0000", 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9773e-05 2024-05-10T14:06:28.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689727+0000", 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5340000000000001e-05 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.722 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689905+0000", 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000178128 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:28.723 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.689928+0000", 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2887e-05 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703416+0000", 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.013487783 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.724 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:36.703752+0000", 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033602399999999998 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.725 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 229.99894753199999, 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0044433370000000003, 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717460+0000", 2024-05-10T14:06:28.727 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717461+0000", 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.116e-06 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.728 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717473+0000", 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1987000000000001e-05 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717494+0000", 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1382999999999998e-05 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717518+0000", 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4294000000000002e-05 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.730 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717816+0000", 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00029705699999999999 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.717869+0000", 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.3229999999999997e-05 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721790+0000", 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039213479999999998 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.721903+0000", 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000112922 2024-05-10T14:06:28.732 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.733 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.733 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.733 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.98518880899999, 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0095663899999999993, 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.734 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 211 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:28.735 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731218+0000", 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.736 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731222+0000", 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5640000000000001e-06 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731238+0000", 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6172999999999999e-05 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.737 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731274+0000", 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6186999999999998e-05 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731295+0000", 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0353e-05 2024-05-10T14:06:28.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731467+0000", 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017186100000000001 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op must wait for map", 2024-05-10T14:06:28.739 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.731499+0000", 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2193999999999997e-05 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737704+0000", 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0062057019999999996 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.740 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.737938+0000", 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000233489 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.738342+0000", 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00040447600000000002 2024-05-10T14:06:28.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.739776+0000", 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001433899 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.742 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740574+0000", 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00079756599999999999 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740685+0000", 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000111183 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.740785+0000", 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9742999999999997e-05 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.902285216, 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032502730000000001, 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 232 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:28.746 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814122+0000", 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.747 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814125+0000", 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8729999999999999e-06 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814137+0000", 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2383e-05 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814170+0000", 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2950000000000001e-05 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814186+0000", 2024-05-10T14:06:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.588e-05 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814367+0000", 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018089899999999999 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.750 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.814596+0000", 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229151 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.815031+0000", 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00043449599999999998 2024-05-10T14:06:28.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.816719+0000", 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001687993 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.752 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817211+0000", 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00049272300000000003 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817302+0000", 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0586000000000003e-05 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.817372+0000", 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0339000000000005e-05 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.875947457, 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029326859999999999, 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 276 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.756 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840460+0000", 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840462+0000", 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840477+0000", 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.438e-05 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840507+0000", 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0006e-05 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840525+0000", 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8393000000000002e-05 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840670+0000", 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014444600000000001 2024-05-10T14:06:28.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.840918+0000", 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024885100000000002 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:28.761 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841308+0000", 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038919699999999998 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.842564+0000", 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0012562389999999999 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843127+0000", 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056294600000000004 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843287+0000", 2024-05-10T14:06:28.763 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016003499999999999 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.843392+0000", 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105683 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:280 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.87485740599999, 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041708860000000004, 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.765 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.766 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841550+0000", 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841552+0000", 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8199999999999999e-06 2024-05-10T14:06:28.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841566+0000", 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.428e-05 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841639+0000", 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3386000000000005e-05 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841661+0000", 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1767e-05 2024-05-10T14:06:28.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841840+0000", 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017891399999999999 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.841885+0000", 2024-05-10T14:06:28.770 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5337000000000003e-05 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845621+0000", 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0037361220000000001 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.771 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845721+0000", 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9259999999999995e-05 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:302 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.772 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.87197035, 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0040048169999999999, 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.773 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 302 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844437+0000", 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.775 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844439+0000", 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3070000000000001e-06 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844451+0000", 2024-05-10T14:06:28.776 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1437000000000001e-05 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844482+0000", 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0995999999999999e-05 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.777 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844503+0000", 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1336e-05 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844644+0000", 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014123900000000001 2024-05-10T14:06:28.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.844867+0000", 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022324500000000001 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:28.779 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.845238+0000", 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00037033999999999998 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.846627+0000", 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013894720000000001 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848243+0000", 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016157739999999999 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848348+0000", 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010524899999999999 2024-05-10T14:06:28.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.848442+0000", 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3422000000000001e-05 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:316 6.14 e35/29 6:2c0c0c23:reshard::reshard.0000000001:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.869391947, 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0039875639999999999, 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.783 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.784 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847015+0000", 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847017+0000", 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4529999999999999e-06 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847030+0000", 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2809999999999999e-05 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.786 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847056+0000", 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6236000000000001e-05 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847073+0000", 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6892999999999999e-05 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.787 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847205+0000", 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013268199999999999 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.789 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.847261+0000", 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5807000000000003e-05 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.850894+0000", 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0036332740000000001 2024-05-10T14:06:28.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.851003+0000", 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000108409 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:420 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.83811265099999, 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045293060000000003, 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.792 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 420 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.793 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878295+0000", 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878297+0000", 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0899999999999999e-06 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878308+0000", 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1012999999999999e-05 2024-05-10T14:06:28.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878337+0000", 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8875999999999999e-05 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.796 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878352+0000", 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5556000000000001e-05 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878468+0000", 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115776 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.797 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878602+0000", 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013444600000000001 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 3", 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.878909+0000", 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030632100000000002 2024-05-10T14:06:28.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.880275+0000", 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001366356 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.799 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882548+0000", 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0022728869999999999 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882710+0000", 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016178899999999999 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.882824+0000", 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114196 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:512 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.78647434600001, 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030476430000000001, 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.802 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 512 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929933+0000", 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929934+0000", 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.55e-06 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.805 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929943+0000", 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1359999999999997e-06 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929963+0000", 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0166999999999999e-05 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.929975+0000", 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1787000000000001e-05 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930110+0000", 2024-05-10T14:06:28.807 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000135943 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930360+0000", 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024938100000000002 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:28.808 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.930750+0000", 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000390627 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932358+0000", 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016076199999999999 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932834+0000", 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00047601400000000003 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932897+0000", 2024-05-10T14:06:28.810 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2965000000000004e-05 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.932981+0000", 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.3453000000000002e-05 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:635 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.702328196, 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029866720000000001, 2024-05-10T14:06:28.812 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 635 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.813 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.814 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014079+0000", 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014081+0000", 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.3860000000000001e-06 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.815 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014095+0000", 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3346999999999999e-05 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014130+0000", 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.5370000000000002e-05 2024-05-10T14:06:28.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014153+0000", 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2463000000000002e-05 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.817 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014300+0000", 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000147825 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014586+0000", 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028528800000000002 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.014983+0000", 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00039746999999999997 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.819 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016315+0000", 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001331783 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016884+0000", 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00056859499999999997 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.820 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.016971+0000", 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7056000000000001e-05 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.017066+0000", 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5088999999999997e-05 2024-05-10T14:06:28.821 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:639 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.69828266600001, 2024-05-10T14:06:28.822 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046922639999999998, 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 639 2024-05-10T14:06:28.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018125+0000", 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018126+0000", 2024-05-10T14:06:28.825 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.823e-06 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018136+0000", 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3940000000000002e-06 2024-05-10T14:06:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018162+0000", 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5896000000000001e-05 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018176+0000", 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4087000000000001e-05 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018276+0000", 2024-05-10T14:06:28.828 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000100004 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018402+0000", 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000125976 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 5", 2024-05-10T14:06:28.829 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.018644+0000", 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024226099999999999 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.019589+0000", 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000945118 2024-05-10T14:06:28.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022690+0000", 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031004460000000002 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022761+0000", 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1429999999999999e-05 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.022817+0000", 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5828999999999997e-05 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.63201768499999, 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029170160000000001, 2024-05-10T14:06:28.833 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 709 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084390+0000", 2024-05-10T14:06:28.835 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084392+0000", 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2129999999999998e-06 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.836 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084403+0000", 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.082e-05 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084434+0000", 2024-05-10T14:06:28.837 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1202999999999999e-05 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084450+0000", 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5886e-05 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.838 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084580+0000", 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013076299999999999 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.084783+0000", 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000202795 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.085085+0000", 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030213700000000001 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.086450+0000", 2024-05-10T14:06:28.840 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013643329999999999 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087148+0000", 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00069793500000000001 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.841 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087230+0000", 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1932000000000001e-05 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.087307+0000", 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6998999999999999e-05 2024-05-10T14:06:28.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.59493239700001, 2024-05-10T14:06:28.843 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002944496, 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 724 2024-05-10T14:06:28.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.845 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121475+0000", 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121477+0000", 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5100000000000001e-06 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121491+0000", 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3390000000000001e-05 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121522+0000", 2024-05-10T14:06:28.847 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1019999999999998e-05 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121538+0000", 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5855999999999999e-05 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.848 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121680+0000", 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000142392 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.121904+0000", 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022418500000000001 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.122222+0000", 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031748399999999998 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.850 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.123310+0000", 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001088498 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124224+0000", 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091412999999999998 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124311+0000", 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7114999999999995e-05 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.124419+0000", 2024-05-10T14:06:28.852 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000107916 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:28.853 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.587799555, 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032472640000000001, 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.854 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 727 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.855 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128608+0000", 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128610+0000", 2024-05-10T14:06:28.856 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.024e-06 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128620+0000", 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0169e-05 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128646+0000", 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5956999999999999e-05 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.858 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128660+0000", 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4202999999999999e-05 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.128799+0000", 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013918599999999999 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.859 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129037+0000", 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023787799999999999 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.129400+0000", 2024-05-10T14:06:28.860 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00036324399999999998 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.130442+0000", 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010418809999999999 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131711+0000", 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001268686 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131793+0000", 2024-05-10T14:06:28.862 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1682999999999997e-05 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.131855+0000", 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2353000000000004e-05 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.38605848899999, 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029925849999999999, 2024-05-10T14:06:28.864 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 814 2024-05-10T14:06:28.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330349+0000", 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330351+0000", 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7429999999999998e-06 2024-05-10T14:06:28.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330366+0000", 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4146e-05 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.868 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330403+0000", 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7639999999999999e-05 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330427+0000", 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.385e-05 2024-05-10T14:06:28.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330549+0000", 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000121642 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.870 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.330756+0000", 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020678800000000001 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.331065+0000", 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030981100000000001 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.332385+0000", 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013195489999999999 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333187+0000", 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00080183399999999997 2024-05-10T14:06:28.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333274+0000", 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7483000000000002e-05 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.873 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.333341+0000", 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7099000000000003e-05 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.874 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.230128431, 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032026709999999998, 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 880 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486279+0000", 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.877 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486282+0000", 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4029999999999999e-06 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486295+0000", 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3037000000000001e-05 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486328+0000", 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2629000000000002e-05 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486344+0000", 2024-05-10T14:06:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6047000000000001e-05 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486501+0000", 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015700600000000001 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.880 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.486743+0000", 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000241871 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.487084+0000", 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034129700000000001 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.488239+0000", 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001155414 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489313+0000", 2024-05-10T14:06:28.882 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001073505 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489408+0000", 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5168999999999996e-05 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.883 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.489481+0000", 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3293000000000005e-05 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.884 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.22309795199999, 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0030757179999999999, 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.885 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 883 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493309+0000", 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493311+0000", 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.767e-06 2024-05-10T14:06:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493322+0000", 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0726e-05 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493345+0000", 2024-05-10T14:06:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.302e-05 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493360+0000", 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5449999999999999e-05 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493486+0000", 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012539300000000001 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.493725+0000", 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00023892799999999999 2024-05-10T14:06:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 2", 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.494136+0000", 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041188599999999998 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.495369+0000", 2024-05-10T14:06:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001233023 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496225+0000", 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00085563999999999996 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496319+0000", 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3653000000000006e-05 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.496385+0000", 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.6231999999999999e-05 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.12529622400001, 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029850290000000002, 2024-05-10T14:06:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 925 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591111+0000", 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591113+0000", 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.463e-06 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591125+0000", 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1926000000000001e-05 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591156+0000", 2024-05-10T14:06:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.078e-05 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591172+0000", 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5500000000000001e-05 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591311+0000", 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013964899999999999 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591569+0000", 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025774499999999998 2024-05-10T14:06:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.591892+0000", 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00032325399999999998 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.592964+0000", 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010716110000000001 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.593940+0000", 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097594299999999995 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594025+0000", 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5074999999999994e-05 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.594096+0000", 2024-05-10T14:06:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1082999999999997e-05 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T14:06:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 226.11798983, 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031673510000000001, 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 928 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598417+0000", 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598419+0000", 2024-05-10T14:06:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.88e-06 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598428+0000", 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1530000000000003e-06 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598454+0000", 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5547000000000001e-05 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598473+0000", 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9076000000000002e-05 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598588+0000", 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000114789 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.598797+0000", 2024-05-10T14:06:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000209318 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 6", 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.599114+0000", 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00031706799999999999 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.600308+0000", 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00119406 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601398+0000", 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010896149999999999 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601486+0000", 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8401999999999998e-05 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.601585+0000", 2024-05-10T14:06:28.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8443000000000006e-05 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:28.914 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:28.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T14:06:29.046 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.046 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:29.046 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:29.046 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:29.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T14:06:29.182 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.182 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:29.182 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:29.183 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:29.183 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:29.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4461.0:40 5.3 e28/27 5:c780874f:::zonegroup_info.dced2414-d93c-40d5-b3a6-4c784cbe22b7:head v 28'1, mlcod=0'0)", 2024-05-10T14:06:29.327 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 234.58015171100001, 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001729773, 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.328 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745481+0000", 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745483+0000", 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9870000000000002e-06 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.330 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745496+0000", 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2593e-05 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745523+0000", 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7095999999999999e-05 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745537+0000", 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4749999999999999e-05 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745631+0000", 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3294000000000005e-05 2024-05-10T14:06:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.745677+0000", 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5880000000000001e-05 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.333 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747111+0000", 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001434187 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:34.747211+0000", 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.9986000000000001e-05 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.334 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.62754597, 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.026864375999999999, 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.335 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698087+0000", 2024-05-10T14:06:29.337 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698090+0000", 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.066e-06 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.338 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698103+0000", 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3546999999999999e-05 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698138+0000", 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4436e-05 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.698164+0000", 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.5766e-05 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703648+0000", 2024-05-10T14:06:29.340 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0054846290000000004 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.703670+0000", 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1573000000000002e-05 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.341 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715512+0000", 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011842507 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.715762+0000", 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00024948499999999997 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.716088+0000", 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000325944 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.720350+0000", 2024-05-10T14:06:29.343 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0042625859999999996 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724700+0000", 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043494730000000004 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.344 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724837+0000", 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000137751 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.724951+0000", 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113613 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.345 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.60010199600001, 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035858349999999999, 2024-05-10T14:06:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.347 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725531+0000", 2024-05-10T14:06:29.348 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725534+0000", 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4460000000000001e-06 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.349 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725548+0000", 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3871e-05 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725580+0000", 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1760000000000001e-05 2024-05-10T14:06:29.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725641+0000", 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1699000000000007e-05 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.725821+0000", 2024-05-10T14:06:29.351 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000179424 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726029+0000", 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020827399999999999 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 4", 2024-05-10T14:06:29.352 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.726418+0000", 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000388351 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728159+0000", 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017411480000000001 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.728923+0000", 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00076479499999999997 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729006+0000", 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2855000000000005e-05 2024-05-10T14:06:29.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.729117+0000", 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011021199999999999 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.58684454199999, 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023948350000000001, 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.356 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 54 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.357 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738788+0000", 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.358 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738790+0000", 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.21e-06 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738801+0000", 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1060000000000001e-05 2024-05-10T14:06:29.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738831+0000", 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9726e-05 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738847+0000", 2024-05-10T14:06:29.360 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5707000000000001e-05 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.738963+0000", 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116308 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.361 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739114+0000", 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015076299999999999 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.739267+0000", 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015309699999999999 2024-05-10T14:06:29.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.740296+0000", 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001029133 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.363 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741020+0000", 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00072356799999999995 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741094+0000", 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4505999999999994e-05 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.364 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741183+0000", 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8757000000000004e-05 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206011493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T14:06:29.365 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.584272626, 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024669729999999999, 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:29.366 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 55 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741360+0000", 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741362+0000", 2024-05-10T14:06:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.84e-06 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741370+0000", 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.1159999999999999e-06 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.369 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741401+0000", 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0586999999999997e-05 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741417+0000", 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6076e-05 2024-05-10T14:06:29.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741490+0000", 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3230000000000002e-05 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741581+0000", 2024-05-10T14:06:29.371 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.1537000000000001e-05 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 1", 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.741749+0000", 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000168066 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.372 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.742508+0000", 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00075883500000000002 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743692+0000", 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001183297 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743753+0000", 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1713999999999999e-05 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.374 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.743827+0000", 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3675000000000002e-05 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:29.375 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 230.487660035, 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018619839999999999, 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:29.376 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837973+0000", 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.377 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837974+0000", 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.686e-06 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.837987+0000", 2024-05-10T14:06:29.378 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2296999999999999e-05 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838017+0000", 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0303000000000001e-05 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.379 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838031+0000", 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3936e-05 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838168+0000", 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013706300000000001 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.838217+0000", 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8872999999999998e-05 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.381 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839730+0000", 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00151359 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:38.839835+0000", 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104236 2024-05-10T14:06:29.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:215 6.3 e35/29 6:c31f41d7:gc::gc.10:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.571545211, 2024-05-10T14:06:29.383 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018350549999999999, 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754087+0000", 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754091+0000", 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0740000000000001e-06 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754111+0000", 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0339999999999998e-05 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754153+0000", 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.2283000000000002e-05 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754178+0000", 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.4559e-05 2024-05-10T14:06:29.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754306+0000", 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000128326 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.388 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.754359+0000", 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.2920000000000002e-05 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755854+0000", 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001495094 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.755923+0000", 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8459000000000003e-05 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.390 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:226 6.a e35/29 6:5127e642:gc::gc.21:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.53220360399999, 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001769173, 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.391 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793429+0000", 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793430+0000", 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.6300000000000005e-07 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793437+0000", 2024-05-10T14:06:29.393 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4370000000000001e-06 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793485+0000", 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7706e-05 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.394 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793499+0000", 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4507e-05 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793641+0000", 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014212200000000001 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.793693+0000", 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.206e-05 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795079+0000", 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001385549 2024-05-10T14:06:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.795198+0000", 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011922900000000001 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:344 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.47323363999999, 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001811195, 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.398 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.399 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852399+0000", 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852400+0000", 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.06e-07 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852418+0000", 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8366999999999999e-05 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852444+0000", 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6043000000000001e-05 2024-05-10T14:06:29.401 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852459+0000", 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4917e-05 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.402 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852599+0000", 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013961900000000001 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.852650+0000", 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.1808999999999998e-05 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854096+0000", 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014458349999999999 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.854210+0000", 2024-05-10T14:06:29.404 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000113899 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:395 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'5, mlcod=35'3)", 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.45769200699999, 2024-05-10T14:06:29.405 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020695430000000001, 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:29.406 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867941+0000", 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867943+0000", 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.08e-06 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.408 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867960+0000", 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.77e-05 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.867995+0000", 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4619999999999997e-05 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.409 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868015+0000", 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9755999999999999e-05 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868165+0000", 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015002200000000001 2024-05-10T14:06:29.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868202+0000", 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6684000000000003e-05 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.411 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.869879+0000", 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0016770190000000001 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870010+0000", 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000131662 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.412 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:396 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.457185974, 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002399497, 2024-05-10T14:06:29.413 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.414 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868447+0000", 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868449+0000", 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9199999999999998e-06 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868463+0000", 2024-05-10T14:06:29.416 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4413000000000001e-05 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868492+0000", 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8886000000000001e-05 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.417 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868505+0000", 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868673+0000", 2024-05-10T14:06:29.418 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016839200000000001 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.868734+0000", 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0393000000000003e-05 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.419 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870760+0000", 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002026127 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.870846+0000", 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6279000000000005e-05 2024-05-10T14:06:29.420 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:401 6.5 e35/29 6:a60f9269:lc::lua_package_allowlist:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.45296645600001, 2024-05-10T14:06:29.421 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0024550370000000002, 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:29.422 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872666+0000", 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.423 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872668+0000", 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9800000000000001e-06 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872683+0000", 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5077e-05 2024-05-10T14:06:29.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872714+0000", 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1197e-05 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872735+0000", 2024-05-10T14:06:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0415999999999999e-05 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872863+0000", 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012839899999999999 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.426 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.872912+0000", 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8285999999999998e-05 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.874995+0000", 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020832429999999998 2024-05-10T14:06:29.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.875121+0000", 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000126439 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:437 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.437901458, 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001863532, 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.429 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.430 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887731+0000", 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887733+0000", 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.793e-06 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.431 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887747+0000", 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4487e-05 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887780+0000", 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2225999999999999e-05 2024-05-10T14:06:29.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887798+0000", 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.857e-05 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887932+0000", 2024-05-10T14:06:29.433 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013342900000000001 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.887990+0000", 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7859999999999998e-05 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889492+0000", 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0015023440000000001 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889595+0000", 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102823 2024-05-10T14:06:29.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:438 6.a e35/29 6:50d64734:::obj_delete_at_hint.0000000009:head v 35'2, mlcod=0'0)", 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.43651543600001, 2024-05-10T14:06:29.436 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019221279999999999, 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889117+0000", 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889119+0000", 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7799999999999999e-06 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889131+0000", 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1667e-05 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.439 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889159+0000", 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.8259000000000002e-05 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889180+0000", 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0956999999999999e-05 2024-05-10T14:06:29.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889309+0000", 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012941600000000001 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.889347+0000", 2024-05-10T14:06:29.441 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7830000000000002e-05 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.890944+0000", 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001596653 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.442 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.891039+0000", 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5565999999999999e-05 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:445 6.a e35/29 6:55b0279d:reshard::reshard.0000000009:head v 35'3, mlcod=35'1)", 2024-05-10T14:06:29.443 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.431573972, 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002221771, 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.444 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894059+0000", 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.445 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894061+0000", 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0200000000000001e-06 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894077+0000", 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6546e-05 2024-05-10T14:06:29.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894115+0000", 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.752e-05 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.447 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894136+0000", 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0973000000000001e-05 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894299+0000", 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000163182 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.448 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894345+0000", 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.5849000000000001e-05 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896163+0000", 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001818042 2024-05-10T14:06:29.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896280+0000", 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117639 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:448 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'7, mlcod=35'5)", 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.43111812399999, 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001791483, 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.452 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894515+0000", 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894516+0000", 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.86e-06 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.453 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894530+0000", 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3457e-05 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894560+0000", 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.0351000000000001e-05 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.454 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894579+0000", 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8680000000000001e-05 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894719+0000", 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000140445 2024-05-10T14:06:29.455 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.894751+0000", 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1883e-05 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.456 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896184+0000", 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001432408 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.896306+0000", 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000122399 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.457 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:474 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'4, mlcod=35'2)", 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.416098858, 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0021847989999999999, 2024-05-10T14:06:29.458 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909534+0000", 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909536+0000", 2024-05-10T14:06:29.460 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.996e-06 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909550+0000", 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4406999999999999e-05 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.461 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909590+0000", 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9473e-05 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909609+0000", 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9732999999999999e-05 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.462 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909727+0000", 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000117249 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.909776+0000", 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9265999999999999e-05 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911617+0000", 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001841472 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.911719+0000", 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101203 2024-05-10T14:06:29.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:481 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.41103283699999, 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002059207, 2024-05-10T14:06:29.465 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914600+0000", 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914601+0000", 2024-05-10T14:06:29.467 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5460000000000001e-06 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914612+0000", 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0516999999999999e-05 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.468 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914636+0000", 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.372e-05 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914648+0000", 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1951e-05 2024-05-10T14:06:29.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914781+0000", 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000133378 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.914836+0000", 2024-05-10T14:06:29.470 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5420000000000001e-05 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916538+0000", 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001701356 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.471 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:41.916659+0000", 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012131899999999999 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_repop(client.4379.0:628 6.a e35/29 6:5127e642:gc::gc.21:head v 35'6, mlcod=35'4)", 2024-05-10T14:06:29.472 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 227.31706273699999, 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0035617240000000001, 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.473 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008570+0000", 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008572+0000", 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8059999999999999e-06 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.475 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008585+0000", 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.326e-05 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008606+0000", 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1206e-05 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008619+0000", 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2792999999999999e-05 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008763+0000", 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014437299999999999 2024-05-10T14:06:29.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.008802+0000", 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.8312999999999997e-05 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.478 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012069+0000", 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0032674190000000001 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:42.012132+0000", 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2553999999999998e-05 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.479 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:996 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94206011499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 209.50745100200001, 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0017841199999999999, 2024-05-10T14:06:29.480 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 996 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818182+0000", 2024-05-10T14:06:29.482 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818185+0000", 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.1370000000000002e-06 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.483 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818200+0000", 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.5265e-05 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818238+0000", 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.7552000000000002e-05 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.818278+0000", 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0417000000000003e-05 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819371+0000", 2024-05-10T14:06:29.485 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010930479999999999 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819658+0000", 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028660900000000001 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.486 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:59.819966+0000", 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00030809199999999999 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.487 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:29.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T14:06:29.620 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.620 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:29.620 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:29.621 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:29.634 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T14:06:29.751 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.751 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:29.751 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:29.752 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:29.752 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:29.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T14:06:29.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~121s 2024-05-10T14:06:29.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T14:06:29.886 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:29.887 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 250.338119183, 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.58247353899999998, 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1 2024-05-10T14:06:29.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.889 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546630+0000", 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546632+0000", 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8929999999999999e-06 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546645+0000", 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3087e-05 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546667+0000", 2024-05-10T14:06:29.891 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2306e-05 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546688+0000", 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0112999999999999e-05 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.892 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546850+0000", 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00016220899999999999 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for peered", 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:19.546877+0000", 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.6906e-05 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.125998+0000", 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.57912173600000005 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126275+0000", 2024-05-10T14:06:29.894 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000276228 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.126624+0000", 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00034953399999999998 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.895 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.127927+0000", 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013027259999999999 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.896 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.128943+0000", 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010158260000000001 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129044+0000", 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010150899999999999 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.129104+0000", 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9466000000000003e-05 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.71521542599999, 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011417470000000001, 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.899 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 25 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:29.900 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169534+0000", 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.901 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169535+0000", 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2299999999999999e-07 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169542+0000", 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.5530000000000004e-06 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169559+0000", 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6460000000000002e-05 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.169580+0000", 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.1597e-05 2024-05-10T14:06:29.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178486+0000", 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0089054939999999999 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178623+0000", 2024-05-10T14:06:29.904 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000136945 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.178821+0000", 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000197822 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.905 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.179886+0000", 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010648879999999999 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180805+0000", 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00091899600000000005 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180889+0000", 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.4568999999999996e-05 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.180951+0000", 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2223000000000004e-05 2024-05-10T14:06:29.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.61968178000001, 2024-05-10T14:06:29.908 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011197185, 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 45 2024-05-10T14:06:29.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.910 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265068+0000", 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265069+0000", 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0100000000000001e-06 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265075+0000", 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1029999999999998e-06 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265097+0000", 2024-05-10T14:06:29.912 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.228e-05 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265109+0000", 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.153e-05 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.913 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272498+0000", 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.007389077 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272633+0000", 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000134969 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.272838+0000", 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020566399999999999 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276002+0000", 2024-05-10T14:06:29.915 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031639379999999998 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276129+0000", 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012636200000000001 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.916 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276201+0000", 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.2866000000000003e-05 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276265+0000", 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3386000000000006e-05 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.61962757399999, 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011282294999999999, 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.918 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 46 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.919 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265122+0000", 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265123+0000", 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0400000000000005e-07 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265128+0000", 2024-05-10T14:06:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.5899999999999998e-06 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265140+0000", 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.131e-05 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.922 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265147+0000", 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4660000000000002e-06 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273877+0000", 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0087302019999999994 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.273992+0000", 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011464300000000001 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274173+0000", 2024-05-10T14:06:29.924 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018076799999999999 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276103+0000", 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019305209999999999 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.925 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276287+0000", 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018372500000000001 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276355+0000", 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.8100000000000002e-05 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276404+0000", 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.9166000000000003e-05 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.927 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.61959070399999, 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014476302, 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.928 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 47 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265159+0000", 2024-05-10T14:06:29.930 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265264+0000", 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000104356 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.931 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265291+0000", 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7279000000000001e-05 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265301+0000", 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5340000000000005e-06 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274746+0000", 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0094459690000000002 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.274870+0000", 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123736 2024-05-10T14:06:29.933 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.275065+0000", 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194649 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277403+0000", 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0023382609999999999 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279494+0000", 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020913189999999999 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.935 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279575+0000", 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0747000000000005e-05 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279635+0000", 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.9772000000000003e-05 2024-05-10T14:06:29.936 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.61942915899999, 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014670160999999999, 2024-05-10T14:06:29.937 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 48 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265320+0000", 2024-05-10T14:06:29.939 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265321+0000", 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6700000000000002e-07 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.940 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265341+0000", 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0069999999999999e-05 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265353+0000", 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1375999999999999e-05 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.941 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265361+0000", 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.977e-06 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276478+0000", 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011117053 2024-05-10T14:06:29.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276597+0000", 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011979199999999999 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.276792+0000", 2024-05-10T14:06:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019497199999999999 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279733+0000", 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0029405659999999999 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279863+0000", 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000129956 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279933+0000", 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0172999999999994e-05 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.945 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279990+0000", 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7358999999999997e-05 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.946 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.619375819, 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014746247000000001, 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.947 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 49 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265374+0000", 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4000000000000001e-07 2024-05-10T14:06:29.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265389+0000", 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4837e-05 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.950 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265405+0000", 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6273000000000002e-05 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265416+0000", 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1059e-05 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.951 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277490+0000", 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012073568999999999 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277607+0000", 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000116679 2024-05-10T14:06:29.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.277791+0000", 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018462200000000001 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.953 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.279835+0000", 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0020431799999999999 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280009+0000", 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000174535 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280072+0000", 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2626999999999995e-05 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280120+0000", 2024-05-10T14:06:29.955 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.8126e-05 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.6193179, 2024-05-10T14:06:29.956 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016770084000000001, 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 50 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.958 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265431+0000", 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265432+0000", 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7000000000000003e-07 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.959 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265518+0000", 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5690000000000001e-05 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265532+0000", 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4103e-05 2024-05-10T14:06:29.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265546+0000", 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.384e-05 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278401+0000", 2024-05-10T14:06:29.961 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012854872 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278524+0000", 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000123039 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.962 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.278724+0000", 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020015500000000001 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281894+0000", 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0031699779999999999 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282008+0000", 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011367899999999999 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282082+0000", 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.4511999999999994e-05 2024-05-10T14:06:29.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282202+0000", 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000119246 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.619188151, 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016826939999999999, 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.966 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 51 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:29.967 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265561+0000", 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.968 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265562+0000", 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1069999999999999e-06 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265568+0000", 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0560000000000001e-06 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265578+0000", 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.008e-05 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265588+0000", 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.5240000000000006e-06 2024-05-10T14:06:29.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280193+0000", 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014604921 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.971 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280308+0000", 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115343 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.280531+0000", 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022286800000000001 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281988+0000", 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0014571810000000001 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282217+0000", 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022905500000000001 2024-05-10T14:06:29.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282285+0000", 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7873000000000006e-05 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282388+0000", 2024-05-10T14:06:29.974 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000102932 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:29.975 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.61914969399999, 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017123376999999999, 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 52 2024-05-10T14:06:29.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265600+0000", 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7999999999999995e-07 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265606+0000", 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0399999999999998e-06 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265616+0000", 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6860000000000001e-06 2024-05-10T14:06:29.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.265624+0000", 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9140000000000008e-06 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281117+0000", 2024-05-10T14:06:29.980 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015493477 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281236+0000", 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00011879600000000001 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.981 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.281431+0000", 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000194661 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282510+0000", 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010794579999999999 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282537+0000", 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.709e-05 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282614+0000", 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6933000000000004e-05 2024-05-10T14:06:29.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.282723+0000", 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010864199999999999 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.392026571, 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01029013, 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.985 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 67 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.986 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492723+0000", 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.987 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492724+0000", 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6299999999999993e-07 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492730+0000", 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8869999999999997e-06 2024-05-10T14:06:29.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492740+0000", 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0540000000000001e-05 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492748+0000", 2024-05-10T14:06:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7060000000000004e-06 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497334+0000", 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0045862630000000001 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497562+0000", 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022789199999999999 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.497973+0000", 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00041069300000000001 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501288+0000", 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033150570000000002 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502717+0000", 2024-05-10T14:06:29.992 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001429591 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.502890+0000", 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00017265600000000001 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:29.993 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503013+0000", 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012288199999999999 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:29.994 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.391819126, 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011968536, 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 68 2024-05-10T14:06:29.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.996 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492930+0000", 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492931+0000", 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0499999999999999e-06 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492938+0000", 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3759999999999996e-06 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492950+0000", 2024-05-10T14:06:29.998 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.257e-05 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.492961+0000", 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0757000000000001e-05 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:29.999 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.499818+0000", 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0068567879999999999 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500048+0000", 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000229798 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.500430+0000", 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00038225999999999999 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504595+0000", 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0041653360000000004 2024-05-10T14:06:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504642+0000", 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.7012999999999999e-05 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.002 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504794+0000", 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015132200000000001 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504899+0000", 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105266 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.39170523999999, 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012982791, 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.004 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 69 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493044+0000", 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493045+0000", 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1659999999999999e-06 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493165+0000", 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000120103 2024-05-10T14:06:30.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493184+0000", 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.8406e-05 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493195+0000", 2024-05-10T14:06:30.008 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.1216000000000001e-05 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501357+0000", 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0081615990000000003 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.009 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501427+0000", 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.0703000000000004e-05 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.501529+0000", 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000101284 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504914+0000", 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0033857459999999998 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505887+0000", 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00097221500000000001 2024-05-10T14:06:30.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505969+0000", 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2223000000000002e-05 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506027+0000", 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8130000000000001e-05 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.39153683500001, 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012980831, 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 70 2024-05-10T14:06:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493213+0000", 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0999999999999997e-07 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493220+0000", 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.2430000000000002e-06 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493231+0000", 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0813e-05 2024-05-10T14:06:30.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493238+0000", 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.52e-06 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.018 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503076+0000", 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0098381900000000001 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503210+0000", 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00013393300000000001 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.019 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.503417+0000", 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000206708 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506046+0000", 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0026293549999999999 2024-05-10T14:06:30.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506118+0000", 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.1679000000000003e-05 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506160+0000", 2024-05-10T14:06:30.021 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1646000000000001e-05 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506193+0000", 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3834000000000002e-05 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.391499275, 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014904562, 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 71 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.024 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493250+0000", 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493251+0000", 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7599999999999997e-07 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493257+0000", 2024-05-10T14:06:30.026 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.7070000000000003e-06 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493267+0000", 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.6469999999999993e-06 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493275+0000", 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6760000000000007e-06 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504027+0000", 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.010752272 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504085+0000", 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.7429999999999997e-05 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504178+0000", 2024-05-10T14:06:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.3914999999999998e-05 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506058+0000", 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001879333 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.030 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507988+0000", 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019298399999999999 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508074+0000", 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.6673000000000002e-05 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508155+0000", 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0393000000000001e-05 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.032 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.39144585899999, 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016905412000000002, 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.033 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 72 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.035 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493304+0000", 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2600000000000001e-07 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493393+0000", 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8193000000000001e-05 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.036 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493405+0000", 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.254e-05 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493414+0000", 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.5799999999999992e-06 2024-05-10T14:06:30.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.504942+0000", 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.011528503000000001 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505006+0000", 2024-05-10T14:06:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3632000000000003e-05 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.505110+0000", 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00010432199999999999 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.039 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508178+0000", 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003068196 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510135+0000", 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019566620000000001 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510175+0000", 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.0324000000000002e-05 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510209+0000", 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3633999999999997e-05 2024-05-10T14:06:30.041 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.39132057, 2024-05-10T14:06:30.042 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.016910644999999998, 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 73 2024-05-10T14:06:30.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.044 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493429+0000", 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493430+0000", 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.7300000000000005e-07 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493438+0000", 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0059999999999992e-06 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493448+0000", 2024-05-10T14:06:30.046 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.8169999999999994e-06 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493457+0000", 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.4599999999999992e-06 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.047 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506258+0000", 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.012801229000000001 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506456+0000", 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000198075 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.506687+0000", 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000230972 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510076+0000", 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.003388889 2024-05-10T14:06:30.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510259+0000", 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00018255999999999999 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510303+0000", 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.4314999999999998e-05 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510339+0000", 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6449000000000003e-05 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.051 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.391280427, 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017013337999999999, 2024-05-10T14:06:30.052 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 74 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493469+0000", 2024-05-10T14:06:30.054 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493470+0000", 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.5600000000000005e-07 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.055 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493476+0000", 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.1739999999999997e-06 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493485+0000", 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.2529999999999993e-06 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493493+0000", 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.6499999999999996e-06 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507327+0000", 2024-05-10T14:06:30.057 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.01383442 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507390+0000", 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.3165999999999998e-05 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.058 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.507506+0000", 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000115604 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510351+0000", 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.002845144 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.059 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510388+0000", 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6900999999999998e-05 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510452+0000", 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.4460000000000003e-05 2024-05-10T14:06:30.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510482+0000", 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.991e-05 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.391228044, 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.017804148999999998, 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.062 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 75 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493521+0000", 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.064 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493522+0000", 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.8999999999999995e-07 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493663+0000", 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014121500000000001 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493681+0000", 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.7376000000000001e-05 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493690+0000", 2024-05-10T14:06:30.066 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.0499999999999997e-06 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508215+0000", 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.014525011000000001 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.067 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508275+0000", 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 6.0177999999999999e-05 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.508372+0000", 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 9.7213000000000006e-05 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510355+0000", 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0019828010000000002 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511251+0000", 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00089627399999999996 2024-05-10T14:06:30.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511292+0000", 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1213e-05 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.070 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.511325+0000", 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3028000000000003e-05 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4163.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T14:06:30.071 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 249.39104364600001, 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.018403958000000002, 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4163", 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/81462917", 2024-05-10T14:06:30.072 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 76 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493706+0000", 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493707+0000", 2024-05-10T14:06:30.074 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8999999999999995e-07 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493712+0000", 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 5.8200000000000002e-06 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.075 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493726+0000", 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3910000000000001e-05 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.493737+0000", 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.0523000000000001e-05 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.076 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509012+0000", 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.015274655999999999 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509156+0000", 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00014489200000000001 2024-05-10T14:06:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "waiting for subops from 0", 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.509427+0000", 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00027029099999999998 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "op_commit", 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.510563+0000", 2024-05-10T14:06:30.078 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001136108 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "sub_op_commit_rec", 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512038+0000", 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00147477 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.079 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "commit_sent", 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512077+0000", 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.9535e-05 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:02:20.512110+0000", 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2563e-05 2024-05-10T14:06:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.081 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.081 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.081 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:30.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T14:06:30.176 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-05-10T14:06:30.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T14:06:30.215 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:30.215 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:30.216 INFO:teuthology.orchestra.run.smithi130.stdout: "num_ops": 0 2024-05-10T14:06:30.216 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:30.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T14:06:30.352 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:30.353 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [], 2024-05-10T14:06:30.353 INFO:teuthology.orchestra.run.smithi130.stdout: "complaint_time": 30, 2024-05-10T14:06:30.353 INFO:teuthology.orchestra.run.smithi130.stdout: "num_blocked_ops": 0 2024-05-10T14:06:30.353 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:30.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T14:06:30.486 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-10T14:06:30.486 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 20, 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 600, 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "ops": [ 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(7.e epoch 74/70 rep_tid 29 entries 74'4 (0'0) error 7:7759931f:::notify.3:head by client.4379.0:1149 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.61286833, 2024-05-10T14:06:30.487 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0018467819999999999, 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.488 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874243+0000", 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874245+0000", 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.866e-06 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.490 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874268+0000", 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2682999999999999e-05 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874341+0000", 2024-05-10T14:06:30.491 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.3038000000000001e-05 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874373+0000", 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.2141999999999998e-05 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.492 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874577+0000", 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000204067 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876090+0000", 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001512986 2024-05-10T14:06:30.493 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing(6.4 epoch 74/70 rep_tid 52 entries 74'25 (0'0) error 6:22d26bf9:::data_loggenerations_metadata:head by client.4379.0:1148 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.61284666099999, 2024-05-10T14:06:30.494 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00129583, 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:06:30.495 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874265+0000", 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.497 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.497 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874266+0000", 2024-05-10T14:06:30.497 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.776e-06 2024-05-10T14:06:30.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.498 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.498 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874287+0000", 2024-05-10T14:06:30.498 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0696e-05 2024-05-10T14:06:30.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.499 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.499 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874328+0000", 2024-05-10T14:06:30.500 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 4.1168999999999998e-05 2024-05-10T14:06:30.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.500 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.501 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874356+0000", 2024-05-10T14:06:30.501 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.7572e-05 2024-05-10T14:06:30.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.502 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.502 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.874551+0000", 2024-05-10T14:06:30.502 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000195181 2024-05-10T14:06:30.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.503 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.503 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875561+0000", 2024-05-10T14:06:30.503 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0010094360000000001 2024-05-10T14:06:30.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.504 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.505 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1147 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:06:30.505 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:06:30.505 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.611810007, 2024-05-10T14:06:30.506 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.001940773, 2024-05-10T14:06:30.506 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.506 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.506 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:30.507 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.507 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:30.507 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:30.507 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1147 2024-05-10T14:06:30.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.508 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.508 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.509 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:06:30.509 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.510 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.510 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875301+0000", 2024-05-10T14:06:30.510 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.511 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.511 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875303+0000", 2024-05-10T14:06:30.512 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0040000000000002e-06 2024-05-10T14:06:30.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.512 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.513 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875311+0000", 2024-05-10T14:06:30.513 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.0960000000000001e-06 2024-05-10T14:06:30.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.514 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.514 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875331+0000", 2024-05-10T14:06:30.515 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.9596e-05 2024-05-10T14:06:30.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.515 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.516 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875348+0000", 2024-05-10T14:06:30.516 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6696000000000001e-05 2024-05-10T14:06:30.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.517 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.517 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875524+0000", 2024-05-10T14:06:30.517 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000176601 2024-05-10T14:06:30.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.518 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.518 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.875883+0000", 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000359069 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877242+0000", 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0013587110000000001 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.519 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "pg_update_log_missing_reply(7.0 epoch 74/70 rep_tid 0 lcod 74'4)", 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.61019273400001, 2024-05-10T14:06:30.520 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00033067300000000002, 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876919+0000", 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.522 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876926+0000", 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.7430000000000002e-06 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876935+0000", 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.8370000000000003e-06 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876955+0000", 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.0271999999999998e-05 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.876968+0000", 2024-05-10T14:06:30.524 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.2407e-05 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877092+0000", 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012419899999999999 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.525 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:09.877249+0000", 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015721499999999999 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.526 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 140.29388023600001, 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00025337899999999997, 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.527 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 4 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193231+0000", 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.529 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193233+0000", 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.2390000000000001e-06 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193247+0000", 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4063000000000001e-05 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193264+0000", 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6079999999999999e-05 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193277+0000", 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.3574000000000001e-05 2024-05-10T14:06:30.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193360+0000", 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 8.2466999999999995e-05 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.532 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:10.193485+0000", 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012495599999999999 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1156 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T14:06:30.533 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 135.61018465199999, 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0011735370000000001, 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:30.534 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1156 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876927+0000", 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876935+0000", 2024-05-10T14:06:30.536 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9400000000000002e-06 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876950+0000", 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4873e-05 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.537 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876979+0000", 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.9955999999999999e-05 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.876996+0000", 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6586e-05 2024-05-10T14:06:30.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877591+0000", 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00059475999999999995 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.539 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.877812+0000", 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022115700000000001 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:14.878100+0000", 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00028826500000000001 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.540 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4379.0:1166 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94206011500672 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 130.60602641599999, 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000470431, 2024-05-10T14:06:30.541 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "started", 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4379", 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2549771328", 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 1166 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.542 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.543 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881085+0000", 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881086+0000", 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.19e-06 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881094+0000", 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 7.9000000000000006e-06 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881109+0000", 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4939e-05 2024-05-10T14:06:30.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881125+0000", 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6310000000000001e-05 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.546 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881326+0000", 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00020064 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "started", 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881431+0000", 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.000105531 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:04:19.881555+0000", 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00012392100000000001 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.548 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:6 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 80.257447252000006, 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00044475200000000003, 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.549 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 6 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:06:30.550 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229664+0000", 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.551 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229668+0000", 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4130000000000002e-06 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229704+0000", 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.6006000000000001e-05 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229738+0000", 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.4366000000000003e-05 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229755+0000", 2024-05-10T14:06:30.553 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.6897000000000001e-05 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.229912+0000", 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00015710100000000001 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.554 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:05:10.230109+0000", 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00019696899999999999 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: "description": "osd_op(client.4169.0:7 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-05-10T14:06:30.555 INFO:teuthology.orchestra.run.smithi130.stdout: "initiated_at": "2024-05-10T14:06:10.239677+0000", 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "age": 20.247434374000001, 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0046068639999999996, 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "continuous": false, 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "type_data": { 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "flag_point": "reached pg", 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_info": { 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client": "client.4169", 2024-05-10T14:06:30.556 INFO:teuthology.orchestra.run.smithi130.stdout: "client_addr": "172.21.15.16:0/2250301339", 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: "tid": 7 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: "events": [ 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "initiated", 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239677+0000", 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "header_read", 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239677+0000", 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "throttled", 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239680+0000", 2024-05-10T14:06:30.558 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 2.92e-06 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "all_read", 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239695+0000", 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.4747e-05 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.559 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "dispatched", 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239728+0000", 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 3.3565999999999997e-05 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "queued_for_pg", 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.239745+0000", 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 1.717e-05 2024-05-10T14:06:30.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "reached_pg", 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.244061+0000", 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.0043156189999999997 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "event": "done", 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "time": "2024-05-10T14:06:10.244284+0000", 2024-05-10T14:06:30.561 INFO:teuthology.orchestra.run.smithi130.stdout: "duration": 0.00022284200000000001 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-10T14:06:30.562 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-10T14:06:31.194 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-05-10T14:06:36.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~128s 2024-05-10T14:06:42.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~134s 2024-05-10T14:06:48.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~141s 2024-05-10T14:06:54.220 INFO:tasks.thrashosds.thrasher:inning osd 2024-05-10T14:06:54.221 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-05-10T14:06:54.221 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-05-10T14:06:54.548 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-05-10T14:06:54.545+0000 7f59ce941640 -1 mon.a@0(leader).osd e134 definitely_dead 0 2024-05-10T14:06:55.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~147s 2024-05-10T14:06:55.297 INFO:teuthology.orchestra.run.smithi016.stderr:marked in osd.7. 2024-05-10T14:06:55.336 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-05-10T14:06:55.336 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-10T14:06:55.470 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a: {} 2024-05-10T14:06:55.471 INFO:teuthology.orchestra.run.smithi016.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:06:55.484 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b: {} 2024-05-10T14:06:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:06:55.494 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c: {} 2024-05-10T14:06:55.494 INFO:teuthology.orchestra.run.smithi016.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T14:06:55.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T14:06:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T14:06:56.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-10T14:06:57.347 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-10T14:06:57.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T14:06:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T14:06:58.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-10T14:06:59.367 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-10T14:06:59.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T14:07:00.390 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T14:07:00.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-10T14:07:01.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~153s 2024-05-10T14:07:01.403 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-10T14:07:01.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T14:07:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T14:07:02.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-10T14:07:03.421 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-10T14:07:03.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T14:07:04.443 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T14:07:04.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-10T14:07:05.462 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-10T14:07:05.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T14:07:06.477 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T14:07:06.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-10T14:07:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-10T14:07:07.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-10T14:07:07.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~160s 2024-05-10T14:07:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-05-10T14:07:08.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-10T14:07:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-10T14:07:09.543 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T14:07:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T14:07:10.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-10T14:07:11.552 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-10T14:07:11.576 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-10T14:07:11.577 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-10T14:07:11.577 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-10T14:07:11.577 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-10T14:07:11.577 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T14:07:11.577 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:07:11.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:11.889 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":151,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:07:11.541491+0000","last_up_change":"2024-05-10T14:04:05.266195+0000","last_in_change":"2024-05-10T14:06:55.297244+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T14:02:23.522518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T14:02:29.396923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T14:02:30.972010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T14:02:32.919979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T14:02:34.837119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T14:02:36.725909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T14:02:38.855802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":55,"up_from":70,"up_thru":135,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6817","nonce":3659833369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6819","nonce":3659833369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6823","nonce":3659833369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6821","nonce":3659833369}]},"public_addr":"172.21.15.130:6817/3659833369","cluster_addr":"172.21.15.130:6819/3659833369","heartbeat_back_addr":"172.21.15.130:6823/3659833369","heartbeat_front_addr":"172.21.15.130:6821/3659833369","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":56},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:07:11.908 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T14:07:11.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:07:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:12.213 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":151,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:07:11.541491+0000","last_up_change":"2024-05-10T14:04:05.266195+0000","last_in_change":"2024-05-10T14:06:55.297244+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T14:02:23.522518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T14:02:29.396923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T14:02:30.972010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T14:02:32.919979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T14:02:34.837119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T14:02:36.725909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T14:02:38.855802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":55,"up_from":70,"up_thru":135,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6817","nonce":3659833369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6819","nonce":3659833369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6823","nonce":3659833369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6821","nonce":3659833369}]},"public_addr":"172.21.15.130:6817/3659833369","cluster_addr":"172.21.15.130:6819/3659833369","heartbeat_back_addr":"172.21.15.130:6823/3659833369","heartbeat_front_addr":"172.21.15.130:6821/3659833369","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":56},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:07:12.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T14:07:12.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T14:07:12.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T14:07:12.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T14:07:12.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T14:07:12.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T14:07:12.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T14:07:12.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T14:07:12.500 INFO:teuthology.orchestra.run.smithi016.stdout:55834574911 2024-05-10T14:07:12.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T14:07:12.505 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:12.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T14:07:12.511 INFO:teuthology.orchestra.run.smithi016.stdout:64424509502 2024-05-10T14:07:12.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T14:07:12.512 INFO:teuthology.orchestra.run.smithi016.stdout:64424509502 2024-05-10T14:07:12.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T14:07:12.514 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:12.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T14:07:12.518 INFO:teuthology.orchestra.run.smithi016.stdout:300647710759 2024-05-10T14:07:12.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T14:07:12.523 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:12.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T14:07:12.527 INFO:teuthology.orchestra.run.smithi016.stdout:64424509503 2024-05-10T14:07:12.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T14:07:13.014 INFO:teuthology.orchestra.run.smithi016.stdout:55834574910 2024-05-10T14:07:13.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574911 got 55834574910 for osd.1 2024-05-10T14:07:13.043 INFO:teuthology.orchestra.run.smithi016.stdout:64424509501 2024-05-10T14:07:13.046 INFO:teuthology.orchestra.run.smithi016.stdout:64424509503 2024-05-10T14:07:13.049 INFO:teuthology.orchestra.run.smithi016.stdout:300647710758 2024-05-10T14:07:13.070 INFO:teuthology.orchestra.run.smithi016.stdout:64424509503 2024-05-10T14:07:13.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509502 got 64424509501 for osd.4 2024-05-10T14:07:13.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509503 for osd.0 2024-05-10T14:07:13.081 INFO:teuthology.orchestra.run.smithi016.stdout:64424509503 2024-05-10T14:07:13.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710759 got 300647710758 for osd.5 2024-05-10T14:07:13.084 INFO:teuthology.orchestra.run.smithi016.stdout:64424509501 2024-05-10T14:07:13.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509503 for osd.6 2024-05-10T14:07:13.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509503 for osd.3 2024-05-10T14:07:13.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509502 got 64424509501 for osd.7 2024-05-10T14:07:13.109 INFO:teuthology.orchestra.run.smithi016.stdout:64424509502 2024-05-10T14:07:13.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509503 got 64424509502 for osd.2 2024-05-10T14:07:13.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~166s 2024-05-10T14:07:14.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T14:07:14.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T14:07:14.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T14:07:14.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T14:07:14.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T14:07:14.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T14:07:14.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T14:07:14.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T14:07:14.566 INFO:teuthology.orchestra.run.smithi016.stdout:55834574910 2024-05-10T14:07:14.598 INFO:teuthology.orchestra.run.smithi016.stdout:300647710759 2024-05-10T14:07:14.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574911 got 55834574910 for osd.1 2024-05-10T14:07:14.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710759 got 300647710759 for osd.5 2024-05-10T14:07:14.617 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.624 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:14.638 INFO:teuthology.orchestra.run.smithi016.stdout:64424509502 2024-05-10T14:07:14.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509504 for osd.0 2024-05-10T14:07:14.650 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509502 got 64424509502 for osd.4 2024-05-10T14:07:14.660 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:14.661 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.669 INFO:teuthology.orchestra.run.smithi016.stdout:64424509502 2024-05-10T14:07:14.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509504 for osd.3 2024-05-10T14:07:14.682 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509502 got 64424509502 for osd.7 2024-05-10T14:07:14.691 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.699 INFO:teuthology.orchestra.run.smithi016.stdout:64424509503 2024-05-10T14:07:14.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509503 got 64424509503 for osd.2 2024-05-10T14:07:14.723 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:14.724 INFO:teuthology.orchestra.run.smithi016.stdout:64424509504 2024-05-10T14:07:14.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509504 got 64424509504 for osd.6 2024-05-10T14:07:14.741 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:15.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T14:07:15.913 INFO:teuthology.orchestra.run.smithi016.stdout:55834574911 2024-05-10T14:07:15.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574911 got 55834574911 for osd.1 2024-05-10T14:07:15.931 DEBUG:teuthology.parallel:result is None 2024-05-10T14:07:15.931 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T14:07:15.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:16.270 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:16.277 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:16.286 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-05-10T14:07:16.217760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302680,"kb_used_data":36068,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672040,"statfs":{"total":773094113280,"available":772784168960,"internally_reserved":0,"allocated":36933632,"data_stored":30814595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701241"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074058+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074058+0000","last_peered":"2024-05-10T14:07:12.074058+0000","last_clean":"2024-05-10T14:07:12.074058+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074058+0000","last_undegraded":"2024-05-10T14:07:12.074058+0000","last_fullsized":"2024-05-10T14:07:12.074058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548272+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548272+0000","last_peered":"2024-05-10T14:07:11.548272+0000","last_clean":"2024-05-10T14:07:11.548272+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548272+0000","last_undegraded":"2024-05-10T14:07:11.548272+0000","last_fullsized":"2024-05-10T14:07:11.548272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555985+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.555985+0000","last_peered":"2024-05-10T14:07:11.555985+0000","last_clean":"2024-05-10T14:07:11.555985+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.555985+0000","last_undegraded":"2024-05-10T14:07:11.555985+0000","last_fullsized":"2024-05-10T14:07:11.555985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081409+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081409+0000","last_peered":"2024-05-10T14:07:12.081409+0000","last_clean":"2024-05-10T14:07:12.081409+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081409+0000","last_undegraded":"2024-05-10T14:07:12.081409+0000","last_fullsized":"2024-05-10T14:07:12.081409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079824+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079824+0000","last_peered":"2024-05-10T14:07:12.079824+0000","last_clean":"2024-05-10T14:07:12.079824+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079824+0000","last_undegraded":"2024-05-10T14:07:12.079824+0000","last_fullsized":"2024-05-10T14:07:12.079824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554228+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:11.554228+0000","last_peered":"2024-05-10T14:07:11.554228+0000","last_clean":"2024-05-10T14:07:11.554228+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:11.554228+0000","last_undegraded":"2024-05-10T14:07:11.554228+0000","last_fullsized":"2024-05-10T14:07:11.554228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550475+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550475+0000","last_peered":"2024-05-10T14:07:11.550475+0000","last_clean":"2024-05-10T14:07:11.550475+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550475+0000","last_undegraded":"2024-05-10T14:07:11.550475+0000","last_fullsized":"2024-05-10T14:07:11.550475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555673+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:11.555673+0000","last_peered":"2024-05-10T14:07:11.555673+0000","last_clean":"2024-05-10T14:07:11.555673+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:11.555673+0000","last_undegraded":"2024-05-10T14:07:11.555673+0000","last_fullsized":"2024-05-10T14:07:11.555673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553359+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:11.553359+0000","last_peered":"2024-05-10T14:07:11.553359+0000","last_clean":"2024-05-10T14:07:11.553359+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:11.553359+0000","last_undegraded":"2024-05-10T14:07:11.553359+0000","last_fullsized":"2024-05-10T14:07:11.553359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549532+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549532+0000","last_peered":"2024-05-10T14:07:11.549532+0000","last_clean":"2024-05-10T14:07:11.549532+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549532+0000","last_undegraded":"2024-05-10T14:07:11.549532+0000","last_fullsized":"2024-05-10T14:07:11.549532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.073945+0000","last_peered":"2024-05-10T14:07:12.073945+0000","last_clean":"2024-05-10T14:07:12.073945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.073945+0000","last_undegraded":"2024-05-10T14:07:12.073945+0000","last_fullsized":"2024-05-10T14:07:12.073945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555009+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555009+0000","last_peered":"2024-05-10T14:07:11.555009+0000","last_clean":"2024-05-10T14:07:11.555009+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555009+0000","last_undegraded":"2024-05-10T14:07:11.555009+0000","last_fullsized":"2024-05-10T14:07:11.555009+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:12.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074427+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:12.074427+0000","last_peered":"2024-05-10T14:07:12.074427+0000","last_clean":"2024-05-10T14:07:12.074427+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:12.074427+0000","last_undegraded":"2024-05-10T14:07:12.074427+0000","last_fullsized":"2024-05-10T14:07:12.074427+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550092+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:11.550092+0000","last_peered":"2024-05-10T14:07:11.550092+0000","last_clean":"2024-05-10T14:07:11.550092+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:11.550092+0000","last_undegraded":"2024-05-10T14:07:11.550092+0000","last_fullsized":"2024-05-10T14:07:11.550092+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:52.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073622+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073622+0000","last_peered":"2024-05-10T14:07:12.073622+0000","last_clean":"2024-05-10T14:07:12.073622+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073622+0000","last_undegraded":"2024-05-10T14:07:12.073622+0000","last_fullsized":"2024-05-10T14:07:12.073622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075091+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:12.075091+0000","last_peered":"2024-05-10T14:07:12.075091+0000","last_clean":"2024-05-10T14:07:12.075091+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:12.075091+0000","last_undegraded":"2024-05-10T14:07:12.075091+0000","last_fullsized":"2024-05-10T14:07:12.075091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555017+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555017+0000","last_peered":"2024-05-10T14:07:11.555017+0000","last_clean":"2024-05-10T14:07:11.555017+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555017+0000","last_undegraded":"2024-05-10T14:07:11.555017+0000","last_fullsized":"2024-05-10T14:07:11.555017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555401+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:11.555401+0000","last_peered":"2024-05-10T14:07:11.555401+0000","last_clean":"2024-05-10T14:07:11.555401+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:11.555401+0000","last_undegraded":"2024-05-10T14:07:11.555401+0000","last_fullsized":"2024-05-10T14:07:11.555401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083134+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:12.083134+0000","last_peered":"2024-05-10T14:07:12.083134+0000","last_clean":"2024-05-10T14:07:12.083134+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:12.083134+0000","last_undegraded":"2024-05-10T14:07:12.083134+0000","last_fullsized":"2024-05-10T14:07:12.083134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554347+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:11.554347+0000","last_peered":"2024-05-10T14:07:11.554347+0000","last_clean":"2024-05-10T14:07:11.554347+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:11.554347+0000","last_undegraded":"2024-05-10T14:07:11.554347+0000","last_fullsized":"2024-05-10T14:07:11.554347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:47.045146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082687+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:12.082687+0000","last_peered":"2024-05-10T14:07:12.082687+0000","last_clean":"2024-05-10T14:07:12.082687+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:12.082687+0000","last_undegraded":"2024-05-10T14:07:12.082687+0000","last_fullsized":"2024-05-10T14:07:12.082687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549354+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:11.549354+0000","last_peered":"2024-05-10T14:07:11.549354+0000","last_clean":"2024-05-10T14:07:11.549354+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:11.549354+0000","last_undegraded":"2024-05-10T14:07:11.549354+0000","last_fullsized":"2024-05-10T14:07:11.549354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075462+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:12.075462+0000","last_peered":"2024-05-10T14:07:12.075462+0000","last_clean":"2024-05-10T14:07:12.075462+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:12.075462+0000","last_undegraded":"2024-05-10T14:07:12.075462+0000","last_fullsized":"2024-05-10T14:07:12.075462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550653+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550653+0000","last_peered":"2024-05-10T14:07:11.550653+0000","last_clean":"2024-05-10T14:07:11.550653+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550653+0000","last_undegraded":"2024-05-10T14:07:11.550653+0000","last_fullsized":"2024-05-10T14:07:11.550653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":301,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554321+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:11.554321+0000","last_peered":"2024-05-10T14:07:11.554321+0000","last_clean":"2024-05-10T14:07:11.554321+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:11.554321+0000","last_undegraded":"2024-05-10T14:07:11.554321+0000","last_fullsized":"2024-05-10T14:07:11.554321+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:10.732947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548392+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548392+0000","last_peered":"2024-05-10T14:07:11.548392+0000","last_clean":"2024-05-10T14:07:11.548392+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548392+0000","last_undegraded":"2024-05-10T14:07:11.548392+0000","last_fullsized":"2024-05-10T14:07:11.548392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554759+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554759+0000","last_peered":"2024-05-10T14:07:11.554759+0000","last_clean":"2024-05-10T14:07:11.554759+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554759+0000","last_undegraded":"2024-05-10T14:07:11.554759+0000","last_fullsized":"2024-05-10T14:07:11.554759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076842+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:12.076842+0000","last_peered":"2024-05-10T14:07:12.076842+0000","last_clean":"2024-05-10T14:07:12.076842+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:12.076842+0000","last_undegraded":"2024-05-10T14:07:12.076842+0000","last_fullsized":"2024-05-10T14:07:12.076842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072614+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:12.072614+0000","last_peered":"2024-05-10T14:07:12.072614+0000","last_clean":"2024-05-10T14:07:12.072614+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:12.072614+0000","last_undegraded":"2024-05-10T14:07:12.072614+0000","last_fullsized":"2024-05-10T14:07:12.072614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074531+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074531+0000","last_peered":"2024-05-10T14:07:12.074531+0000","last_clean":"2024-05-10T14:07:12.074531+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074531+0000","last_undegraded":"2024-05-10T14:07:12.074531+0000","last_fullsized":"2024-05-10T14:07:12.074531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074815+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074815+0000","last_peered":"2024-05-10T14:07:12.074815+0000","last_clean":"2024-05-10T14:07:12.074815+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074815+0000","last_undegraded":"2024-05-10T14:07:12.074815+0000","last_fullsized":"2024-05-10T14:07:12.074815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552380+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552380+0000","last_peered":"2024-05-10T14:07:11.552380+0000","last_clean":"2024-05-10T14:07:11.552380+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552380+0000","last_undegraded":"2024-05-10T14:07:11.552380+0000","last_fullsized":"2024-05-10T14:07:11.552380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072973+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:12.072973+0000","last_peered":"2024-05-10T14:07:12.072973+0000","last_clean":"2024-05-10T14:07:12.072973+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:12.072973+0000","last_undegraded":"2024-05-10T14:07:12.072973+0000","last_fullsized":"2024-05-10T14:07:12.072973+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550200+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550200+0000","last_peered":"2024-05-10T14:07:11.550200+0000","last_clean":"2024-05-10T14:07:11.550200+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550200+0000","last_undegraded":"2024-05-10T14:07:11.550200+0000","last_fullsized":"2024-05-10T14:07:11.550200+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:47.337132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552750+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552750+0000","last_peered":"2024-05-10T14:07:11.552750+0000","last_clean":"2024-05-10T14:07:11.552750+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552750+0000","last_undegraded":"2024-05-10T14:07:11.552750+0000","last_fullsized":"2024-05-10T14:07:11.552750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554785+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554785+0000","last_peered":"2024-05-10T14:07:11.554785+0000","last_clean":"2024-05-10T14:07:11.554785+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554785+0000","last_undegraded":"2024-05-10T14:07:11.554785+0000","last_fullsized":"2024-05-10T14:07:11.554785+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.963586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550032+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:11.550032+0000","last_peered":"2024-05-10T14:07:11.550032+0000","last_clean":"2024-05-10T14:07:11.550032+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:11.550032+0000","last_undegraded":"2024-05-10T14:07:11.550032+0000","last_fullsized":"2024-05-10T14:07:11.550032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075442+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.075442+0000","last_peered":"2024-05-10T14:07:12.075442+0000","last_clean":"2024-05-10T14:07:12.075442+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.075442+0000","last_undegraded":"2024-05-10T14:07:12.075442+0000","last_fullsized":"2024-05-10T14:07:12.075442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549388+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549388+0000","last_peered":"2024-05-10T14:07:11.549388+0000","last_clean":"2024-05-10T14:07:11.549388+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549388+0000","last_undegraded":"2024-05-10T14:07:11.549388+0000","last_fullsized":"2024-05-10T14:07:11.549388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555844+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:07:11.555844+0000","last_peered":"2024-05-10T14:07:11.555844+0000","last_clean":"2024-05-10T14:07:11.555844+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:11.555844+0000","last_undegraded":"2024-05-10T14:07:11.555844+0000","last_fullsized":"2024-05-10T14:07:11.555844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":296,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555085+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:11.555085+0000","last_peered":"2024-05-10T14:07:11.555085+0000","last_clean":"2024-05-10T14:07:11.555085+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:11.555085+0000","last_undegraded":"2024-05-10T14:07:11.555085+0000","last_fullsized":"2024-05-10T14:07:11.555085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":203,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080999+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:12.080999+0000","last_peered":"2024-05-10T14:07:12.080999+0000","last_clean":"2024-05-10T14:07:12.080999+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:12.080999+0000","last_undegraded":"2024-05-10T14:07:12.080999+0000","last_fullsized":"2024-05-10T14:07:12.080999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549647+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549647+0000","last_peered":"2024-05-10T14:07:11.549647+0000","last_clean":"2024-05-10T14:07:11.549647+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549647+0000","last_undegraded":"2024-05-10T14:07:11.549647+0000","last_fullsized":"2024-05-10T14:07:11.549647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078973+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:12.078973+0000","last_peered":"2024-05-10T14:07:12.078973+0000","last_clean":"2024-05-10T14:07:12.078973+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:12.078973+0000","last_undegraded":"2024-05-10T14:07:12.078973+0000","last_fullsized":"2024-05-10T14:07:12.078973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":217,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077168+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:12.077168+0000","last_peered":"2024-05-10T14:07:12.077168+0000","last_clean":"2024-05-10T14:07:12.077168+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:12.077168+0000","last_undegraded":"2024-05-10T14:07:12.077168+0000","last_fullsized":"2024-05-10T14:07:12.077168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549496+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549496+0000","last_peered":"2024-05-10T14:07:11.549496+0000","last_clean":"2024-05-10T14:07:11.549496+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549496+0000","last_undegraded":"2024-05-10T14:07:11.549496+0000","last_fullsized":"2024-05-10T14:07:11.549496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":218,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080066+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:12.080066+0000","last_peered":"2024-05-10T14:07:12.080066+0000","last_clean":"2024-05-10T14:07:12.080066+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:12.080066+0000","last_undegraded":"2024-05-10T14:07:12.080066+0000","last_fullsized":"2024-05-10T14:07:12.080066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074628+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074628+0000","last_peered":"2024-05-10T14:07:12.074628+0000","last_clean":"2024-05-10T14:07:12.074628+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074628+0000","last_undegraded":"2024-05-10T14:07:12.074628+0000","last_fullsized":"2024-05-10T14:07:12.074628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.724292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074954+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074954+0000","last_peered":"2024-05-10T14:07:12.074954+0000","last_clean":"2024-05-10T14:07:12.074954+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074954+0000","last_undegraded":"2024-05-10T14:07:12.074954+0000","last_fullsized":"2024-05-10T14:07:12.074954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073072+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073072+0000","last_peered":"2024-05-10T14:07:12.073072+0000","last_clean":"2024-05-10T14:07:12.073072+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073072+0000","last_undegraded":"2024-05-10T14:07:12.073072+0000","last_fullsized":"2024-05-10T14:07:12.073072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":337,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073234+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:12.073234+0000","last_peered":"2024-05-10T14:07:12.073234+0000","last_clean":"2024-05-10T14:07:12.073234+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:12.073234+0000","last_undegraded":"2024-05-10T14:07:12.073234+0000","last_fullsized":"2024-05-10T14:07:12.073234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552257+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552257+0000","last_peered":"2024-05-10T14:07:11.552257+0000","last_clean":"2024-05-10T14:07:11.552257+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552257+0000","last_undegraded":"2024-05-10T14:07:11.552257+0000","last_fullsized":"2024-05-10T14:07:11.552257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555371+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555371+0000","last_peered":"2024-05-10T14:07:11.555371+0000","last_clean":"2024-05-10T14:07:11.555371+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555371+0000","last_undegraded":"2024-05-10T14:07:11.555371+0000","last_fullsized":"2024-05-10T14:07:11.555371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553894+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:11.553894+0000","last_peered":"2024-05-10T14:07:11.553894+0000","last_clean":"2024-05-10T14:07:11.553894+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:11.553894+0000","last_undegraded":"2024-05-10T14:07:11.553894+0000","last_fullsized":"2024-05-10T14:07:11.553894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073844+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073844+0000","last_peered":"2024-05-10T14:07:12.073844+0000","last_clean":"2024-05-10T14:07:12.073844+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073844+0000","last_undegraded":"2024-05-10T14:07:12.073844+0000","last_fullsized":"2024-05-10T14:07:12.073844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551597+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551597+0000","last_peered":"2024-05-10T14:07:11.551597+0000","last_clean":"2024-05-10T14:07:11.551597+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551597+0000","last_undegraded":"2024-05-10T14:07:11.551597+0000","last_fullsized":"2024-05-10T14:07:11.551597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554491+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:11.554491+0000","last_peered":"2024-05-10T14:07:11.554491+0000","last_clean":"2024-05-10T14:07:11.554491+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:11.554491+0000","last_undegraded":"2024-05-10T14:07:11.554491+0000","last_fullsized":"2024-05-10T14:07:11.554491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074222+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:12.074222+0000","last_peered":"2024-05-10T14:07:12.074222+0000","last_clean":"2024-05-10T14:07:12.074222+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:12.074222+0000","last_undegraded":"2024-05-10T14:07:12.074222+0000","last_fullsized":"2024-05-10T14:07:12.074222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072664+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:12.072664+0000","last_peered":"2024-05-10T14:07:12.072664+0000","last_clean":"2024-05-10T14:07:12.072664+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:12.072664+0000","last_undegraded":"2024-05-10T14:07:12.072664+0000","last_fullsized":"2024-05-10T14:07:12.072664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074302+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.074302+0000","last_peered":"2024-05-10T14:07:12.074302+0000","last_clean":"2024-05-10T14:07:12.074302+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.074302+0000","last_undegraded":"2024-05-10T14:07:12.074302+0000","last_fullsized":"2024-05-10T14:07:12.074302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074708+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074708+0000","last_peered":"2024-05-10T14:07:12.074708+0000","last_clean":"2024-05-10T14:07:12.074708+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074708+0000","last_undegraded":"2024-05-10T14:07:12.074708+0000","last_fullsized":"2024-05-10T14:07:12.074708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":194,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074718+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:12.074718+0000","last_peered":"2024-05-10T14:07:12.074718+0000","last_clean":"2024-05-10T14:07:12.074718+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:12.074718+0000","last_undegraded":"2024-05-10T14:07:12.074718+0000","last_fullsized":"2024-05-10T14:07:12.074718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554724+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:11.554724+0000","last_peered":"2024-05-10T14:07:11.554724+0000","last_clean":"2024-05-10T14:07:11.554724+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:11.554724+0000","last_undegraded":"2024-05-10T14:07:11.554724+0000","last_fullsized":"2024-05-10T14:07:11.554724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548842+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548842+0000","last_peered":"2024-05-10T14:07:11.548842+0000","last_clean":"2024-05-10T14:07:11.548842+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548842+0000","last_undegraded":"2024-05-10T14:07:11.548842+0000","last_fullsized":"2024-05-10T14:07:11.548842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:58.484385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554074+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554074+0000","last_peered":"2024-05-10T14:07:11.554074+0000","last_clean":"2024-05-10T14:07:11.554074+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554074+0000","last_undegraded":"2024-05-10T14:07:11.554074+0000","last_fullsized":"2024-05-10T14:07:11.554074+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.552986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554801+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:11.554801+0000","last_peered":"2024-05-10T14:07:11.554801+0000","last_clean":"2024-05-10T14:07:11.554801+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:11.554801+0000","last_undegraded":"2024-05-10T14:07:11.554801+0000","last_fullsized":"2024-05-10T14:07:11.554801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074182+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.074182+0000","last_peered":"2024-05-10T14:07:12.074182+0000","last_clean":"2024-05-10T14:07:12.074182+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.074182+0000","last_undegraded":"2024-05-10T14:07:12.074182+0000","last_fullsized":"2024-05-10T14:07:12.074182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075156+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075156+0000","last_peered":"2024-05-10T14:07:12.075156+0000","last_clean":"2024-05-10T14:07:12.075156+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075156+0000","last_undegraded":"2024-05-10T14:07:12.075156+0000","last_fullsized":"2024-05-10T14:07:12.075156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548961+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.548961+0000","last_peered":"2024-05-10T14:07:11.548961+0000","last_clean":"2024-05-10T14:07:11.548961+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.548961+0000","last_undegraded":"2024-05-10T14:07:11.548961+0000","last_fullsized":"2024-05-10T14:07:11.548961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080460+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:12.080460+0000","last_peered":"2024-05-10T14:07:12.080460+0000","last_clean":"2024-05-10T14:07:12.080460+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:12.080460+0000","last_undegraded":"2024-05-10T14:07:12.080460+0000","last_fullsized":"2024-05-10T14:07:12.080460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548696+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548696+0000","last_peered":"2024-05-10T14:07:11.548696+0000","last_clean":"2024-05-10T14:07:11.548696+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548696+0000","last_undegraded":"2024-05-10T14:07:11.548696+0000","last_fullsized":"2024-05-10T14:07:11.548696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075247+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:07:12.075247+0000","last_peered":"2024-05-10T14:07:12.075247+0000","last_clean":"2024-05-10T14:07:12.075247+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:12.075247+0000","last_undegraded":"2024-05-10T14:07:12.075247+0000","last_fullsized":"2024-05-10T14:07:12.075247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548172+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:11.548172+0000","last_peered":"2024-05-10T14:07:11.548172+0000","last_clean":"2024-05-10T14:07:11.548172+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:11.548172+0000","last_undegraded":"2024-05-10T14:07:11.548172+0000","last_fullsized":"2024-05-10T14:07:11.548172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549295+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:11.549295+0000","last_peered":"2024-05-10T14:07:11.549295+0000","last_clean":"2024-05-10T14:07:11.549295+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:11.549295+0000","last_undegraded":"2024-05-10T14:07:11.549295+0000","last_fullsized":"2024-05-10T14:07:11.549295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551032+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551032+0000","last_peered":"2024-05-10T14:07:11.551032+0000","last_clean":"2024-05-10T14:07:11.551032+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551032+0000","last_undegraded":"2024-05-10T14:07:11.551032+0000","last_fullsized":"2024-05-10T14:07:11.551032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:59.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553487+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:11.553487+0000","last_peered":"2024-05-10T14:07:11.553487+0000","last_clean":"2024-05-10T14:07:11.553487+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:11.553487+0000","last_undegraded":"2024-05-10T14:07:11.553487+0000","last_fullsized":"2024-05-10T14:07:11.553487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072820+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:12.072820+0000","last_peered":"2024-05-10T14:07:12.072820+0000","last_clean":"2024-05-10T14:07:12.072820+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:12.072820+0000","last_undegraded":"2024-05-10T14:07:12.072820+0000","last_fullsized":"2024-05-10T14:07:12.072820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073737+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073737+0000","last_peered":"2024-05-10T14:07:12.073737+0000","last_clean":"2024-05-10T14:07:12.073737+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073737+0000","last_undegraded":"2024-05-10T14:07:12.073737+0000","last_fullsized":"2024-05-10T14:07:12.073737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:01.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553105+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:11.553105+0000","last_peered":"2024-05-10T14:07:11.553105+0000","last_clean":"2024-05-10T14:07:11.553105+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:11.553105+0000","last_undegraded":"2024-05-10T14:07:11.553105+0000","last_fullsized":"2024-05-10T14:07:11.553105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077794+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077794+0000","last_peered":"2024-05-10T14:07:12.077794+0000","last_clean":"2024-05-10T14:07:12.077794+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077794+0000","last_undegraded":"2024-05-10T14:07:12.077794+0000","last_fullsized":"2024-05-10T14:07:12.077794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548579+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:11.548579+0000","last_peered":"2024-05-10T14:07:11.548579+0000","last_clean":"2024-05-10T14:07:11.548579+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:11.548579+0000","last_undegraded":"2024-05-10T14:07:11.548579+0000","last_fullsized":"2024-05-10T14:07:11.548579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075775+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:07:12.075775+0000","last_peered":"2024-05-10T14:07:12.075775+0000","last_clean":"2024-05-10T14:07:12.075775+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:12.075775+0000","last_undegraded":"2024-05-10T14:07:12.075775+0000","last_fullsized":"2024-05-10T14:07:12.075775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077486+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077486+0000","last_peered":"2024-05-10T14:07:12.077486+0000","last_clean":"2024-05-10T14:07:12.077486+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077486+0000","last_undegraded":"2024-05-10T14:07:12.077486+0000","last_fullsized":"2024-05-10T14:07:12.077486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079988+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:12.079988+0000","last_peered":"2024-05-10T14:07:12.079988+0000","last_clean":"2024-05-10T14:07:12.079988+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:12.079988+0000","last_undegraded":"2024-05-10T14:07:12.079988+0000","last_fullsized":"2024-05-10T14:07:12.079988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073822+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:12.073822+0000","last_peered":"2024-05-10T14:07:12.073822+0000","last_clean":"2024-05-10T14:07:12.073822+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:12.073822+0000","last_undegraded":"2024-05-10T14:07:12.073822+0000","last_fullsized":"2024-05-10T14:07:12.073822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:16.077857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074716+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074716+0000","last_peered":"2024-05-10T14:07:12.074716+0000","last_clean":"2024-05-10T14:07:12.074716+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074716+0000","last_undegraded":"2024-05-10T14:07:12.074716+0000","last_fullsized":"2024-05-10T14:07:12.074716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:08.580401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074052+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:12.074052+0000","last_peered":"2024-05-10T14:07:12.074052+0000","last_clean":"2024-05-10T14:07:12.074052+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:12.074052+0000","last_undegraded":"2024-05-10T14:07:12.074052+0000","last_fullsized":"2024-05-10T14:07:12.074052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552492+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:11.552492+0000","last_peered":"2024-05-10T14:07:11.552492+0000","last_clean":"2024-05-10T14:07:11.552492+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:11.552492+0000","last_undegraded":"2024-05-10T14:07:11.552492+0000","last_fullsized":"2024-05-10T14:07:11.552492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074867+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074867+0000","last_peered":"2024-05-10T14:07:12.074867+0000","last_clean":"2024-05-10T14:07:12.074867+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074867+0000","last_undegraded":"2024-05-10T14:07:12.074867+0000","last_fullsized":"2024-05-10T14:07:12.074867+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:45.875457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073037+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073037+0000","last_peered":"2024-05-10T14:07:12.073037+0000","last_clean":"2024-05-10T14:07:12.073037+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073037+0000","last_undegraded":"2024-05-10T14:07:12.073037+0000","last_fullsized":"2024-05-10T14:07:12.073037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082680+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:12.082680+0000","last_peered":"2024-05-10T14:07:12.082680+0000","last_clean":"2024-05-10T14:07:12.082680+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:12.082680+0000","last_undegraded":"2024-05-10T14:07:12.082680+0000","last_fullsized":"2024-05-10T14:07:12.082680+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077404+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077404+0000","last_peered":"2024-05-10T14:07:12.077404+0000","last_clean":"2024-05-10T14:07:12.077404+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077404+0000","last_undegraded":"2024-05-10T14:07:12.077404+0000","last_fullsized":"2024-05-10T14:07:12.077404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550664+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550664+0000","last_peered":"2024-05-10T14:07:11.550664+0000","last_clean":"2024-05-10T14:07:11.550664+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550664+0000","last_undegraded":"2024-05-10T14:07:11.550664+0000","last_fullsized":"2024-05-10T14:07:11.550664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551820+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551820+0000","last_peered":"2024-05-10T14:07:11.551820+0000","last_clean":"2024-05-10T14:07:11.551820+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551820+0000","last_undegraded":"2024-05-10T14:07:11.551820+0000","last_fullsized":"2024-05-10T14:07:11.551820+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:23.429115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554939+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:11.554939+0000","last_peered":"2024-05-10T14:07:11.554939+0000","last_clean":"2024-05-10T14:07:11.554939+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:11.554939+0000","last_undegraded":"2024-05-10T14:07:11.554939+0000","last_fullsized":"2024-05-10T14:07:11.554939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556160+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556160+0000","last_peered":"2024-05-10T14:07:11.556160+0000","last_clean":"2024-05-10T14:07:11.556160+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556160+0000","last_undegraded":"2024-05-10T14:07:11.556160+0000","last_fullsized":"2024-05-10T14:07:11.556160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073897+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073897+0000","last_peered":"2024-05-10T14:07:12.073897+0000","last_clean":"2024-05-10T14:07:12.073897+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073897+0000","last_undegraded":"2024-05-10T14:07:12.073897+0000","last_fullsized":"2024-05-10T14:07:12.073897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081383+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:12.081383+0000","last_peered":"2024-05-10T14:07:12.081383+0000","last_clean":"2024-05-10T14:07:12.081383+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:12.081383+0000","last_undegraded":"2024-05-10T14:07:12.081383+0000","last_fullsized":"2024-05-10T14:07:12.081383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":214,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074906+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:12.074906+0000","last_peered":"2024-05-10T14:07:12.074906+0000","last_clean":"2024-05-10T14:07:12.074906+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:12.074906+0000","last_undegraded":"2024-05-10T14:07:12.074906+0000","last_fullsized":"2024-05-10T14:07:12.074906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073264+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073264+0000","last_peered":"2024-05-10T14:07:12.073264+0000","last_clean":"2024-05-10T14:07:12.073264+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073264+0000","last_undegraded":"2024-05-10T14:07:12.073264+0000","last_fullsized":"2024-05-10T14:07:12.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073160+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:12.073160+0000","last_peered":"2024-05-10T14:07:12.073160+0000","last_clean":"2024-05-10T14:07:12.073160+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:12.073160+0000","last_undegraded":"2024-05-10T14:07:12.073160+0000","last_fullsized":"2024-05-10T14:07:12.073160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551248+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551248+0000","last_peered":"2024-05-10T14:07:11.551248+0000","last_clean":"2024-05-10T14:07:11.551248+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551248+0000","last_undegraded":"2024-05-10T14:07:11.551248+0000","last_fullsized":"2024-05-10T14:07:11.551248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548996+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:11.548996+0000","last_peered":"2024-05-10T14:07:11.548996+0000","last_clean":"2024-05-10T14:07:11.548996+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:11.548996+0000","last_undegraded":"2024-05-10T14:07:11.548996+0000","last_fullsized":"2024-05-10T14:07:11.548996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552102+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552102+0000","last_peered":"2024-05-10T14:07:11.552102+0000","last_clean":"2024-05-10T14:07:11.552102+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552102+0000","last_undegraded":"2024-05-10T14:07:11.552102+0000","last_fullsized":"2024-05-10T14:07:11.552102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554640+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:11.554640+0000","last_peered":"2024-05-10T14:07:11.554640+0000","last_clean":"2024-05-10T14:07:11.554640+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:11.554640+0000","last_undegraded":"2024-05-10T14:07:11.554640+0000","last_fullsized":"2024-05-10T14:07:11.554640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.339148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548815+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548815+0000","last_peered":"2024-05-10T14:07:11.548815+0000","last_clean":"2024-05-10T14:07:11.548815+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548815+0000","last_undegraded":"2024-05-10T14:07:11.548815+0000","last_fullsized":"2024-05-10T14:07:11.548815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075683+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075683+0000","last_peered":"2024-05-10T14:07:12.075683+0000","last_clean":"2024-05-10T14:07:12.075683+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075683+0000","last_undegraded":"2024-05-10T14:07:12.075683+0000","last_fullsized":"2024-05-10T14:07:12.075683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548974+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:11.548974+0000","last_peered":"2024-05-10T14:07:11.548974+0000","last_clean":"2024-05-10T14:07:11.548974+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:11.548974+0000","last_undegraded":"2024-05-10T14:07:11.548974+0000","last_fullsized":"2024-05-10T14:07:11.548974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073748+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073748+0000","last_peered":"2024-05-10T14:07:12.073748+0000","last_clean":"2024-05-10T14:07:12.073748+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073748+0000","last_undegraded":"2024-05-10T14:07:12.073748+0000","last_fullsized":"2024-05-10T14:07:12.073748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551825+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551825+0000","last_peered":"2024-05-10T14:07:11.551825+0000","last_clean":"2024-05-10T14:07:11.551825+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551825+0000","last_undegraded":"2024-05-10T14:07:11.551825+0000","last_fullsized":"2024-05-10T14:07:11.551825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074123+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074123+0000","last_peered":"2024-05-10T14:07:12.074123+0000","last_clean":"2024-05-10T14:07:12.074123+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074123+0000","last_undegraded":"2024-05-10T14:07:12.074123+0000","last_fullsized":"2024-05-10T14:07:12.074123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554033+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554033+0000","last_peered":"2024-05-10T14:07:11.554033+0000","last_clean":"2024-05-10T14:07:11.554033+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554033+0000","last_undegraded":"2024-05-10T14:07:11.554033+0000","last_fullsized":"2024-05-10T14:07:11.554033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:10:20.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550568+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550568+0000","last_peered":"2024-05-10T14:07:11.550568+0000","last_clean":"2024-05-10T14:07:11.550568+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550568+0000","last_undegraded":"2024-05-10T14:07:11.550568+0000","last_fullsized":"2024-05-10T14:07:11.550568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:27.784903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548734+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548734+0000","last_peered":"2024-05-10T14:07:11.548734+0000","last_clean":"2024-05-10T14:07:11.548734+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548734+0000","last_undegraded":"2024-05-10T14:07:11.548734+0000","last_fullsized":"2024-05-10T14:07:11.548734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554459+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554459+0000","last_peered":"2024-05-10T14:07:11.554459+0000","last_clean":"2024-05-10T14:07:11.554459+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554459+0000","last_undegraded":"2024-05-10T14:07:11.554459+0000","last_fullsized":"2024-05-10T14:07:11.554459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075630+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.075630+0000","last_peered":"2024-05-10T14:07:12.075630+0000","last_clean":"2024-05-10T14:07:12.075630+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.075630+0000","last_undegraded":"2024-05-10T14:07:12.075630+0000","last_fullsized":"2024-05-10T14:07:12.075630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549103+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549103+0000","last_peered":"2024-05-10T14:07:11.549103+0000","last_clean":"2024-05-10T14:07:11.549103+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549103+0000","last_undegraded":"2024-05-10T14:07:11.549103+0000","last_fullsized":"2024-05-10T14:07:11.549103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555318+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555318+0000","last_peered":"2024-05-10T14:07:11.555318+0000","last_clean":"2024-05-10T14:07:11.555318+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555318+0000","last_undegraded":"2024-05-10T14:07:11.555318+0000","last_fullsized":"2024-05-10T14:07:11.555318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":229,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552097+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552097+0000","last_peered":"2024-05-10T14:07:11.552097+0000","last_clean":"2024-05-10T14:07:11.552097+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552097+0000","last_undegraded":"2024-05-10T14:07:11.552097+0000","last_fullsized":"2024-05-10T14:07:11.552097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:17.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074350+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074350+0000","last_peered":"2024-05-10T14:07:12.074350+0000","last_clean":"2024-05-10T14:07:12.074350+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074350+0000","last_undegraded":"2024-05-10T14:07:12.074350+0000","last_fullsized":"2024-05-10T14:07:12.074350+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:17.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073526+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073526+0000","last_peered":"2024-05-10T14:07:12.073526+0000","last_clean":"2024-05-10T14:07:12.073526+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073526+0000","last_undegraded":"2024-05-10T14:07:12.073526+0000","last_fullsized":"2024-05-10T14:07:12.073526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548647+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548647+0000","last_peered":"2024-05-10T14:07:11.548647+0000","last_clean":"2024-05-10T14:07:11.548647+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548647+0000","last_undegraded":"2024-05-10T14:07:11.548647+0000","last_fullsized":"2024-05-10T14:07:11.548647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556094+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:11.556094+0000","last_peered":"2024-05-10T14:07:11.556094+0000","last_clean":"2024-05-10T14:07:11.556094+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:11.556094+0000","last_undegraded":"2024-05-10T14:07:11.556094+0000","last_fullsized":"2024-05-10T14:07:11.556094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075494+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:12.075494+0000","last_peered":"2024-05-10T14:07:12.075494+0000","last_clean":"2024-05-10T14:07:12.075494+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:12.075494+0000","last_undegraded":"2024-05-10T14:07:12.075494+0000","last_fullsized":"2024-05-10T14:07:12.075494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39712,"kb_used_data":8532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332128,"statfs":{"total":96636764160,"available":96596099072,"internally_reserved":0,"allocated":8736768,"data_stored":7959958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710760,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":5868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":6008832,"data_stored":5271863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41252,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39176,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332664,"statfs":{"total":96636764160,"available":96596647936,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2433024,"data_stored":1668141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:16.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:16.654 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:16.664 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-05-10T14:07:16.217760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302680,"kb_used_data":36068,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672040,"statfs":{"total":773094113280,"available":772784168960,"internally_reserved":0,"allocated":36933632,"data_stored":30814595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701241"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074058+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074058+0000","last_peered":"2024-05-10T14:07:12.074058+0000","last_clean":"2024-05-10T14:07:12.074058+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074058+0000","last_undegraded":"2024-05-10T14:07:12.074058+0000","last_fullsized":"2024-05-10T14:07:12.074058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548272+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548272+0000","last_peered":"2024-05-10T14:07:11.548272+0000","last_clean":"2024-05-10T14:07:11.548272+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548272+0000","last_undegraded":"2024-05-10T14:07:11.548272+0000","last_fullsized":"2024-05-10T14:07:11.548272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555985+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.555985+0000","last_peered":"2024-05-10T14:07:11.555985+0000","last_clean":"2024-05-10T14:07:11.555985+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.555985+0000","last_undegraded":"2024-05-10T14:07:11.555985+0000","last_fullsized":"2024-05-10T14:07:11.555985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081409+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081409+0000","last_peered":"2024-05-10T14:07:12.081409+0000","last_clean":"2024-05-10T14:07:12.081409+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081409+0000","last_undegraded":"2024-05-10T14:07:12.081409+0000","last_fullsized":"2024-05-10T14:07:12.081409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079824+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079824+0000","last_peered":"2024-05-10T14:07:12.079824+0000","last_clean":"2024-05-10T14:07:12.079824+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079824+0000","last_undegraded":"2024-05-10T14:07:12.079824+0000","last_fullsized":"2024-05-10T14:07:12.079824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554228+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:11.554228+0000","last_peered":"2024-05-10T14:07:11.554228+0000","last_clean":"2024-05-10T14:07:11.554228+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:11.554228+0000","last_undegraded":"2024-05-10T14:07:11.554228+0000","last_fullsized":"2024-05-10T14:07:11.554228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550475+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550475+0000","last_peered":"2024-05-10T14:07:11.550475+0000","last_clean":"2024-05-10T14:07:11.550475+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550475+0000","last_undegraded":"2024-05-10T14:07:11.550475+0000","last_fullsized":"2024-05-10T14:07:11.550475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555673+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:11.555673+0000","last_peered":"2024-05-10T14:07:11.555673+0000","last_clean":"2024-05-10T14:07:11.555673+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:11.555673+0000","last_undegraded":"2024-05-10T14:07:11.555673+0000","last_fullsized":"2024-05-10T14:07:11.555673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553359+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:11.553359+0000","last_peered":"2024-05-10T14:07:11.553359+0000","last_clean":"2024-05-10T14:07:11.553359+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:11.553359+0000","last_undegraded":"2024-05-10T14:07:11.553359+0000","last_fullsized":"2024-05-10T14:07:11.553359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549532+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549532+0000","last_peered":"2024-05-10T14:07:11.549532+0000","last_clean":"2024-05-10T14:07:11.549532+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549532+0000","last_undegraded":"2024-05-10T14:07:11.549532+0000","last_fullsized":"2024-05-10T14:07:11.549532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.073945+0000","last_peered":"2024-05-10T14:07:12.073945+0000","last_clean":"2024-05-10T14:07:12.073945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.073945+0000","last_undegraded":"2024-05-10T14:07:12.073945+0000","last_fullsized":"2024-05-10T14:07:12.073945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555009+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555009+0000","last_peered":"2024-05-10T14:07:11.555009+0000","last_clean":"2024-05-10T14:07:11.555009+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555009+0000","last_undegraded":"2024-05-10T14:07:11.555009+0000","last_fullsized":"2024-05-10T14:07:11.555009+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:12.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074427+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:12.074427+0000","last_peered":"2024-05-10T14:07:12.074427+0000","last_clean":"2024-05-10T14:07:12.074427+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:12.074427+0000","last_undegraded":"2024-05-10T14:07:12.074427+0000","last_fullsized":"2024-05-10T14:07:12.074427+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550092+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:11.550092+0000","last_peered":"2024-05-10T14:07:11.550092+0000","last_clean":"2024-05-10T14:07:11.550092+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:11.550092+0000","last_undegraded":"2024-05-10T14:07:11.550092+0000","last_fullsized":"2024-05-10T14:07:11.550092+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:52.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073622+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073622+0000","last_peered":"2024-05-10T14:07:12.073622+0000","last_clean":"2024-05-10T14:07:12.073622+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073622+0000","last_undegraded":"2024-05-10T14:07:12.073622+0000","last_fullsized":"2024-05-10T14:07:12.073622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075091+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:12.075091+0000","last_peered":"2024-05-10T14:07:12.075091+0000","last_clean":"2024-05-10T14:07:12.075091+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:12.075091+0000","last_undegraded":"2024-05-10T14:07:12.075091+0000","last_fullsized":"2024-05-10T14:07:12.075091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555017+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555017+0000","last_peered":"2024-05-10T14:07:11.555017+0000","last_clean":"2024-05-10T14:07:11.555017+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555017+0000","last_undegraded":"2024-05-10T14:07:11.555017+0000","last_fullsized":"2024-05-10T14:07:11.555017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555401+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:11.555401+0000","last_peered":"2024-05-10T14:07:11.555401+0000","last_clean":"2024-05-10T14:07:11.555401+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:11.555401+0000","last_undegraded":"2024-05-10T14:07:11.555401+0000","last_fullsized":"2024-05-10T14:07:11.555401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083134+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:12.083134+0000","last_peered":"2024-05-10T14:07:12.083134+0000","last_clean":"2024-05-10T14:07:12.083134+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:12.083134+0000","last_undegraded":"2024-05-10T14:07:12.083134+0000","last_fullsized":"2024-05-10T14:07:12.083134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554347+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:11.554347+0000","last_peered":"2024-05-10T14:07:11.554347+0000","last_clean":"2024-05-10T14:07:11.554347+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:11.554347+0000","last_undegraded":"2024-05-10T14:07:11.554347+0000","last_fullsized":"2024-05-10T14:07:11.554347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:47.045146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082687+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:12.082687+0000","last_peered":"2024-05-10T14:07:12.082687+0000","last_clean":"2024-05-10T14:07:12.082687+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:12.082687+0000","last_undegraded":"2024-05-10T14:07:12.082687+0000","last_fullsized":"2024-05-10T14:07:12.082687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549354+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:11.549354+0000","last_peered":"2024-05-10T14:07:11.549354+0000","last_clean":"2024-05-10T14:07:11.549354+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:11.549354+0000","last_undegraded":"2024-05-10T14:07:11.549354+0000","last_fullsized":"2024-05-10T14:07:11.549354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075462+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:12.075462+0000","last_peered":"2024-05-10T14:07:12.075462+0000","last_clean":"2024-05-10T14:07:12.075462+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:12.075462+0000","last_undegraded":"2024-05-10T14:07:12.075462+0000","last_fullsized":"2024-05-10T14:07:12.075462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550653+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550653+0000","last_peered":"2024-05-10T14:07:11.550653+0000","last_clean":"2024-05-10T14:07:11.550653+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550653+0000","last_undegraded":"2024-05-10T14:07:11.550653+0000","last_fullsized":"2024-05-10T14:07:11.550653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":301,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554321+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:11.554321+0000","last_peered":"2024-05-10T14:07:11.554321+0000","last_clean":"2024-05-10T14:07:11.554321+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:11.554321+0000","last_undegraded":"2024-05-10T14:07:11.554321+0000","last_fullsized":"2024-05-10T14:07:11.554321+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:10.732947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548392+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548392+0000","last_peered":"2024-05-10T14:07:11.548392+0000","last_clean":"2024-05-10T14:07:11.548392+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548392+0000","last_undegraded":"2024-05-10T14:07:11.548392+0000","last_fullsized":"2024-05-10T14:07:11.548392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554759+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554759+0000","last_peered":"2024-05-10T14:07:11.554759+0000","last_clean":"2024-05-10T14:07:11.554759+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554759+0000","last_undegraded":"2024-05-10T14:07:11.554759+0000","last_fullsized":"2024-05-10T14:07:11.554759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076842+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:12.076842+0000","last_peered":"2024-05-10T14:07:12.076842+0000","last_clean":"2024-05-10T14:07:12.076842+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:12.076842+0000","last_undegraded":"2024-05-10T14:07:12.076842+0000","last_fullsized":"2024-05-10T14:07:12.076842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072614+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:12.072614+0000","last_peered":"2024-05-10T14:07:12.072614+0000","last_clean":"2024-05-10T14:07:12.072614+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:12.072614+0000","last_undegraded":"2024-05-10T14:07:12.072614+0000","last_fullsized":"2024-05-10T14:07:12.072614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074531+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074531+0000","last_peered":"2024-05-10T14:07:12.074531+0000","last_clean":"2024-05-10T14:07:12.074531+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074531+0000","last_undegraded":"2024-05-10T14:07:12.074531+0000","last_fullsized":"2024-05-10T14:07:12.074531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074815+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074815+0000","last_peered":"2024-05-10T14:07:12.074815+0000","last_clean":"2024-05-10T14:07:12.074815+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074815+0000","last_undegraded":"2024-05-10T14:07:12.074815+0000","last_fullsized":"2024-05-10T14:07:12.074815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552380+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552380+0000","last_peered":"2024-05-10T14:07:11.552380+0000","last_clean":"2024-05-10T14:07:11.552380+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552380+0000","last_undegraded":"2024-05-10T14:07:11.552380+0000","last_fullsized":"2024-05-10T14:07:11.552380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072973+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:12.072973+0000","last_peered":"2024-05-10T14:07:12.072973+0000","last_clean":"2024-05-10T14:07:12.072973+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:12.072973+0000","last_undegraded":"2024-05-10T14:07:12.072973+0000","last_fullsized":"2024-05-10T14:07:12.072973+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550200+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550200+0000","last_peered":"2024-05-10T14:07:11.550200+0000","last_clean":"2024-05-10T14:07:11.550200+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550200+0000","last_undegraded":"2024-05-10T14:07:11.550200+0000","last_fullsized":"2024-05-10T14:07:11.550200+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:47.337132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552750+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552750+0000","last_peered":"2024-05-10T14:07:11.552750+0000","last_clean":"2024-05-10T14:07:11.552750+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552750+0000","last_undegraded":"2024-05-10T14:07:11.552750+0000","last_fullsized":"2024-05-10T14:07:11.552750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554785+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554785+0000","last_peered":"2024-05-10T14:07:11.554785+0000","last_clean":"2024-05-10T14:07:11.554785+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554785+0000","last_undegraded":"2024-05-10T14:07:11.554785+0000","last_fullsized":"2024-05-10T14:07:11.554785+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.963586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550032+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:11.550032+0000","last_peered":"2024-05-10T14:07:11.550032+0000","last_clean":"2024-05-10T14:07:11.550032+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:11.550032+0000","last_undegraded":"2024-05-10T14:07:11.550032+0000","last_fullsized":"2024-05-10T14:07:11.550032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075442+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.075442+0000","last_peered":"2024-05-10T14:07:12.075442+0000","last_clean":"2024-05-10T14:07:12.075442+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.075442+0000","last_undegraded":"2024-05-10T14:07:12.075442+0000","last_fullsized":"2024-05-10T14:07:12.075442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549388+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549388+0000","last_peered":"2024-05-10T14:07:11.549388+0000","last_clean":"2024-05-10T14:07:11.549388+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549388+0000","last_undegraded":"2024-05-10T14:07:11.549388+0000","last_fullsized":"2024-05-10T14:07:11.549388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555844+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:07:11.555844+0000","last_peered":"2024-05-10T14:07:11.555844+0000","last_clean":"2024-05-10T14:07:11.555844+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:11.555844+0000","last_undegraded":"2024-05-10T14:07:11.555844+0000","last_fullsized":"2024-05-10T14:07:11.555844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":296,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555085+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:11.555085+0000","last_peered":"2024-05-10T14:07:11.555085+0000","last_clean":"2024-05-10T14:07:11.555085+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:11.555085+0000","last_undegraded":"2024-05-10T14:07:11.555085+0000","last_fullsized":"2024-05-10T14:07:11.555085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":203,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080999+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:12.080999+0000","last_peered":"2024-05-10T14:07:12.080999+0000","last_clean":"2024-05-10T14:07:12.080999+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:12.080999+0000","last_undegraded":"2024-05-10T14:07:12.080999+0000","last_fullsized":"2024-05-10T14:07:12.080999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549647+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549647+0000","last_peered":"2024-05-10T14:07:11.549647+0000","last_clean":"2024-05-10T14:07:11.549647+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549647+0000","last_undegraded":"2024-05-10T14:07:11.549647+0000","last_fullsized":"2024-05-10T14:07:11.549647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078973+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:12.078973+0000","last_peered":"2024-05-10T14:07:12.078973+0000","last_clean":"2024-05-10T14:07:12.078973+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:12.078973+0000","last_undegraded":"2024-05-10T14:07:12.078973+0000","last_fullsized":"2024-05-10T14:07:12.078973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":217,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077168+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:12.077168+0000","last_peered":"2024-05-10T14:07:12.077168+0000","last_clean":"2024-05-10T14:07:12.077168+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:12.077168+0000","last_undegraded":"2024-05-10T14:07:12.077168+0000","last_fullsized":"2024-05-10T14:07:12.077168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549496+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549496+0000","last_peered":"2024-05-10T14:07:11.549496+0000","last_clean":"2024-05-10T14:07:11.549496+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549496+0000","last_undegraded":"2024-05-10T14:07:11.549496+0000","last_fullsized":"2024-05-10T14:07:11.549496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":218,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080066+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:12.080066+0000","last_peered":"2024-05-10T14:07:12.080066+0000","last_clean":"2024-05-10T14:07:12.080066+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:12.080066+0000","last_undegraded":"2024-05-10T14:07:12.080066+0000","last_fullsized":"2024-05-10T14:07:12.080066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074628+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074628+0000","last_peered":"2024-05-10T14:07:12.074628+0000","last_clean":"2024-05-10T14:07:12.074628+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074628+0000","last_undegraded":"2024-05-10T14:07:12.074628+0000","last_fullsized":"2024-05-10T14:07:12.074628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.724292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074954+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074954+0000","last_peered":"2024-05-10T14:07:12.074954+0000","last_clean":"2024-05-10T14:07:12.074954+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074954+0000","last_undegraded":"2024-05-10T14:07:12.074954+0000","last_fullsized":"2024-05-10T14:07:12.074954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073072+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073072+0000","last_peered":"2024-05-10T14:07:12.073072+0000","last_clean":"2024-05-10T14:07:12.073072+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073072+0000","last_undegraded":"2024-05-10T14:07:12.073072+0000","last_fullsized":"2024-05-10T14:07:12.073072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":337,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073234+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:12.073234+0000","last_peered":"2024-05-10T14:07:12.073234+0000","last_clean":"2024-05-10T14:07:12.073234+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:12.073234+0000","last_undegraded":"2024-05-10T14:07:12.073234+0000","last_fullsized":"2024-05-10T14:07:12.073234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552257+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552257+0000","last_peered":"2024-05-10T14:07:11.552257+0000","last_clean":"2024-05-10T14:07:11.552257+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552257+0000","last_undegraded":"2024-05-10T14:07:11.552257+0000","last_fullsized":"2024-05-10T14:07:11.552257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555371+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555371+0000","last_peered":"2024-05-10T14:07:11.555371+0000","last_clean":"2024-05-10T14:07:11.555371+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555371+0000","last_undegraded":"2024-05-10T14:07:11.555371+0000","last_fullsized":"2024-05-10T14:07:11.555371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553894+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:11.553894+0000","last_peered":"2024-05-10T14:07:11.553894+0000","last_clean":"2024-05-10T14:07:11.553894+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:11.553894+0000","last_undegraded":"2024-05-10T14:07:11.553894+0000","last_fullsized":"2024-05-10T14:07:11.553894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073844+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073844+0000","last_peered":"2024-05-10T14:07:12.073844+0000","last_clean":"2024-05-10T14:07:12.073844+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073844+0000","last_undegraded":"2024-05-10T14:07:12.073844+0000","last_fullsized":"2024-05-10T14:07:12.073844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551597+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551597+0000","last_peered":"2024-05-10T14:07:11.551597+0000","last_clean":"2024-05-10T14:07:11.551597+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551597+0000","last_undegraded":"2024-05-10T14:07:11.551597+0000","last_fullsized":"2024-05-10T14:07:11.551597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554491+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:11.554491+0000","last_peered":"2024-05-10T14:07:11.554491+0000","last_clean":"2024-05-10T14:07:11.554491+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:11.554491+0000","last_undegraded":"2024-05-10T14:07:11.554491+0000","last_fullsized":"2024-05-10T14:07:11.554491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074222+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:12.074222+0000","last_peered":"2024-05-10T14:07:12.074222+0000","last_clean":"2024-05-10T14:07:12.074222+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:12.074222+0000","last_undegraded":"2024-05-10T14:07:12.074222+0000","last_fullsized":"2024-05-10T14:07:12.074222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072664+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:12.072664+0000","last_peered":"2024-05-10T14:07:12.072664+0000","last_clean":"2024-05-10T14:07:12.072664+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:12.072664+0000","last_undegraded":"2024-05-10T14:07:12.072664+0000","last_fullsized":"2024-05-10T14:07:12.072664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074302+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.074302+0000","last_peered":"2024-05-10T14:07:12.074302+0000","last_clean":"2024-05-10T14:07:12.074302+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.074302+0000","last_undegraded":"2024-05-10T14:07:12.074302+0000","last_fullsized":"2024-05-10T14:07:12.074302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074708+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074708+0000","last_peered":"2024-05-10T14:07:12.074708+0000","last_clean":"2024-05-10T14:07:12.074708+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074708+0000","last_undegraded":"2024-05-10T14:07:12.074708+0000","last_fullsized":"2024-05-10T14:07:12.074708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":194,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074718+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:12.074718+0000","last_peered":"2024-05-10T14:07:12.074718+0000","last_clean":"2024-05-10T14:07:12.074718+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:12.074718+0000","last_undegraded":"2024-05-10T14:07:12.074718+0000","last_fullsized":"2024-05-10T14:07:12.074718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554724+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:11.554724+0000","last_peered":"2024-05-10T14:07:11.554724+0000","last_clean":"2024-05-10T14:07:11.554724+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:11.554724+0000","last_undegraded":"2024-05-10T14:07:11.554724+0000","last_fullsized":"2024-05-10T14:07:11.554724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548842+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548842+0000","last_peered":"2024-05-10T14:07:11.548842+0000","last_clean":"2024-05-10T14:07:11.548842+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548842+0000","last_undegraded":"2024-05-10T14:07:11.548842+0000","last_fullsized":"2024-05-10T14:07:11.548842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:58.484385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554074+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554074+0000","last_peered":"2024-05-10T14:07:11.554074+0000","last_clean":"2024-05-10T14:07:11.554074+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554074+0000","last_undegraded":"2024-05-10T14:07:11.554074+0000","last_fullsized":"2024-05-10T14:07:11.554074+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.552986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554801+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:11.554801+0000","last_peered":"2024-05-10T14:07:11.554801+0000","last_clean":"2024-05-10T14:07:11.554801+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:11.554801+0000","last_undegraded":"2024-05-10T14:07:11.554801+0000","last_fullsized":"2024-05-10T14:07:11.554801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074182+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.074182+0000","last_peered":"2024-05-10T14:07:12.074182+0000","last_clean":"2024-05-10T14:07:12.074182+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.074182+0000","last_undegraded":"2024-05-10T14:07:12.074182+0000","last_fullsized":"2024-05-10T14:07:12.074182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075156+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075156+0000","last_peered":"2024-05-10T14:07:12.075156+0000","last_clean":"2024-05-10T14:07:12.075156+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075156+0000","last_undegraded":"2024-05-10T14:07:12.075156+0000","last_fullsized":"2024-05-10T14:07:12.075156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548961+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.548961+0000","last_peered":"2024-05-10T14:07:11.548961+0000","last_clean":"2024-05-10T14:07:11.548961+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.548961+0000","last_undegraded":"2024-05-10T14:07:11.548961+0000","last_fullsized":"2024-05-10T14:07:11.548961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080460+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:12.080460+0000","last_peered":"2024-05-10T14:07:12.080460+0000","last_clean":"2024-05-10T14:07:12.080460+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:12.080460+0000","last_undegraded":"2024-05-10T14:07:12.080460+0000","last_fullsized":"2024-05-10T14:07:12.080460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548696+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548696+0000","last_peered":"2024-05-10T14:07:11.548696+0000","last_clean":"2024-05-10T14:07:11.548696+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548696+0000","last_undegraded":"2024-05-10T14:07:11.548696+0000","last_fullsized":"2024-05-10T14:07:11.548696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075247+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:07:12.075247+0000","last_peered":"2024-05-10T14:07:12.075247+0000","last_clean":"2024-05-10T14:07:12.075247+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:12.075247+0000","last_undegraded":"2024-05-10T14:07:12.075247+0000","last_fullsized":"2024-05-10T14:07:12.075247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548172+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:11.548172+0000","last_peered":"2024-05-10T14:07:11.548172+0000","last_clean":"2024-05-10T14:07:11.548172+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:11.548172+0000","last_undegraded":"2024-05-10T14:07:11.548172+0000","last_fullsized":"2024-05-10T14:07:11.548172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549295+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:11.549295+0000","last_peered":"2024-05-10T14:07:11.549295+0000","last_clean":"2024-05-10T14:07:11.549295+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:11.549295+0000","last_undegraded":"2024-05-10T14:07:11.549295+0000","last_fullsized":"2024-05-10T14:07:11.549295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551032+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551032+0000","last_peered":"2024-05-10T14:07:11.551032+0000","last_clean":"2024-05-10T14:07:11.551032+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551032+0000","last_undegraded":"2024-05-10T14:07:11.551032+0000","last_fullsized":"2024-05-10T14:07:11.551032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:59.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553487+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:11.553487+0000","last_peered":"2024-05-10T14:07:11.553487+0000","last_clean":"2024-05-10T14:07:11.553487+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:11.553487+0000","last_undegraded":"2024-05-10T14:07:11.553487+0000","last_fullsized":"2024-05-10T14:07:11.553487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072820+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:12.072820+0000","last_peered":"2024-05-10T14:07:12.072820+0000","last_clean":"2024-05-10T14:07:12.072820+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:12.072820+0000","last_undegraded":"2024-05-10T14:07:12.072820+0000","last_fullsized":"2024-05-10T14:07:12.072820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073737+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073737+0000","last_peered":"2024-05-10T14:07:12.073737+0000","last_clean":"2024-05-10T14:07:12.073737+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073737+0000","last_undegraded":"2024-05-10T14:07:12.073737+0000","last_fullsized":"2024-05-10T14:07:12.073737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:01.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553105+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:11.553105+0000","last_peered":"2024-05-10T14:07:11.553105+0000","last_clean":"2024-05-10T14:07:11.553105+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:11.553105+0000","last_undegraded":"2024-05-10T14:07:11.553105+0000","last_fullsized":"2024-05-10T14:07:11.553105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077794+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077794+0000","last_peered":"2024-05-10T14:07:12.077794+0000","last_clean":"2024-05-10T14:07:12.077794+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077794+0000","last_undegraded":"2024-05-10T14:07:12.077794+0000","last_fullsized":"2024-05-10T14:07:12.077794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548579+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:11.548579+0000","last_peered":"2024-05-10T14:07:11.548579+0000","last_clean":"2024-05-10T14:07:11.548579+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:11.548579+0000","last_undegraded":"2024-05-10T14:07:11.548579+0000","last_fullsized":"2024-05-10T14:07:11.548579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075775+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:07:12.075775+0000","last_peered":"2024-05-10T14:07:12.075775+0000","last_clean":"2024-05-10T14:07:12.075775+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:12.075775+0000","last_undegraded":"2024-05-10T14:07:12.075775+0000","last_fullsized":"2024-05-10T14:07:12.075775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077486+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077486+0000","last_peered":"2024-05-10T14:07:12.077486+0000","last_clean":"2024-05-10T14:07:12.077486+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077486+0000","last_undegraded":"2024-05-10T14:07:12.077486+0000","last_fullsized":"2024-05-10T14:07:12.077486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079988+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:12.079988+0000","last_peered":"2024-05-10T14:07:12.079988+0000","last_clean":"2024-05-10T14:07:12.079988+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:12.079988+0000","last_undegraded":"2024-05-10T14:07:12.079988+0000","last_fullsized":"2024-05-10T14:07:12.079988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073822+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:12.073822+0000","last_peered":"2024-05-10T14:07:12.073822+0000","last_clean":"2024-05-10T14:07:12.073822+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:12.073822+0000","last_undegraded":"2024-05-10T14:07:12.073822+0000","last_fullsized":"2024-05-10T14:07:12.073822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:16.077857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074716+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074716+0000","last_peered":"2024-05-10T14:07:12.074716+0000","last_clean":"2024-05-10T14:07:12.074716+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074716+0000","last_undegraded":"2024-05-10T14:07:12.074716+0000","last_fullsized":"2024-05-10T14:07:12.074716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:08.580401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074052+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:12.074052+0000","last_peered":"2024-05-10T14:07:12.074052+0000","last_clean":"2024-05-10T14:07:12.074052+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:12.074052+0000","last_undegraded":"2024-05-10T14:07:12.074052+0000","last_fullsized":"2024-05-10T14:07:12.074052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552492+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:11.552492+0000","last_peered":"2024-05-10T14:07:11.552492+0000","last_clean":"2024-05-10T14:07:11.552492+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:11.552492+0000","last_undegraded":"2024-05-10T14:07:11.552492+0000","last_fullsized":"2024-05-10T14:07:11.552492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074867+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074867+0000","last_peered":"2024-05-10T14:07:12.074867+0000","last_clean":"2024-05-10T14:07:12.074867+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074867+0000","last_undegraded":"2024-05-10T14:07:12.074867+0000","last_fullsized":"2024-05-10T14:07:12.074867+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:45.875457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073037+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073037+0000","last_peered":"2024-05-10T14:07:12.073037+0000","last_clean":"2024-05-10T14:07:12.073037+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073037+0000","last_undegraded":"2024-05-10T14:07:12.073037+0000","last_fullsized":"2024-05-10T14:07:12.073037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082680+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:12.082680+0000","last_peered":"2024-05-10T14:07:12.082680+0000","last_clean":"2024-05-10T14:07:12.082680+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:12.082680+0000","last_undegraded":"2024-05-10T14:07:12.082680+0000","last_fullsized":"2024-05-10T14:07:12.082680+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077404+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077404+0000","last_peered":"2024-05-10T14:07:12.077404+0000","last_clean":"2024-05-10T14:07:12.077404+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077404+0000","last_undegraded":"2024-05-10T14:07:12.077404+0000","last_fullsized":"2024-05-10T14:07:12.077404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550664+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550664+0000","last_peered":"2024-05-10T14:07:11.550664+0000","last_clean":"2024-05-10T14:07:11.550664+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550664+0000","last_undegraded":"2024-05-10T14:07:11.550664+0000","last_fullsized":"2024-05-10T14:07:11.550664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551820+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551820+0000","last_peered":"2024-05-10T14:07:11.551820+0000","last_clean":"2024-05-10T14:07:11.551820+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551820+0000","last_undegraded":"2024-05-10T14:07:11.551820+0000","last_fullsized":"2024-05-10T14:07:11.551820+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:23.429115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554939+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:11.554939+0000","last_peered":"2024-05-10T14:07:11.554939+0000","last_clean":"2024-05-10T14:07:11.554939+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:11.554939+0000","last_undegraded":"2024-05-10T14:07:11.554939+0000","last_fullsized":"2024-05-10T14:07:11.554939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556160+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556160+0000","last_peered":"2024-05-10T14:07:11.556160+0000","last_clean":"2024-05-10T14:07:11.556160+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556160+0000","last_undegraded":"2024-05-10T14:07:11.556160+0000","last_fullsized":"2024-05-10T14:07:11.556160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073897+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073897+0000","last_peered":"2024-05-10T14:07:12.073897+0000","last_clean":"2024-05-10T14:07:12.073897+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073897+0000","last_undegraded":"2024-05-10T14:07:12.073897+0000","last_fullsized":"2024-05-10T14:07:12.073897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081383+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:12.081383+0000","last_peered":"2024-05-10T14:07:12.081383+0000","last_clean":"2024-05-10T14:07:12.081383+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:12.081383+0000","last_undegraded":"2024-05-10T14:07:12.081383+0000","last_fullsized":"2024-05-10T14:07:12.081383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":214,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074906+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:12.074906+0000","last_peered":"2024-05-10T14:07:12.074906+0000","last_clean":"2024-05-10T14:07:12.074906+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:12.074906+0000","last_undegraded":"2024-05-10T14:07:12.074906+0000","last_fullsized":"2024-05-10T14:07:12.074906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073264+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073264+0000","last_peered":"2024-05-10T14:07:12.073264+0000","last_clean":"2024-05-10T14:07:12.073264+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073264+0000","last_undegraded":"2024-05-10T14:07:12.073264+0000","last_fullsized":"2024-05-10T14:07:12.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073160+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:12.073160+0000","last_peered":"2024-05-10T14:07:12.073160+0000","last_clean":"2024-05-10T14:07:12.073160+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:12.073160+0000","last_undegraded":"2024-05-10T14:07:12.073160+0000","last_fullsized":"2024-05-10T14:07:12.073160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551248+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551248+0000","last_peered":"2024-05-10T14:07:11.551248+0000","last_clean":"2024-05-10T14:07:11.551248+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551248+0000","last_undegraded":"2024-05-10T14:07:11.551248+0000","last_fullsized":"2024-05-10T14:07:11.551248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548996+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:11.548996+0000","last_peered":"2024-05-10T14:07:11.548996+0000","last_clean":"2024-05-10T14:07:11.548996+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:11.548996+0000","last_undegraded":"2024-05-10T14:07:11.548996+0000","last_fullsized":"2024-05-10T14:07:11.548996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552102+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552102+0000","last_peered":"2024-05-10T14:07:11.552102+0000","last_clean":"2024-05-10T14:07:11.552102+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552102+0000","last_undegraded":"2024-05-10T14:07:11.552102+0000","last_fullsized":"2024-05-10T14:07:11.552102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554640+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:11.554640+0000","last_peered":"2024-05-10T14:07:11.554640+0000","last_clean":"2024-05-10T14:07:11.554640+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:11.554640+0000","last_undegraded":"2024-05-10T14:07:11.554640+0000","last_fullsized":"2024-05-10T14:07:11.554640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.339148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548815+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548815+0000","last_peered":"2024-05-10T14:07:11.548815+0000","last_clean":"2024-05-10T14:07:11.548815+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548815+0000","last_undegraded":"2024-05-10T14:07:11.548815+0000","last_fullsized":"2024-05-10T14:07:11.548815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075683+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075683+0000","last_peered":"2024-05-10T14:07:12.075683+0000","last_clean":"2024-05-10T14:07:12.075683+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075683+0000","last_undegraded":"2024-05-10T14:07:12.075683+0000","last_fullsized":"2024-05-10T14:07:12.075683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548974+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:11.548974+0000","last_peered":"2024-05-10T14:07:11.548974+0000","last_clean":"2024-05-10T14:07:11.548974+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:11.548974+0000","last_undegraded":"2024-05-10T14:07:11.548974+0000","last_fullsized":"2024-05-10T14:07:11.548974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073748+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073748+0000","last_peered":"2024-05-10T14:07:12.073748+0000","last_clean":"2024-05-10T14:07:12.073748+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073748+0000","last_undegraded":"2024-05-10T14:07:12.073748+0000","last_fullsized":"2024-05-10T14:07:12.073748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551825+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551825+0000","last_peered":"2024-05-10T14:07:11.551825+0000","last_clean":"2024-05-10T14:07:11.551825+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551825+0000","last_undegraded":"2024-05-10T14:07:11.551825+0000","last_fullsized":"2024-05-10T14:07:11.551825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074123+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074123+0000","last_peered":"2024-05-10T14:07:12.074123+0000","last_clean":"2024-05-10T14:07:12.074123+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074123+0000","last_undegraded":"2024-05-10T14:07:12.074123+0000","last_fullsized":"2024-05-10T14:07:12.074123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554033+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554033+0000","last_peered":"2024-05-10T14:07:11.554033+0000","last_clean":"2024-05-10T14:07:11.554033+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554033+0000","last_undegraded":"2024-05-10T14:07:11.554033+0000","last_fullsized":"2024-05-10T14:07:11.554033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:10:20.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550568+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550568+0000","last_peered":"2024-05-10T14:07:11.550568+0000","last_clean":"2024-05-10T14:07:11.550568+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550568+0000","last_undegraded":"2024-05-10T14:07:11.550568+0000","last_fullsized":"2024-05-10T14:07:11.550568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:27.784903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548734+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548734+0000","last_peered":"2024-05-10T14:07:11.548734+0000","last_clean":"2024-05-10T14:07:11.548734+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548734+0000","last_undegraded":"2024-05-10T14:07:11.548734+0000","last_fullsized":"2024-05-10T14:07:11.548734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554459+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554459+0000","last_peered":"2024-05-10T14:07:11.554459+0000","last_clean":"2024-05-10T14:07:11.554459+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554459+0000","last_undegraded":"2024-05-10T14:07:11.554459+0000","last_fullsized":"2024-05-10T14:07:11.554459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075630+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.075630+0000","last_peered":"2024-05-10T14:07:12.075630+0000","last_clean":"2024-05-10T14:07:12.075630+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.075630+0000","last_undegraded":"2024-05-10T14:07:12.075630+0000","last_fullsized":"2024-05-10T14:07:12.075630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549103+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549103+0000","last_peered":"2024-05-10T14:07:11.549103+0000","last_clean":"2024-05-10T14:07:11.549103+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549103+0000","last_undegraded":"2024-05-10T14:07:11.549103+0000","last_fullsized":"2024-05-10T14:07:11.549103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555318+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555318+0000","last_peered":"2024-05-10T14:07:11.555318+0000","last_clean":"2024-05-10T14:07:11.555318+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555318+0000","last_undegraded":"2024-05-10T14:07:11.555318+0000","last_fullsized":"2024-05-10T14:07:11.555318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":229,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552097+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552097+0000","last_peered":"2024-05-10T14:07:11.552097+0000","last_clean":"2024-05-10T14:07:11.552097+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552097+0000","last_undegraded":"2024-05-10T14:07:11.552097+0000","last_fullsized":"2024-05-10T14:07:11.552097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:17.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074350+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074350+0000","last_peered":"2024-05-10T14:07:12.074350+0000","last_clean":"2024-05-10T14:07:12.074350+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074350+0000","last_undegraded":"2024-05-10T14:07:12.074350+0000","last_fullsized":"2024-05-10T14:07:12.074350+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:17.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073526+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073526+0000","last_peered":"2024-05-10T14:07:12.073526+0000","last_clean":"2024-05-10T14:07:12.073526+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073526+0000","last_undegraded":"2024-05-10T14:07:12.073526+0000","last_fullsized":"2024-05-10T14:07:12.073526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548647+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548647+0000","last_peered":"2024-05-10T14:07:11.548647+0000","last_clean":"2024-05-10T14:07:11.548647+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548647+0000","last_undegraded":"2024-05-10T14:07:11.548647+0000","last_fullsized":"2024-05-10T14:07:11.548647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556094+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:11.556094+0000","last_peered":"2024-05-10T14:07:11.556094+0000","last_clean":"2024-05-10T14:07:11.556094+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:11.556094+0000","last_undegraded":"2024-05-10T14:07:11.556094+0000","last_fullsized":"2024-05-10T14:07:11.556094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075494+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:12.075494+0000","last_peered":"2024-05-10T14:07:12.075494+0000","last_clean":"2024-05-10T14:07:12.075494+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:12.075494+0000","last_undegraded":"2024-05-10T14:07:12.075494+0000","last_fullsized":"2024-05-10T14:07:12.075494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39712,"kb_used_data":8532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332128,"statfs":{"total":96636764160,"available":96596099072,"internally_reserved":0,"allocated":8736768,"data_stored":7959958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710760,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":5868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":6008832,"data_stored":5271863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41252,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39176,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332664,"statfs":{"total":96636764160,"available":96596647936,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2433024,"data_stored":1668141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:16.674 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T14:07:16.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-10T14:07:17.031 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-10T14:07:17.045 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-10T14:07:17.045 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:07:17.046 INFO:tasks.rgw.client.0:Stopped 2024-05-10T14:07:17.046 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-10T14:07:17.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/vault-root-token 2024-05-10T14:07:17.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-10T14:07:17.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-10T14:07:17.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-10T14:07:17.162 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-10T14:07:17.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T14:07:17.717 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T14:07:17.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:18.081 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:18.087 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:18.103 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-05-10T14:07:16.217760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302680,"kb_used_data":36068,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672040,"statfs":{"total":773094113280,"available":772784168960,"internally_reserved":0,"allocated":36933632,"data_stored":30814595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701241"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074058+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074058+0000","last_peered":"2024-05-10T14:07:12.074058+0000","last_clean":"2024-05-10T14:07:12.074058+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074058+0000","last_undegraded":"2024-05-10T14:07:12.074058+0000","last_fullsized":"2024-05-10T14:07:12.074058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548272+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548272+0000","last_peered":"2024-05-10T14:07:11.548272+0000","last_clean":"2024-05-10T14:07:11.548272+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548272+0000","last_undegraded":"2024-05-10T14:07:11.548272+0000","last_fullsized":"2024-05-10T14:07:11.548272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555985+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.555985+0000","last_peered":"2024-05-10T14:07:11.555985+0000","last_clean":"2024-05-10T14:07:11.555985+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.555985+0000","last_undegraded":"2024-05-10T14:07:11.555985+0000","last_fullsized":"2024-05-10T14:07:11.555985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081409+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081409+0000","last_peered":"2024-05-10T14:07:12.081409+0000","last_clean":"2024-05-10T14:07:12.081409+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081409+0000","last_undegraded":"2024-05-10T14:07:12.081409+0000","last_fullsized":"2024-05-10T14:07:12.081409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079824+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079824+0000","last_peered":"2024-05-10T14:07:12.079824+0000","last_clean":"2024-05-10T14:07:12.079824+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079824+0000","last_undegraded":"2024-05-10T14:07:12.079824+0000","last_fullsized":"2024-05-10T14:07:12.079824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554228+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:11.554228+0000","last_peered":"2024-05-10T14:07:11.554228+0000","last_clean":"2024-05-10T14:07:11.554228+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:11.554228+0000","last_undegraded":"2024-05-10T14:07:11.554228+0000","last_fullsized":"2024-05-10T14:07:11.554228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550475+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550475+0000","last_peered":"2024-05-10T14:07:11.550475+0000","last_clean":"2024-05-10T14:07:11.550475+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550475+0000","last_undegraded":"2024-05-10T14:07:11.550475+0000","last_fullsized":"2024-05-10T14:07:11.550475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555673+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:11.555673+0000","last_peered":"2024-05-10T14:07:11.555673+0000","last_clean":"2024-05-10T14:07:11.555673+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:11.555673+0000","last_undegraded":"2024-05-10T14:07:11.555673+0000","last_fullsized":"2024-05-10T14:07:11.555673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553359+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:11.553359+0000","last_peered":"2024-05-10T14:07:11.553359+0000","last_clean":"2024-05-10T14:07:11.553359+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:11.553359+0000","last_undegraded":"2024-05-10T14:07:11.553359+0000","last_fullsized":"2024-05-10T14:07:11.553359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549532+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549532+0000","last_peered":"2024-05-10T14:07:11.549532+0000","last_clean":"2024-05-10T14:07:11.549532+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549532+0000","last_undegraded":"2024-05-10T14:07:11.549532+0000","last_fullsized":"2024-05-10T14:07:11.549532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.073945+0000","last_peered":"2024-05-10T14:07:12.073945+0000","last_clean":"2024-05-10T14:07:12.073945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.073945+0000","last_undegraded":"2024-05-10T14:07:12.073945+0000","last_fullsized":"2024-05-10T14:07:12.073945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555009+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555009+0000","last_peered":"2024-05-10T14:07:11.555009+0000","last_clean":"2024-05-10T14:07:11.555009+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555009+0000","last_undegraded":"2024-05-10T14:07:11.555009+0000","last_fullsized":"2024-05-10T14:07:11.555009+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:12.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074427+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:12.074427+0000","last_peered":"2024-05-10T14:07:12.074427+0000","last_clean":"2024-05-10T14:07:12.074427+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:12.074427+0000","last_undegraded":"2024-05-10T14:07:12.074427+0000","last_fullsized":"2024-05-10T14:07:12.074427+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550092+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:11.550092+0000","last_peered":"2024-05-10T14:07:11.550092+0000","last_clean":"2024-05-10T14:07:11.550092+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:11.550092+0000","last_undegraded":"2024-05-10T14:07:11.550092+0000","last_fullsized":"2024-05-10T14:07:11.550092+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:52.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073622+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073622+0000","last_peered":"2024-05-10T14:07:12.073622+0000","last_clean":"2024-05-10T14:07:12.073622+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073622+0000","last_undegraded":"2024-05-10T14:07:12.073622+0000","last_fullsized":"2024-05-10T14:07:12.073622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075091+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:12.075091+0000","last_peered":"2024-05-10T14:07:12.075091+0000","last_clean":"2024-05-10T14:07:12.075091+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:12.075091+0000","last_undegraded":"2024-05-10T14:07:12.075091+0000","last_fullsized":"2024-05-10T14:07:12.075091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555017+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555017+0000","last_peered":"2024-05-10T14:07:11.555017+0000","last_clean":"2024-05-10T14:07:11.555017+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555017+0000","last_undegraded":"2024-05-10T14:07:11.555017+0000","last_fullsized":"2024-05-10T14:07:11.555017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555401+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:11.555401+0000","last_peered":"2024-05-10T14:07:11.555401+0000","last_clean":"2024-05-10T14:07:11.555401+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:11.555401+0000","last_undegraded":"2024-05-10T14:07:11.555401+0000","last_fullsized":"2024-05-10T14:07:11.555401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083134+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:12.083134+0000","last_peered":"2024-05-10T14:07:12.083134+0000","last_clean":"2024-05-10T14:07:12.083134+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:12.083134+0000","last_undegraded":"2024-05-10T14:07:12.083134+0000","last_fullsized":"2024-05-10T14:07:12.083134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554347+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:11.554347+0000","last_peered":"2024-05-10T14:07:11.554347+0000","last_clean":"2024-05-10T14:07:11.554347+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:11.554347+0000","last_undegraded":"2024-05-10T14:07:11.554347+0000","last_fullsized":"2024-05-10T14:07:11.554347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:47.045146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082687+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:12.082687+0000","last_peered":"2024-05-10T14:07:12.082687+0000","last_clean":"2024-05-10T14:07:12.082687+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:12.082687+0000","last_undegraded":"2024-05-10T14:07:12.082687+0000","last_fullsized":"2024-05-10T14:07:12.082687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549354+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:11.549354+0000","last_peered":"2024-05-10T14:07:11.549354+0000","last_clean":"2024-05-10T14:07:11.549354+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:11.549354+0000","last_undegraded":"2024-05-10T14:07:11.549354+0000","last_fullsized":"2024-05-10T14:07:11.549354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075462+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:12.075462+0000","last_peered":"2024-05-10T14:07:12.075462+0000","last_clean":"2024-05-10T14:07:12.075462+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:12.075462+0000","last_undegraded":"2024-05-10T14:07:12.075462+0000","last_fullsized":"2024-05-10T14:07:12.075462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550653+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550653+0000","last_peered":"2024-05-10T14:07:11.550653+0000","last_clean":"2024-05-10T14:07:11.550653+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550653+0000","last_undegraded":"2024-05-10T14:07:11.550653+0000","last_fullsized":"2024-05-10T14:07:11.550653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":301,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554321+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:11.554321+0000","last_peered":"2024-05-10T14:07:11.554321+0000","last_clean":"2024-05-10T14:07:11.554321+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:11.554321+0000","last_undegraded":"2024-05-10T14:07:11.554321+0000","last_fullsized":"2024-05-10T14:07:11.554321+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:10.732947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548392+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548392+0000","last_peered":"2024-05-10T14:07:11.548392+0000","last_clean":"2024-05-10T14:07:11.548392+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548392+0000","last_undegraded":"2024-05-10T14:07:11.548392+0000","last_fullsized":"2024-05-10T14:07:11.548392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554759+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554759+0000","last_peered":"2024-05-10T14:07:11.554759+0000","last_clean":"2024-05-10T14:07:11.554759+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554759+0000","last_undegraded":"2024-05-10T14:07:11.554759+0000","last_fullsized":"2024-05-10T14:07:11.554759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076842+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:12.076842+0000","last_peered":"2024-05-10T14:07:12.076842+0000","last_clean":"2024-05-10T14:07:12.076842+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:12.076842+0000","last_undegraded":"2024-05-10T14:07:12.076842+0000","last_fullsized":"2024-05-10T14:07:12.076842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072614+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:12.072614+0000","last_peered":"2024-05-10T14:07:12.072614+0000","last_clean":"2024-05-10T14:07:12.072614+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:12.072614+0000","last_undegraded":"2024-05-10T14:07:12.072614+0000","last_fullsized":"2024-05-10T14:07:12.072614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074531+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074531+0000","last_peered":"2024-05-10T14:07:12.074531+0000","last_clean":"2024-05-10T14:07:12.074531+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074531+0000","last_undegraded":"2024-05-10T14:07:12.074531+0000","last_fullsized":"2024-05-10T14:07:12.074531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074815+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074815+0000","last_peered":"2024-05-10T14:07:12.074815+0000","last_clean":"2024-05-10T14:07:12.074815+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074815+0000","last_undegraded":"2024-05-10T14:07:12.074815+0000","last_fullsized":"2024-05-10T14:07:12.074815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552380+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552380+0000","last_peered":"2024-05-10T14:07:11.552380+0000","last_clean":"2024-05-10T14:07:11.552380+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552380+0000","last_undegraded":"2024-05-10T14:07:11.552380+0000","last_fullsized":"2024-05-10T14:07:11.552380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072973+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:12.072973+0000","last_peered":"2024-05-10T14:07:12.072973+0000","last_clean":"2024-05-10T14:07:12.072973+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:12.072973+0000","last_undegraded":"2024-05-10T14:07:12.072973+0000","last_fullsized":"2024-05-10T14:07:12.072973+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550200+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550200+0000","last_peered":"2024-05-10T14:07:11.550200+0000","last_clean":"2024-05-10T14:07:11.550200+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550200+0000","last_undegraded":"2024-05-10T14:07:11.550200+0000","last_fullsized":"2024-05-10T14:07:11.550200+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:47.337132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552750+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552750+0000","last_peered":"2024-05-10T14:07:11.552750+0000","last_clean":"2024-05-10T14:07:11.552750+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552750+0000","last_undegraded":"2024-05-10T14:07:11.552750+0000","last_fullsized":"2024-05-10T14:07:11.552750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554785+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554785+0000","last_peered":"2024-05-10T14:07:11.554785+0000","last_clean":"2024-05-10T14:07:11.554785+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554785+0000","last_undegraded":"2024-05-10T14:07:11.554785+0000","last_fullsized":"2024-05-10T14:07:11.554785+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.963586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550032+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:11.550032+0000","last_peered":"2024-05-10T14:07:11.550032+0000","last_clean":"2024-05-10T14:07:11.550032+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:11.550032+0000","last_undegraded":"2024-05-10T14:07:11.550032+0000","last_fullsized":"2024-05-10T14:07:11.550032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075442+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.075442+0000","last_peered":"2024-05-10T14:07:12.075442+0000","last_clean":"2024-05-10T14:07:12.075442+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.075442+0000","last_undegraded":"2024-05-10T14:07:12.075442+0000","last_fullsized":"2024-05-10T14:07:12.075442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549388+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549388+0000","last_peered":"2024-05-10T14:07:11.549388+0000","last_clean":"2024-05-10T14:07:11.549388+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549388+0000","last_undegraded":"2024-05-10T14:07:11.549388+0000","last_fullsized":"2024-05-10T14:07:11.549388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555844+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:07:11.555844+0000","last_peered":"2024-05-10T14:07:11.555844+0000","last_clean":"2024-05-10T14:07:11.555844+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:11.555844+0000","last_undegraded":"2024-05-10T14:07:11.555844+0000","last_fullsized":"2024-05-10T14:07:11.555844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":296,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555085+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:11.555085+0000","last_peered":"2024-05-10T14:07:11.555085+0000","last_clean":"2024-05-10T14:07:11.555085+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:11.555085+0000","last_undegraded":"2024-05-10T14:07:11.555085+0000","last_fullsized":"2024-05-10T14:07:11.555085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":203,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080999+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:12.080999+0000","last_peered":"2024-05-10T14:07:12.080999+0000","last_clean":"2024-05-10T14:07:12.080999+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:12.080999+0000","last_undegraded":"2024-05-10T14:07:12.080999+0000","last_fullsized":"2024-05-10T14:07:12.080999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549647+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549647+0000","last_peered":"2024-05-10T14:07:11.549647+0000","last_clean":"2024-05-10T14:07:11.549647+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549647+0000","last_undegraded":"2024-05-10T14:07:11.549647+0000","last_fullsized":"2024-05-10T14:07:11.549647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078973+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:12.078973+0000","last_peered":"2024-05-10T14:07:12.078973+0000","last_clean":"2024-05-10T14:07:12.078973+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:12.078973+0000","last_undegraded":"2024-05-10T14:07:12.078973+0000","last_fullsized":"2024-05-10T14:07:12.078973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":217,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077168+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:12.077168+0000","last_peered":"2024-05-10T14:07:12.077168+0000","last_clean":"2024-05-10T14:07:12.077168+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:12.077168+0000","last_undegraded":"2024-05-10T14:07:12.077168+0000","last_fullsized":"2024-05-10T14:07:12.077168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549496+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549496+0000","last_peered":"2024-05-10T14:07:11.549496+0000","last_clean":"2024-05-10T14:07:11.549496+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549496+0000","last_undegraded":"2024-05-10T14:07:11.549496+0000","last_fullsized":"2024-05-10T14:07:11.549496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":218,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080066+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:12.080066+0000","last_peered":"2024-05-10T14:07:12.080066+0000","last_clean":"2024-05-10T14:07:12.080066+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:12.080066+0000","last_undegraded":"2024-05-10T14:07:12.080066+0000","last_fullsized":"2024-05-10T14:07:12.080066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074628+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074628+0000","last_peered":"2024-05-10T14:07:12.074628+0000","last_clean":"2024-05-10T14:07:12.074628+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074628+0000","last_undegraded":"2024-05-10T14:07:12.074628+0000","last_fullsized":"2024-05-10T14:07:12.074628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.724292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074954+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074954+0000","last_peered":"2024-05-10T14:07:12.074954+0000","last_clean":"2024-05-10T14:07:12.074954+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074954+0000","last_undegraded":"2024-05-10T14:07:12.074954+0000","last_fullsized":"2024-05-10T14:07:12.074954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073072+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073072+0000","last_peered":"2024-05-10T14:07:12.073072+0000","last_clean":"2024-05-10T14:07:12.073072+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073072+0000","last_undegraded":"2024-05-10T14:07:12.073072+0000","last_fullsized":"2024-05-10T14:07:12.073072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":337,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073234+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:12.073234+0000","last_peered":"2024-05-10T14:07:12.073234+0000","last_clean":"2024-05-10T14:07:12.073234+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:12.073234+0000","last_undegraded":"2024-05-10T14:07:12.073234+0000","last_fullsized":"2024-05-10T14:07:12.073234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552257+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552257+0000","last_peered":"2024-05-10T14:07:11.552257+0000","last_clean":"2024-05-10T14:07:11.552257+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552257+0000","last_undegraded":"2024-05-10T14:07:11.552257+0000","last_fullsized":"2024-05-10T14:07:11.552257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555371+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555371+0000","last_peered":"2024-05-10T14:07:11.555371+0000","last_clean":"2024-05-10T14:07:11.555371+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555371+0000","last_undegraded":"2024-05-10T14:07:11.555371+0000","last_fullsized":"2024-05-10T14:07:11.555371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553894+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:11.553894+0000","last_peered":"2024-05-10T14:07:11.553894+0000","last_clean":"2024-05-10T14:07:11.553894+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:11.553894+0000","last_undegraded":"2024-05-10T14:07:11.553894+0000","last_fullsized":"2024-05-10T14:07:11.553894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073844+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073844+0000","last_peered":"2024-05-10T14:07:12.073844+0000","last_clean":"2024-05-10T14:07:12.073844+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073844+0000","last_undegraded":"2024-05-10T14:07:12.073844+0000","last_fullsized":"2024-05-10T14:07:12.073844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551597+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551597+0000","last_peered":"2024-05-10T14:07:11.551597+0000","last_clean":"2024-05-10T14:07:11.551597+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551597+0000","last_undegraded":"2024-05-10T14:07:11.551597+0000","last_fullsized":"2024-05-10T14:07:11.551597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554491+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:11.554491+0000","last_peered":"2024-05-10T14:07:11.554491+0000","last_clean":"2024-05-10T14:07:11.554491+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:11.554491+0000","last_undegraded":"2024-05-10T14:07:11.554491+0000","last_fullsized":"2024-05-10T14:07:11.554491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074222+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:12.074222+0000","last_peered":"2024-05-10T14:07:12.074222+0000","last_clean":"2024-05-10T14:07:12.074222+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:12.074222+0000","last_undegraded":"2024-05-10T14:07:12.074222+0000","last_fullsized":"2024-05-10T14:07:12.074222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072664+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:12.072664+0000","last_peered":"2024-05-10T14:07:12.072664+0000","last_clean":"2024-05-10T14:07:12.072664+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:12.072664+0000","last_undegraded":"2024-05-10T14:07:12.072664+0000","last_fullsized":"2024-05-10T14:07:12.072664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074302+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.074302+0000","last_peered":"2024-05-10T14:07:12.074302+0000","last_clean":"2024-05-10T14:07:12.074302+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.074302+0000","last_undegraded":"2024-05-10T14:07:12.074302+0000","last_fullsized":"2024-05-10T14:07:12.074302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074708+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074708+0000","last_peered":"2024-05-10T14:07:12.074708+0000","last_clean":"2024-05-10T14:07:12.074708+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074708+0000","last_undegraded":"2024-05-10T14:07:12.074708+0000","last_fullsized":"2024-05-10T14:07:12.074708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":194,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074718+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:12.074718+0000","last_peered":"2024-05-10T14:07:12.074718+0000","last_clean":"2024-05-10T14:07:12.074718+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:12.074718+0000","last_undegraded":"2024-05-10T14:07:12.074718+0000","last_fullsized":"2024-05-10T14:07:12.074718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554724+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:11.554724+0000","last_peered":"2024-05-10T14:07:11.554724+0000","last_clean":"2024-05-10T14:07:11.554724+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:11.554724+0000","last_undegraded":"2024-05-10T14:07:11.554724+0000","last_fullsized":"2024-05-10T14:07:11.554724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548842+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548842+0000","last_peered":"2024-05-10T14:07:11.548842+0000","last_clean":"2024-05-10T14:07:11.548842+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548842+0000","last_undegraded":"2024-05-10T14:07:11.548842+0000","last_fullsized":"2024-05-10T14:07:11.548842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:58.484385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554074+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554074+0000","last_peered":"2024-05-10T14:07:11.554074+0000","last_clean":"2024-05-10T14:07:11.554074+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554074+0000","last_undegraded":"2024-05-10T14:07:11.554074+0000","last_fullsized":"2024-05-10T14:07:11.554074+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.552986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554801+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:11.554801+0000","last_peered":"2024-05-10T14:07:11.554801+0000","last_clean":"2024-05-10T14:07:11.554801+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:11.554801+0000","last_undegraded":"2024-05-10T14:07:11.554801+0000","last_fullsized":"2024-05-10T14:07:11.554801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074182+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.074182+0000","last_peered":"2024-05-10T14:07:12.074182+0000","last_clean":"2024-05-10T14:07:12.074182+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.074182+0000","last_undegraded":"2024-05-10T14:07:12.074182+0000","last_fullsized":"2024-05-10T14:07:12.074182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075156+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075156+0000","last_peered":"2024-05-10T14:07:12.075156+0000","last_clean":"2024-05-10T14:07:12.075156+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075156+0000","last_undegraded":"2024-05-10T14:07:12.075156+0000","last_fullsized":"2024-05-10T14:07:12.075156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548961+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.548961+0000","last_peered":"2024-05-10T14:07:11.548961+0000","last_clean":"2024-05-10T14:07:11.548961+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.548961+0000","last_undegraded":"2024-05-10T14:07:11.548961+0000","last_fullsized":"2024-05-10T14:07:11.548961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080460+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:12.080460+0000","last_peered":"2024-05-10T14:07:12.080460+0000","last_clean":"2024-05-10T14:07:12.080460+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:12.080460+0000","last_undegraded":"2024-05-10T14:07:12.080460+0000","last_fullsized":"2024-05-10T14:07:12.080460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548696+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548696+0000","last_peered":"2024-05-10T14:07:11.548696+0000","last_clean":"2024-05-10T14:07:11.548696+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548696+0000","last_undegraded":"2024-05-10T14:07:11.548696+0000","last_fullsized":"2024-05-10T14:07:11.548696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075247+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:07:12.075247+0000","last_peered":"2024-05-10T14:07:12.075247+0000","last_clean":"2024-05-10T14:07:12.075247+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:12.075247+0000","last_undegraded":"2024-05-10T14:07:12.075247+0000","last_fullsized":"2024-05-10T14:07:12.075247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548172+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:11.548172+0000","last_peered":"2024-05-10T14:07:11.548172+0000","last_clean":"2024-05-10T14:07:11.548172+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:11.548172+0000","last_undegraded":"2024-05-10T14:07:11.548172+0000","last_fullsized":"2024-05-10T14:07:11.548172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549295+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:11.549295+0000","last_peered":"2024-05-10T14:07:11.549295+0000","last_clean":"2024-05-10T14:07:11.549295+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:11.549295+0000","last_undegraded":"2024-05-10T14:07:11.549295+0000","last_fullsized":"2024-05-10T14:07:11.549295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551032+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551032+0000","last_peered":"2024-05-10T14:07:11.551032+0000","last_clean":"2024-05-10T14:07:11.551032+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551032+0000","last_undegraded":"2024-05-10T14:07:11.551032+0000","last_fullsized":"2024-05-10T14:07:11.551032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:59.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553487+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:11.553487+0000","last_peered":"2024-05-10T14:07:11.553487+0000","last_clean":"2024-05-10T14:07:11.553487+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:11.553487+0000","last_undegraded":"2024-05-10T14:07:11.553487+0000","last_fullsized":"2024-05-10T14:07:11.553487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072820+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:12.072820+0000","last_peered":"2024-05-10T14:07:12.072820+0000","last_clean":"2024-05-10T14:07:12.072820+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:12.072820+0000","last_undegraded":"2024-05-10T14:07:12.072820+0000","last_fullsized":"2024-05-10T14:07:12.072820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073737+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073737+0000","last_peered":"2024-05-10T14:07:12.073737+0000","last_clean":"2024-05-10T14:07:12.073737+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073737+0000","last_undegraded":"2024-05-10T14:07:12.073737+0000","last_fullsized":"2024-05-10T14:07:12.073737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:01.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553105+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:11.553105+0000","last_peered":"2024-05-10T14:07:11.553105+0000","last_clean":"2024-05-10T14:07:11.553105+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:11.553105+0000","last_undegraded":"2024-05-10T14:07:11.553105+0000","last_fullsized":"2024-05-10T14:07:11.553105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077794+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077794+0000","last_peered":"2024-05-10T14:07:12.077794+0000","last_clean":"2024-05-10T14:07:12.077794+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077794+0000","last_undegraded":"2024-05-10T14:07:12.077794+0000","last_fullsized":"2024-05-10T14:07:12.077794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548579+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:11.548579+0000","last_peered":"2024-05-10T14:07:11.548579+0000","last_clean":"2024-05-10T14:07:11.548579+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:11.548579+0000","last_undegraded":"2024-05-10T14:07:11.548579+0000","last_fullsized":"2024-05-10T14:07:11.548579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075775+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:07:12.075775+0000","last_peered":"2024-05-10T14:07:12.075775+0000","last_clean":"2024-05-10T14:07:12.075775+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:12.075775+0000","last_undegraded":"2024-05-10T14:07:12.075775+0000","last_fullsized":"2024-05-10T14:07:12.075775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077486+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077486+0000","last_peered":"2024-05-10T14:07:12.077486+0000","last_clean":"2024-05-10T14:07:12.077486+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077486+0000","last_undegraded":"2024-05-10T14:07:12.077486+0000","last_fullsized":"2024-05-10T14:07:12.077486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079988+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:12.079988+0000","last_peered":"2024-05-10T14:07:12.079988+0000","last_clean":"2024-05-10T14:07:12.079988+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:12.079988+0000","last_undegraded":"2024-05-10T14:07:12.079988+0000","last_fullsized":"2024-05-10T14:07:12.079988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073822+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:12.073822+0000","last_peered":"2024-05-10T14:07:12.073822+0000","last_clean":"2024-05-10T14:07:12.073822+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:12.073822+0000","last_undegraded":"2024-05-10T14:07:12.073822+0000","last_fullsized":"2024-05-10T14:07:12.073822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:16.077857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074716+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074716+0000","last_peered":"2024-05-10T14:07:12.074716+0000","last_clean":"2024-05-10T14:07:12.074716+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074716+0000","last_undegraded":"2024-05-10T14:07:12.074716+0000","last_fullsized":"2024-05-10T14:07:12.074716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:08.580401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074052+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:12.074052+0000","last_peered":"2024-05-10T14:07:12.074052+0000","last_clean":"2024-05-10T14:07:12.074052+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:12.074052+0000","last_undegraded":"2024-05-10T14:07:12.074052+0000","last_fullsized":"2024-05-10T14:07:12.074052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552492+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:11.552492+0000","last_peered":"2024-05-10T14:07:11.552492+0000","last_clean":"2024-05-10T14:07:11.552492+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:11.552492+0000","last_undegraded":"2024-05-10T14:07:11.552492+0000","last_fullsized":"2024-05-10T14:07:11.552492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074867+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074867+0000","last_peered":"2024-05-10T14:07:12.074867+0000","last_clean":"2024-05-10T14:07:12.074867+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074867+0000","last_undegraded":"2024-05-10T14:07:12.074867+0000","last_fullsized":"2024-05-10T14:07:12.074867+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:45.875457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073037+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073037+0000","last_peered":"2024-05-10T14:07:12.073037+0000","last_clean":"2024-05-10T14:07:12.073037+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073037+0000","last_undegraded":"2024-05-10T14:07:12.073037+0000","last_fullsized":"2024-05-10T14:07:12.073037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082680+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:12.082680+0000","last_peered":"2024-05-10T14:07:12.082680+0000","last_clean":"2024-05-10T14:07:12.082680+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:12.082680+0000","last_undegraded":"2024-05-10T14:07:12.082680+0000","last_fullsized":"2024-05-10T14:07:12.082680+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077404+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077404+0000","last_peered":"2024-05-10T14:07:12.077404+0000","last_clean":"2024-05-10T14:07:12.077404+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077404+0000","last_undegraded":"2024-05-10T14:07:12.077404+0000","last_fullsized":"2024-05-10T14:07:12.077404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550664+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550664+0000","last_peered":"2024-05-10T14:07:11.550664+0000","last_clean":"2024-05-10T14:07:11.550664+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550664+0000","last_undegraded":"2024-05-10T14:07:11.550664+0000","last_fullsized":"2024-05-10T14:07:11.550664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551820+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551820+0000","last_peered":"2024-05-10T14:07:11.551820+0000","last_clean":"2024-05-10T14:07:11.551820+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551820+0000","last_undegraded":"2024-05-10T14:07:11.551820+0000","last_fullsized":"2024-05-10T14:07:11.551820+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:23.429115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554939+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:11.554939+0000","last_peered":"2024-05-10T14:07:11.554939+0000","last_clean":"2024-05-10T14:07:11.554939+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:11.554939+0000","last_undegraded":"2024-05-10T14:07:11.554939+0000","last_fullsized":"2024-05-10T14:07:11.554939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556160+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556160+0000","last_peered":"2024-05-10T14:07:11.556160+0000","last_clean":"2024-05-10T14:07:11.556160+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556160+0000","last_undegraded":"2024-05-10T14:07:11.556160+0000","last_fullsized":"2024-05-10T14:07:11.556160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073897+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073897+0000","last_peered":"2024-05-10T14:07:12.073897+0000","last_clean":"2024-05-10T14:07:12.073897+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073897+0000","last_undegraded":"2024-05-10T14:07:12.073897+0000","last_fullsized":"2024-05-10T14:07:12.073897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081383+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:12.081383+0000","last_peered":"2024-05-10T14:07:12.081383+0000","last_clean":"2024-05-10T14:07:12.081383+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:12.081383+0000","last_undegraded":"2024-05-10T14:07:12.081383+0000","last_fullsized":"2024-05-10T14:07:12.081383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":214,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074906+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:12.074906+0000","last_peered":"2024-05-10T14:07:12.074906+0000","last_clean":"2024-05-10T14:07:12.074906+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:12.074906+0000","last_undegraded":"2024-05-10T14:07:12.074906+0000","last_fullsized":"2024-05-10T14:07:12.074906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073264+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073264+0000","last_peered":"2024-05-10T14:07:12.073264+0000","last_clean":"2024-05-10T14:07:12.073264+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073264+0000","last_undegraded":"2024-05-10T14:07:12.073264+0000","last_fullsized":"2024-05-10T14:07:12.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073160+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:12.073160+0000","last_peered":"2024-05-10T14:07:12.073160+0000","last_clean":"2024-05-10T14:07:12.073160+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:12.073160+0000","last_undegraded":"2024-05-10T14:07:12.073160+0000","last_fullsized":"2024-05-10T14:07:12.073160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551248+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551248+0000","last_peered":"2024-05-10T14:07:11.551248+0000","last_clean":"2024-05-10T14:07:11.551248+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551248+0000","last_undegraded":"2024-05-10T14:07:11.551248+0000","last_fullsized":"2024-05-10T14:07:11.551248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548996+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:11.548996+0000","last_peered":"2024-05-10T14:07:11.548996+0000","last_clean":"2024-05-10T14:07:11.548996+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:11.548996+0000","last_undegraded":"2024-05-10T14:07:11.548996+0000","last_fullsized":"2024-05-10T14:07:11.548996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552102+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552102+0000","last_peered":"2024-05-10T14:07:11.552102+0000","last_clean":"2024-05-10T14:07:11.552102+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552102+0000","last_undegraded":"2024-05-10T14:07:11.552102+0000","last_fullsized":"2024-05-10T14:07:11.552102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554640+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:11.554640+0000","last_peered":"2024-05-10T14:07:11.554640+0000","last_clean":"2024-05-10T14:07:11.554640+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:11.554640+0000","last_undegraded":"2024-05-10T14:07:11.554640+0000","last_fullsized":"2024-05-10T14:07:11.554640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.339148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548815+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548815+0000","last_peered":"2024-05-10T14:07:11.548815+0000","last_clean":"2024-05-10T14:07:11.548815+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548815+0000","last_undegraded":"2024-05-10T14:07:11.548815+0000","last_fullsized":"2024-05-10T14:07:11.548815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075683+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075683+0000","last_peered":"2024-05-10T14:07:12.075683+0000","last_clean":"2024-05-10T14:07:12.075683+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075683+0000","last_undegraded":"2024-05-10T14:07:12.075683+0000","last_fullsized":"2024-05-10T14:07:12.075683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548974+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:11.548974+0000","last_peered":"2024-05-10T14:07:11.548974+0000","last_clean":"2024-05-10T14:07:11.548974+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:11.548974+0000","last_undegraded":"2024-05-10T14:07:11.548974+0000","last_fullsized":"2024-05-10T14:07:11.548974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073748+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073748+0000","last_peered":"2024-05-10T14:07:12.073748+0000","last_clean":"2024-05-10T14:07:12.073748+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073748+0000","last_undegraded":"2024-05-10T14:07:12.073748+0000","last_fullsized":"2024-05-10T14:07:12.073748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551825+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551825+0000","last_peered":"2024-05-10T14:07:11.551825+0000","last_clean":"2024-05-10T14:07:11.551825+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551825+0000","last_undegraded":"2024-05-10T14:07:11.551825+0000","last_fullsized":"2024-05-10T14:07:11.551825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074123+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074123+0000","last_peered":"2024-05-10T14:07:12.074123+0000","last_clean":"2024-05-10T14:07:12.074123+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074123+0000","last_undegraded":"2024-05-10T14:07:12.074123+0000","last_fullsized":"2024-05-10T14:07:12.074123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554033+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554033+0000","last_peered":"2024-05-10T14:07:11.554033+0000","last_clean":"2024-05-10T14:07:11.554033+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554033+0000","last_undegraded":"2024-05-10T14:07:11.554033+0000","last_fullsized":"2024-05-10T14:07:11.554033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:10:20.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550568+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550568+0000","last_peered":"2024-05-10T14:07:11.550568+0000","last_clean":"2024-05-10T14:07:11.550568+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550568+0000","last_undegraded":"2024-05-10T14:07:11.550568+0000","last_fullsized":"2024-05-10T14:07:11.550568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:27.784903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548734+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548734+0000","last_peered":"2024-05-10T14:07:11.548734+0000","last_clean":"2024-05-10T14:07:11.548734+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548734+0000","last_undegraded":"2024-05-10T14:07:11.548734+0000","last_fullsized":"2024-05-10T14:07:11.548734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554459+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554459+0000","last_peered":"2024-05-10T14:07:11.554459+0000","last_clean":"2024-05-10T14:07:11.554459+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554459+0000","last_undegraded":"2024-05-10T14:07:11.554459+0000","last_fullsized":"2024-05-10T14:07:11.554459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075630+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.075630+0000","last_peered":"2024-05-10T14:07:12.075630+0000","last_clean":"2024-05-10T14:07:12.075630+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.075630+0000","last_undegraded":"2024-05-10T14:07:12.075630+0000","last_fullsized":"2024-05-10T14:07:12.075630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549103+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549103+0000","last_peered":"2024-05-10T14:07:11.549103+0000","last_clean":"2024-05-10T14:07:11.549103+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549103+0000","last_undegraded":"2024-05-10T14:07:11.549103+0000","last_fullsized":"2024-05-10T14:07:11.549103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555318+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555318+0000","last_peered":"2024-05-10T14:07:11.555318+0000","last_clean":"2024-05-10T14:07:11.555318+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555318+0000","last_undegraded":"2024-05-10T14:07:11.555318+0000","last_fullsized":"2024-05-10T14:07:11.555318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":229,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552097+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552097+0000","last_peered":"2024-05-10T14:07:11.552097+0000","last_clean":"2024-05-10T14:07:11.552097+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552097+0000","last_undegraded":"2024-05-10T14:07:11.552097+0000","last_fullsized":"2024-05-10T14:07:11.552097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:17.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074350+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074350+0000","last_peered":"2024-05-10T14:07:12.074350+0000","last_clean":"2024-05-10T14:07:12.074350+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074350+0000","last_undegraded":"2024-05-10T14:07:12.074350+0000","last_fullsized":"2024-05-10T14:07:12.074350+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:17.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073526+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073526+0000","last_peered":"2024-05-10T14:07:12.073526+0000","last_clean":"2024-05-10T14:07:12.073526+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073526+0000","last_undegraded":"2024-05-10T14:07:12.073526+0000","last_fullsized":"2024-05-10T14:07:12.073526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548647+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548647+0000","last_peered":"2024-05-10T14:07:11.548647+0000","last_clean":"2024-05-10T14:07:11.548647+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548647+0000","last_undegraded":"2024-05-10T14:07:11.548647+0000","last_fullsized":"2024-05-10T14:07:11.548647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556094+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:11.556094+0000","last_peered":"2024-05-10T14:07:11.556094+0000","last_clean":"2024-05-10T14:07:11.556094+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:11.556094+0000","last_undegraded":"2024-05-10T14:07:11.556094+0000","last_fullsized":"2024-05-10T14:07:11.556094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075494+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:12.075494+0000","last_peered":"2024-05-10T14:07:12.075494+0000","last_clean":"2024-05-10T14:07:12.075494+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:12.075494+0000","last_undegraded":"2024-05-10T14:07:12.075494+0000","last_fullsized":"2024-05-10T14:07:12.075494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39712,"kb_used_data":8532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332128,"statfs":{"total":96636764160,"available":96596099072,"internally_reserved":0,"allocated":8736768,"data_stored":7959958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710760,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":5868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":6008832,"data_stored":5271863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41252,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39176,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332664,"statfs":{"total":96636764160,"available":96596647936,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2433024,"data_stored":1668141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:18.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:18.490 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-05-10T14:07:18.218608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302728,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754671992,"statfs":{"total":773094113280,"available":772784119808,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003448"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074058+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074058+0000","last_peered":"2024-05-10T14:07:12.074058+0000","last_clean":"2024-05-10T14:07:12.074058+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074058+0000","last_undegraded":"2024-05-10T14:07:12.074058+0000","last_fullsized":"2024-05-10T14:07:12.074058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548272+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548272+0000","last_peered":"2024-05-10T14:07:11.548272+0000","last_clean":"2024-05-10T14:07:11.548272+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548272+0000","last_undegraded":"2024-05-10T14:07:11.548272+0000","last_fullsized":"2024-05-10T14:07:11.548272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555985+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.555985+0000","last_peered":"2024-05-10T14:07:11.555985+0000","last_clean":"2024-05-10T14:07:11.555985+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.555985+0000","last_undegraded":"2024-05-10T14:07:11.555985+0000","last_fullsized":"2024-05-10T14:07:11.555985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081409+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081409+0000","last_peered":"2024-05-10T14:07:12.081409+0000","last_clean":"2024-05-10T14:07:12.081409+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081409+0000","last_undegraded":"2024-05-10T14:07:12.081409+0000","last_fullsized":"2024-05-10T14:07:12.081409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079824+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079824+0000","last_peered":"2024-05-10T14:07:12.079824+0000","last_clean":"2024-05-10T14:07:12.079824+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079824+0000","last_undegraded":"2024-05-10T14:07:12.079824+0000","last_fullsized":"2024-05-10T14:07:12.079824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554228+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:11.554228+0000","last_peered":"2024-05-10T14:07:11.554228+0000","last_clean":"2024-05-10T14:07:11.554228+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:11.554228+0000","last_undegraded":"2024-05-10T14:07:11.554228+0000","last_fullsized":"2024-05-10T14:07:11.554228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550475+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550475+0000","last_peered":"2024-05-10T14:07:11.550475+0000","last_clean":"2024-05-10T14:07:11.550475+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550475+0000","last_undegraded":"2024-05-10T14:07:11.550475+0000","last_fullsized":"2024-05-10T14:07:11.550475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555673+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:11.555673+0000","last_peered":"2024-05-10T14:07:11.555673+0000","last_clean":"2024-05-10T14:07:11.555673+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:11.555673+0000","last_undegraded":"2024-05-10T14:07:11.555673+0000","last_fullsized":"2024-05-10T14:07:11.555673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553359+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:11.553359+0000","last_peered":"2024-05-10T14:07:11.553359+0000","last_clean":"2024-05-10T14:07:11.553359+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:11.553359+0000","last_undegraded":"2024-05-10T14:07:11.553359+0000","last_fullsized":"2024-05-10T14:07:11.553359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549532+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549532+0000","last_peered":"2024-05-10T14:07:11.549532+0000","last_clean":"2024-05-10T14:07:11.549532+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549532+0000","last_undegraded":"2024-05-10T14:07:11.549532+0000","last_fullsized":"2024-05-10T14:07:11.549532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.073945+0000","last_peered":"2024-05-10T14:07:12.073945+0000","last_clean":"2024-05-10T14:07:12.073945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.073945+0000","last_undegraded":"2024-05-10T14:07:12.073945+0000","last_fullsized":"2024-05-10T14:07:12.073945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555009+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555009+0000","last_peered":"2024-05-10T14:07:11.555009+0000","last_clean":"2024-05-10T14:07:11.555009+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555009+0000","last_undegraded":"2024-05-10T14:07:11.555009+0000","last_fullsized":"2024-05-10T14:07:11.555009+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:12.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074427+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:12.074427+0000","last_peered":"2024-05-10T14:07:12.074427+0000","last_clean":"2024-05-10T14:07:12.074427+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:12.074427+0000","last_undegraded":"2024-05-10T14:07:12.074427+0000","last_fullsized":"2024-05-10T14:07:12.074427+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550195+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:11.550195+0000","last_peered":"2024-05-10T14:07:11.550195+0000","last_clean":"2024-05-10T14:07:11.550195+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:11.550195+0000","last_undegraded":"2024-05-10T14:07:11.550195+0000","last_fullsized":"2024-05-10T14:07:11.550195+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:52.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073622+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073622+0000","last_peered":"2024-05-10T14:07:12.073622+0000","last_clean":"2024-05-10T14:07:12.073622+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073622+0000","last_undegraded":"2024-05-10T14:07:12.073622+0000","last_fullsized":"2024-05-10T14:07:12.073622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075091+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:12.075091+0000","last_peered":"2024-05-10T14:07:12.075091+0000","last_clean":"2024-05-10T14:07:12.075091+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:12.075091+0000","last_undegraded":"2024-05-10T14:07:12.075091+0000","last_fullsized":"2024-05-10T14:07:12.075091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555017+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555017+0000","last_peered":"2024-05-10T14:07:11.555017+0000","last_clean":"2024-05-10T14:07:11.555017+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555017+0000","last_undegraded":"2024-05-10T14:07:11.555017+0000","last_fullsized":"2024-05-10T14:07:11.555017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555476+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:11.555476+0000","last_peered":"2024-05-10T14:07:11.555476+0000","last_clean":"2024-05-10T14:07:11.555476+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:11.555476+0000","last_undegraded":"2024-05-10T14:07:11.555476+0000","last_fullsized":"2024-05-10T14:07:11.555476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083134+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:12.083134+0000","last_peered":"2024-05-10T14:07:12.083134+0000","last_clean":"2024-05-10T14:07:12.083134+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:12.083134+0000","last_undegraded":"2024-05-10T14:07:12.083134+0000","last_fullsized":"2024-05-10T14:07:12.083134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554347+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:11.554347+0000","last_peered":"2024-05-10T14:07:11.554347+0000","last_clean":"2024-05-10T14:07:11.554347+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:11.554347+0000","last_undegraded":"2024-05-10T14:07:11.554347+0000","last_fullsized":"2024-05-10T14:07:11.554347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:47.045146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082687+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:12.082687+0000","last_peered":"2024-05-10T14:07:12.082687+0000","last_clean":"2024-05-10T14:07:12.082687+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:12.082687+0000","last_undegraded":"2024-05-10T14:07:12.082687+0000","last_fullsized":"2024-05-10T14:07:12.082687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549354+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:11.549354+0000","last_peered":"2024-05-10T14:07:11.549354+0000","last_clean":"2024-05-10T14:07:11.549354+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:11.549354+0000","last_undegraded":"2024-05-10T14:07:11.549354+0000","last_fullsized":"2024-05-10T14:07:11.549354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075462+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:12.075462+0000","last_peered":"2024-05-10T14:07:12.075462+0000","last_clean":"2024-05-10T14:07:12.075462+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:12.075462+0000","last_undegraded":"2024-05-10T14:07:12.075462+0000","last_fullsized":"2024-05-10T14:07:12.075462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550653+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550653+0000","last_peered":"2024-05-10T14:07:11.550653+0000","last_clean":"2024-05-10T14:07:11.550653+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550653+0000","last_undegraded":"2024-05-10T14:07:11.550653+0000","last_fullsized":"2024-05-10T14:07:11.550653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":301,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554321+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:11.554321+0000","last_peered":"2024-05-10T14:07:11.554321+0000","last_clean":"2024-05-10T14:07:11.554321+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:11.554321+0000","last_undegraded":"2024-05-10T14:07:11.554321+0000","last_fullsized":"2024-05-10T14:07:11.554321+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:10.732947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548392+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548392+0000","last_peered":"2024-05-10T14:07:11.548392+0000","last_clean":"2024-05-10T14:07:11.548392+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548392+0000","last_undegraded":"2024-05-10T14:07:11.548392+0000","last_fullsized":"2024-05-10T14:07:11.548392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554759+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554759+0000","last_peered":"2024-05-10T14:07:11.554759+0000","last_clean":"2024-05-10T14:07:11.554759+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554759+0000","last_undegraded":"2024-05-10T14:07:11.554759+0000","last_fullsized":"2024-05-10T14:07:11.554759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076842+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:12.076842+0000","last_peered":"2024-05-10T14:07:12.076842+0000","last_clean":"2024-05-10T14:07:12.076842+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:12.076842+0000","last_undegraded":"2024-05-10T14:07:12.076842+0000","last_fullsized":"2024-05-10T14:07:12.076842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072614+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:12.072614+0000","last_peered":"2024-05-10T14:07:12.072614+0000","last_clean":"2024-05-10T14:07:12.072614+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:12.072614+0000","last_undegraded":"2024-05-10T14:07:12.072614+0000","last_fullsized":"2024-05-10T14:07:12.072614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074531+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074531+0000","last_peered":"2024-05-10T14:07:12.074531+0000","last_clean":"2024-05-10T14:07:12.074531+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074531+0000","last_undegraded":"2024-05-10T14:07:12.074531+0000","last_fullsized":"2024-05-10T14:07:12.074531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074815+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074815+0000","last_peered":"2024-05-10T14:07:12.074815+0000","last_clean":"2024-05-10T14:07:12.074815+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074815+0000","last_undegraded":"2024-05-10T14:07:12.074815+0000","last_fullsized":"2024-05-10T14:07:12.074815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552380+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552380+0000","last_peered":"2024-05-10T14:07:11.552380+0000","last_clean":"2024-05-10T14:07:11.552380+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552380+0000","last_undegraded":"2024-05-10T14:07:11.552380+0000","last_fullsized":"2024-05-10T14:07:11.552380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072973+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:12.072973+0000","last_peered":"2024-05-10T14:07:12.072973+0000","last_clean":"2024-05-10T14:07:12.072973+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:12.072973+0000","last_undegraded":"2024-05-10T14:07:12.072973+0000","last_fullsized":"2024-05-10T14:07:12.072973+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550200+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550200+0000","last_peered":"2024-05-10T14:07:11.550200+0000","last_clean":"2024-05-10T14:07:11.550200+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550200+0000","last_undegraded":"2024-05-10T14:07:11.550200+0000","last_fullsized":"2024-05-10T14:07:11.550200+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:47.337132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552750+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552750+0000","last_peered":"2024-05-10T14:07:11.552750+0000","last_clean":"2024-05-10T14:07:11.552750+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552750+0000","last_undegraded":"2024-05-10T14:07:11.552750+0000","last_fullsized":"2024-05-10T14:07:11.552750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554785+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554785+0000","last_peered":"2024-05-10T14:07:11.554785+0000","last_clean":"2024-05-10T14:07:11.554785+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554785+0000","last_undegraded":"2024-05-10T14:07:11.554785+0000","last_fullsized":"2024-05-10T14:07:11.554785+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.963586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550032+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:11.550032+0000","last_peered":"2024-05-10T14:07:11.550032+0000","last_clean":"2024-05-10T14:07:11.550032+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:11.550032+0000","last_undegraded":"2024-05-10T14:07:11.550032+0000","last_fullsized":"2024-05-10T14:07:11.550032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075442+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.075442+0000","last_peered":"2024-05-10T14:07:12.075442+0000","last_clean":"2024-05-10T14:07:12.075442+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.075442+0000","last_undegraded":"2024-05-10T14:07:12.075442+0000","last_fullsized":"2024-05-10T14:07:12.075442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549388+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549388+0000","last_peered":"2024-05-10T14:07:11.549388+0000","last_clean":"2024-05-10T14:07:11.549388+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549388+0000","last_undegraded":"2024-05-10T14:07:11.549388+0000","last_fullsized":"2024-05-10T14:07:11.549388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555844+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:07:11.555844+0000","last_peered":"2024-05-10T14:07:11.555844+0000","last_clean":"2024-05-10T14:07:11.555844+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:11.555844+0000","last_undegraded":"2024-05-10T14:07:11.555844+0000","last_fullsized":"2024-05-10T14:07:11.555844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":296,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555085+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:11.555085+0000","last_peered":"2024-05-10T14:07:11.555085+0000","last_clean":"2024-05-10T14:07:11.555085+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:11.555085+0000","last_undegraded":"2024-05-10T14:07:11.555085+0000","last_fullsized":"2024-05-10T14:07:11.555085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":203,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080999+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:12.080999+0000","last_peered":"2024-05-10T14:07:12.080999+0000","last_clean":"2024-05-10T14:07:12.080999+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:12.080999+0000","last_undegraded":"2024-05-10T14:07:12.080999+0000","last_fullsized":"2024-05-10T14:07:12.080999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549647+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549647+0000","last_peered":"2024-05-10T14:07:11.549647+0000","last_clean":"2024-05-10T14:07:11.549647+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549647+0000","last_undegraded":"2024-05-10T14:07:11.549647+0000","last_fullsized":"2024-05-10T14:07:11.549647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078973+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:12.078973+0000","last_peered":"2024-05-10T14:07:12.078973+0000","last_clean":"2024-05-10T14:07:12.078973+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:12.078973+0000","last_undegraded":"2024-05-10T14:07:12.078973+0000","last_fullsized":"2024-05-10T14:07:12.078973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":217,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077168+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:12.077168+0000","last_peered":"2024-05-10T14:07:12.077168+0000","last_clean":"2024-05-10T14:07:12.077168+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:12.077168+0000","last_undegraded":"2024-05-10T14:07:12.077168+0000","last_fullsized":"2024-05-10T14:07:12.077168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549496+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549496+0000","last_peered":"2024-05-10T14:07:11.549496+0000","last_clean":"2024-05-10T14:07:11.549496+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549496+0000","last_undegraded":"2024-05-10T14:07:11.549496+0000","last_fullsized":"2024-05-10T14:07:11.549496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":218,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080066+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:12.080066+0000","last_peered":"2024-05-10T14:07:12.080066+0000","last_clean":"2024-05-10T14:07:12.080066+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:12.080066+0000","last_undegraded":"2024-05-10T14:07:12.080066+0000","last_fullsized":"2024-05-10T14:07:12.080066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074628+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074628+0000","last_peered":"2024-05-10T14:07:12.074628+0000","last_clean":"2024-05-10T14:07:12.074628+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074628+0000","last_undegraded":"2024-05-10T14:07:12.074628+0000","last_fullsized":"2024-05-10T14:07:12.074628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.724292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074954+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074954+0000","last_peered":"2024-05-10T14:07:12.074954+0000","last_clean":"2024-05-10T14:07:12.074954+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074954+0000","last_undegraded":"2024-05-10T14:07:12.074954+0000","last_fullsized":"2024-05-10T14:07:12.074954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073072+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073072+0000","last_peered":"2024-05-10T14:07:12.073072+0000","last_clean":"2024-05-10T14:07:12.073072+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073072+0000","last_undegraded":"2024-05-10T14:07:12.073072+0000","last_fullsized":"2024-05-10T14:07:12.073072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":337,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073234+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:12.073234+0000","last_peered":"2024-05-10T14:07:12.073234+0000","last_clean":"2024-05-10T14:07:12.073234+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:12.073234+0000","last_undegraded":"2024-05-10T14:07:12.073234+0000","last_fullsized":"2024-05-10T14:07:12.073234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552257+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552257+0000","last_peered":"2024-05-10T14:07:11.552257+0000","last_clean":"2024-05-10T14:07:11.552257+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552257+0000","last_undegraded":"2024-05-10T14:07:11.552257+0000","last_fullsized":"2024-05-10T14:07:11.552257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555371+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555371+0000","last_peered":"2024-05-10T14:07:11.555371+0000","last_clean":"2024-05-10T14:07:11.555371+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555371+0000","last_undegraded":"2024-05-10T14:07:11.555371+0000","last_fullsized":"2024-05-10T14:07:11.555371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553894+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:11.553894+0000","last_peered":"2024-05-10T14:07:11.553894+0000","last_clean":"2024-05-10T14:07:11.553894+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:11.553894+0000","last_undegraded":"2024-05-10T14:07:11.553894+0000","last_fullsized":"2024-05-10T14:07:11.553894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073844+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073844+0000","last_peered":"2024-05-10T14:07:12.073844+0000","last_clean":"2024-05-10T14:07:12.073844+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073844+0000","last_undegraded":"2024-05-10T14:07:12.073844+0000","last_fullsized":"2024-05-10T14:07:12.073844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551597+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551597+0000","last_peered":"2024-05-10T14:07:11.551597+0000","last_clean":"2024-05-10T14:07:11.551597+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551597+0000","last_undegraded":"2024-05-10T14:07:11.551597+0000","last_fullsized":"2024-05-10T14:07:11.551597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554491+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:11.554491+0000","last_peered":"2024-05-10T14:07:11.554491+0000","last_clean":"2024-05-10T14:07:11.554491+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:11.554491+0000","last_undegraded":"2024-05-10T14:07:11.554491+0000","last_fullsized":"2024-05-10T14:07:11.554491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074222+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:12.074222+0000","last_peered":"2024-05-10T14:07:12.074222+0000","last_clean":"2024-05-10T14:07:12.074222+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:12.074222+0000","last_undegraded":"2024-05-10T14:07:12.074222+0000","last_fullsized":"2024-05-10T14:07:12.074222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072664+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:12.072664+0000","last_peered":"2024-05-10T14:07:12.072664+0000","last_clean":"2024-05-10T14:07:12.072664+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:12.072664+0000","last_undegraded":"2024-05-10T14:07:12.072664+0000","last_fullsized":"2024-05-10T14:07:12.072664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074302+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.074302+0000","last_peered":"2024-05-10T14:07:12.074302+0000","last_clean":"2024-05-10T14:07:12.074302+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.074302+0000","last_undegraded":"2024-05-10T14:07:12.074302+0000","last_fullsized":"2024-05-10T14:07:12.074302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074708+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074708+0000","last_peered":"2024-05-10T14:07:12.074708+0000","last_clean":"2024-05-10T14:07:12.074708+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074708+0000","last_undegraded":"2024-05-10T14:07:12.074708+0000","last_fullsized":"2024-05-10T14:07:12.074708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":194,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074718+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:12.074718+0000","last_peered":"2024-05-10T14:07:12.074718+0000","last_clean":"2024-05-10T14:07:12.074718+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:12.074718+0000","last_undegraded":"2024-05-10T14:07:12.074718+0000","last_fullsized":"2024-05-10T14:07:12.074718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554724+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:11.554724+0000","last_peered":"2024-05-10T14:07:11.554724+0000","last_clean":"2024-05-10T14:07:11.554724+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:11.554724+0000","last_undegraded":"2024-05-10T14:07:11.554724+0000","last_fullsized":"2024-05-10T14:07:11.554724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548842+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548842+0000","last_peered":"2024-05-10T14:07:11.548842+0000","last_clean":"2024-05-10T14:07:11.548842+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548842+0000","last_undegraded":"2024-05-10T14:07:11.548842+0000","last_fullsized":"2024-05-10T14:07:11.548842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:58.484385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554074+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554074+0000","last_peered":"2024-05-10T14:07:11.554074+0000","last_clean":"2024-05-10T14:07:11.554074+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554074+0000","last_undegraded":"2024-05-10T14:07:11.554074+0000","last_fullsized":"2024-05-10T14:07:11.554074+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.552986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554801+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:11.554801+0000","last_peered":"2024-05-10T14:07:11.554801+0000","last_clean":"2024-05-10T14:07:11.554801+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:11.554801+0000","last_undegraded":"2024-05-10T14:07:11.554801+0000","last_fullsized":"2024-05-10T14:07:11.554801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074182+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.074182+0000","last_peered":"2024-05-10T14:07:12.074182+0000","last_clean":"2024-05-10T14:07:12.074182+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.074182+0000","last_undegraded":"2024-05-10T14:07:12.074182+0000","last_fullsized":"2024-05-10T14:07:12.074182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075156+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075156+0000","last_peered":"2024-05-10T14:07:12.075156+0000","last_clean":"2024-05-10T14:07:12.075156+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075156+0000","last_undegraded":"2024-05-10T14:07:12.075156+0000","last_fullsized":"2024-05-10T14:07:12.075156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548961+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.548961+0000","last_peered":"2024-05-10T14:07:11.548961+0000","last_clean":"2024-05-10T14:07:11.548961+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.548961+0000","last_undegraded":"2024-05-10T14:07:11.548961+0000","last_fullsized":"2024-05-10T14:07:11.548961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080460+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:12.080460+0000","last_peered":"2024-05-10T14:07:12.080460+0000","last_clean":"2024-05-10T14:07:12.080460+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:12.080460+0000","last_undegraded":"2024-05-10T14:07:12.080460+0000","last_fullsized":"2024-05-10T14:07:12.080460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548696+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548696+0000","last_peered":"2024-05-10T14:07:11.548696+0000","last_clean":"2024-05-10T14:07:11.548696+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548696+0000","last_undegraded":"2024-05-10T14:07:11.548696+0000","last_fullsized":"2024-05-10T14:07:11.548696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075247+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:07:12.075247+0000","last_peered":"2024-05-10T14:07:12.075247+0000","last_clean":"2024-05-10T14:07:12.075247+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:12.075247+0000","last_undegraded":"2024-05-10T14:07:12.075247+0000","last_fullsized":"2024-05-10T14:07:12.075247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548319+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:11.548319+0000","last_peered":"2024-05-10T14:07:11.548319+0000","last_clean":"2024-05-10T14:07:11.548319+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:11.548319+0000","last_undegraded":"2024-05-10T14:07:11.548319+0000","last_fullsized":"2024-05-10T14:07:11.548319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549295+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:11.549295+0000","last_peered":"2024-05-10T14:07:11.549295+0000","last_clean":"2024-05-10T14:07:11.549295+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:11.549295+0000","last_undegraded":"2024-05-10T14:07:11.549295+0000","last_fullsized":"2024-05-10T14:07:11.549295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551032+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551032+0000","last_peered":"2024-05-10T14:07:11.551032+0000","last_clean":"2024-05-10T14:07:11.551032+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551032+0000","last_undegraded":"2024-05-10T14:07:11.551032+0000","last_fullsized":"2024-05-10T14:07:11.551032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:59.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553538+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:11.553538+0000","last_peered":"2024-05-10T14:07:11.553538+0000","last_clean":"2024-05-10T14:07:11.553538+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:11.553538+0000","last_undegraded":"2024-05-10T14:07:11.553538+0000","last_fullsized":"2024-05-10T14:07:11.553538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072872+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:12.072872+0000","last_peered":"2024-05-10T14:07:12.072872+0000","last_clean":"2024-05-10T14:07:12.072872+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:12.072872+0000","last_undegraded":"2024-05-10T14:07:12.072872+0000","last_fullsized":"2024-05-10T14:07:12.072872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073737+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073737+0000","last_peered":"2024-05-10T14:07:12.073737+0000","last_clean":"2024-05-10T14:07:12.073737+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073737+0000","last_undegraded":"2024-05-10T14:07:12.073737+0000","last_fullsized":"2024-05-10T14:07:12.073737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:01.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553223+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:11.553223+0000","last_peered":"2024-05-10T14:07:11.553223+0000","last_clean":"2024-05-10T14:07:11.553223+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:11.553223+0000","last_undegraded":"2024-05-10T14:07:11.553223+0000","last_fullsized":"2024-05-10T14:07:11.553223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077794+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077794+0000","last_peered":"2024-05-10T14:07:12.077794+0000","last_clean":"2024-05-10T14:07:12.077794+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077794+0000","last_undegraded":"2024-05-10T14:07:12.077794+0000","last_fullsized":"2024-05-10T14:07:12.077794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548579+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:11.548579+0000","last_peered":"2024-05-10T14:07:11.548579+0000","last_clean":"2024-05-10T14:07:11.548579+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:11.548579+0000","last_undegraded":"2024-05-10T14:07:11.548579+0000","last_fullsized":"2024-05-10T14:07:11.548579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075775+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:07:12.075775+0000","last_peered":"2024-05-10T14:07:12.075775+0000","last_clean":"2024-05-10T14:07:12.075775+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:12.075775+0000","last_undegraded":"2024-05-10T14:07:12.075775+0000","last_fullsized":"2024-05-10T14:07:12.075775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077612+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077612+0000","last_peered":"2024-05-10T14:07:12.077612+0000","last_clean":"2024-05-10T14:07:12.077612+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077612+0000","last_undegraded":"2024-05-10T14:07:12.077612+0000","last_fullsized":"2024-05-10T14:07:12.077612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079988+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:12.079988+0000","last_peered":"2024-05-10T14:07:12.079988+0000","last_clean":"2024-05-10T14:07:12.079988+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:12.079988+0000","last_undegraded":"2024-05-10T14:07:12.079988+0000","last_fullsized":"2024-05-10T14:07:12.079988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073822+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:12.073822+0000","last_peered":"2024-05-10T14:07:12.073822+0000","last_clean":"2024-05-10T14:07:12.073822+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:12.073822+0000","last_undegraded":"2024-05-10T14:07:12.073822+0000","last_fullsized":"2024-05-10T14:07:12.073822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:16.077857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074716+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074716+0000","last_peered":"2024-05-10T14:07:12.074716+0000","last_clean":"2024-05-10T14:07:12.074716+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074716+0000","last_undegraded":"2024-05-10T14:07:12.074716+0000","last_fullsized":"2024-05-10T14:07:12.074716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:08.580401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074052+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:12.074052+0000","last_peered":"2024-05-10T14:07:12.074052+0000","last_clean":"2024-05-10T14:07:12.074052+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:12.074052+0000","last_undegraded":"2024-05-10T14:07:12.074052+0000","last_fullsized":"2024-05-10T14:07:12.074052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552492+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:11.552492+0000","last_peered":"2024-05-10T14:07:11.552492+0000","last_clean":"2024-05-10T14:07:11.552492+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:11.552492+0000","last_undegraded":"2024-05-10T14:07:11.552492+0000","last_fullsized":"2024-05-10T14:07:11.552492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074867+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074867+0000","last_peered":"2024-05-10T14:07:12.074867+0000","last_clean":"2024-05-10T14:07:12.074867+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074867+0000","last_undegraded":"2024-05-10T14:07:12.074867+0000","last_fullsized":"2024-05-10T14:07:12.074867+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:45.875457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073037+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073037+0000","last_peered":"2024-05-10T14:07:12.073037+0000","last_clean":"2024-05-10T14:07:12.073037+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073037+0000","last_undegraded":"2024-05-10T14:07:12.073037+0000","last_fullsized":"2024-05-10T14:07:12.073037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082680+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:12.082680+0000","last_peered":"2024-05-10T14:07:12.082680+0000","last_clean":"2024-05-10T14:07:12.082680+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:12.082680+0000","last_undegraded":"2024-05-10T14:07:12.082680+0000","last_fullsized":"2024-05-10T14:07:12.082680+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077404+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077404+0000","last_peered":"2024-05-10T14:07:12.077404+0000","last_clean":"2024-05-10T14:07:12.077404+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077404+0000","last_undegraded":"2024-05-10T14:07:12.077404+0000","last_fullsized":"2024-05-10T14:07:12.077404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550664+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550664+0000","last_peered":"2024-05-10T14:07:11.550664+0000","last_clean":"2024-05-10T14:07:11.550664+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550664+0000","last_undegraded":"2024-05-10T14:07:11.550664+0000","last_fullsized":"2024-05-10T14:07:11.550664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551820+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551820+0000","last_peered":"2024-05-10T14:07:11.551820+0000","last_clean":"2024-05-10T14:07:11.551820+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551820+0000","last_undegraded":"2024-05-10T14:07:11.551820+0000","last_fullsized":"2024-05-10T14:07:11.551820+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:23.429115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554939+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:11.554939+0000","last_peered":"2024-05-10T14:07:11.554939+0000","last_clean":"2024-05-10T14:07:11.554939+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:11.554939+0000","last_undegraded":"2024-05-10T14:07:11.554939+0000","last_fullsized":"2024-05-10T14:07:11.554939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556160+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556160+0000","last_peered":"2024-05-10T14:07:11.556160+0000","last_clean":"2024-05-10T14:07:11.556160+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556160+0000","last_undegraded":"2024-05-10T14:07:11.556160+0000","last_fullsized":"2024-05-10T14:07:11.556160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073897+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073897+0000","last_peered":"2024-05-10T14:07:12.073897+0000","last_clean":"2024-05-10T14:07:12.073897+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073897+0000","last_undegraded":"2024-05-10T14:07:12.073897+0000","last_fullsized":"2024-05-10T14:07:12.073897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081383+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:12.081383+0000","last_peered":"2024-05-10T14:07:12.081383+0000","last_clean":"2024-05-10T14:07:12.081383+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:12.081383+0000","last_undegraded":"2024-05-10T14:07:12.081383+0000","last_fullsized":"2024-05-10T14:07:12.081383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":214,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074906+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:12.074906+0000","last_peered":"2024-05-10T14:07:12.074906+0000","last_clean":"2024-05-10T14:07:12.074906+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:12.074906+0000","last_undegraded":"2024-05-10T14:07:12.074906+0000","last_fullsized":"2024-05-10T14:07:12.074906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073264+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073264+0000","last_peered":"2024-05-10T14:07:12.073264+0000","last_clean":"2024-05-10T14:07:12.073264+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073264+0000","last_undegraded":"2024-05-10T14:07:12.073264+0000","last_fullsized":"2024-05-10T14:07:12.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073160+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:12.073160+0000","last_peered":"2024-05-10T14:07:12.073160+0000","last_clean":"2024-05-10T14:07:12.073160+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:12.073160+0000","last_undegraded":"2024-05-10T14:07:12.073160+0000","last_fullsized":"2024-05-10T14:07:12.073160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551248+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551248+0000","last_peered":"2024-05-10T14:07:11.551248+0000","last_clean":"2024-05-10T14:07:11.551248+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551248+0000","last_undegraded":"2024-05-10T14:07:11.551248+0000","last_fullsized":"2024-05-10T14:07:11.551248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548996+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:11.548996+0000","last_peered":"2024-05-10T14:07:11.548996+0000","last_clean":"2024-05-10T14:07:11.548996+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:11.548996+0000","last_undegraded":"2024-05-10T14:07:11.548996+0000","last_fullsized":"2024-05-10T14:07:11.548996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552102+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552102+0000","last_peered":"2024-05-10T14:07:11.552102+0000","last_clean":"2024-05-10T14:07:11.552102+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552102+0000","last_undegraded":"2024-05-10T14:07:11.552102+0000","last_fullsized":"2024-05-10T14:07:11.552102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554640+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:11.554640+0000","last_peered":"2024-05-10T14:07:11.554640+0000","last_clean":"2024-05-10T14:07:11.554640+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:11.554640+0000","last_undegraded":"2024-05-10T14:07:11.554640+0000","last_fullsized":"2024-05-10T14:07:11.554640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.339148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548815+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548815+0000","last_peered":"2024-05-10T14:07:11.548815+0000","last_clean":"2024-05-10T14:07:11.548815+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548815+0000","last_undegraded":"2024-05-10T14:07:11.548815+0000","last_fullsized":"2024-05-10T14:07:11.548815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075683+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075683+0000","last_peered":"2024-05-10T14:07:12.075683+0000","last_clean":"2024-05-10T14:07:12.075683+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075683+0000","last_undegraded":"2024-05-10T14:07:12.075683+0000","last_fullsized":"2024-05-10T14:07:12.075683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548974+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:11.548974+0000","last_peered":"2024-05-10T14:07:11.548974+0000","last_clean":"2024-05-10T14:07:11.548974+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:11.548974+0000","last_undegraded":"2024-05-10T14:07:11.548974+0000","last_fullsized":"2024-05-10T14:07:11.548974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073748+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073748+0000","last_peered":"2024-05-10T14:07:12.073748+0000","last_clean":"2024-05-10T14:07:12.073748+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073748+0000","last_undegraded":"2024-05-10T14:07:12.073748+0000","last_fullsized":"2024-05-10T14:07:12.073748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551825+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551825+0000","last_peered":"2024-05-10T14:07:11.551825+0000","last_clean":"2024-05-10T14:07:11.551825+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551825+0000","last_undegraded":"2024-05-10T14:07:11.551825+0000","last_fullsized":"2024-05-10T14:07:11.551825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074123+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074123+0000","last_peered":"2024-05-10T14:07:12.074123+0000","last_clean":"2024-05-10T14:07:12.074123+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074123+0000","last_undegraded":"2024-05-10T14:07:12.074123+0000","last_fullsized":"2024-05-10T14:07:12.074123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554033+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554033+0000","last_peered":"2024-05-10T14:07:11.554033+0000","last_clean":"2024-05-10T14:07:11.554033+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554033+0000","last_undegraded":"2024-05-10T14:07:11.554033+0000","last_fullsized":"2024-05-10T14:07:11.554033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:10:20.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550568+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550568+0000","last_peered":"2024-05-10T14:07:11.550568+0000","last_clean":"2024-05-10T14:07:11.550568+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550568+0000","last_undegraded":"2024-05-10T14:07:11.550568+0000","last_fullsized":"2024-05-10T14:07:11.550568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:27.784903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548734+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548734+0000","last_peered":"2024-05-10T14:07:11.548734+0000","last_clean":"2024-05-10T14:07:11.548734+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548734+0000","last_undegraded":"2024-05-10T14:07:11.548734+0000","last_fullsized":"2024-05-10T14:07:11.548734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554459+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554459+0000","last_peered":"2024-05-10T14:07:11.554459+0000","last_clean":"2024-05-10T14:07:11.554459+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554459+0000","last_undegraded":"2024-05-10T14:07:11.554459+0000","last_fullsized":"2024-05-10T14:07:11.554459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075630+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.075630+0000","last_peered":"2024-05-10T14:07:12.075630+0000","last_clean":"2024-05-10T14:07:12.075630+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.075630+0000","last_undegraded":"2024-05-10T14:07:12.075630+0000","last_fullsized":"2024-05-10T14:07:12.075630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549103+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549103+0000","last_peered":"2024-05-10T14:07:11.549103+0000","last_clean":"2024-05-10T14:07:11.549103+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549103+0000","last_undegraded":"2024-05-10T14:07:11.549103+0000","last_fullsized":"2024-05-10T14:07:11.549103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555318+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555318+0000","last_peered":"2024-05-10T14:07:11.555318+0000","last_clean":"2024-05-10T14:07:11.555318+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555318+0000","last_undegraded":"2024-05-10T14:07:11.555318+0000","last_fullsized":"2024-05-10T14:07:11.555318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":229,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552097+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552097+0000","last_peered":"2024-05-10T14:07:11.552097+0000","last_clean":"2024-05-10T14:07:11.552097+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552097+0000","last_undegraded":"2024-05-10T14:07:11.552097+0000","last_fullsized":"2024-05-10T14:07:11.552097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:17.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074350+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074350+0000","last_peered":"2024-05-10T14:07:12.074350+0000","last_clean":"2024-05-10T14:07:12.074350+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074350+0000","last_undegraded":"2024-05-10T14:07:12.074350+0000","last_fullsized":"2024-05-10T14:07:12.074350+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:17.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073526+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073526+0000","last_peered":"2024-05-10T14:07:12.073526+0000","last_clean":"2024-05-10T14:07:12.073526+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073526+0000","last_undegraded":"2024-05-10T14:07:12.073526+0000","last_fullsized":"2024-05-10T14:07:12.073526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548647+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548647+0000","last_peered":"2024-05-10T14:07:11.548647+0000","last_clean":"2024-05-10T14:07:11.548647+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548647+0000","last_undegraded":"2024-05-10T14:07:11.548647+0000","last_fullsized":"2024-05-10T14:07:11.548647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556094+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:11.556094+0000","last_peered":"2024-05-10T14:07:11.556094+0000","last_clean":"2024-05-10T14:07:11.556094+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:11.556094+0000","last_undegraded":"2024-05-10T14:07:11.556094+0000","last_fullsized":"2024-05-10T14:07:11.556094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075494+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:12.075494+0000","last_peered":"2024-05-10T14:07:12.075494+0000","last_clean":"2024-05-10T14:07:12.075494+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:12.075494+0000","last_undegraded":"2024-05-10T14:07:12.075494+0000","last_fullsized":"2024-05-10T14:07:12.075494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710760,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41252,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39176,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332664,"statfs":{"total":96636764160,"available":96596647936,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509505,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37736,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334104,"statfs":{"total":96636764160,"available":96598122496,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:18.500 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T14:07:18.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:18.890 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:18.904 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-05-10T14:07:18.218608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":837,"num_read_kb":580,"num_write":575,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302728,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754671992,"statfs":{"total":773094113280,"available":772784119808,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003448"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074058+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074058+0000","last_peered":"2024-05-10T14:07:12.074058+0000","last_clean":"2024-05-10T14:07:12.074058+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074058+0000","last_undegraded":"2024-05-10T14:07:12.074058+0000","last_fullsized":"2024-05-10T14:07:12.074058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548272+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548272+0000","last_peered":"2024-05-10T14:07:11.548272+0000","last_clean":"2024-05-10T14:07:11.548272+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548272+0000","last_undegraded":"2024-05-10T14:07:11.548272+0000","last_fullsized":"2024-05-10T14:07:11.548272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:46.408201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555985+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.555985+0000","last_peered":"2024-05-10T14:07:11.555985+0000","last_clean":"2024-05-10T14:07:11.555985+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.555985+0000","last_undegraded":"2024-05-10T14:07:11.555985+0000","last_fullsized":"2024-05-10T14:07:11.555985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:41.500142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081409+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081409+0000","last_peered":"2024-05-10T14:07:12.081409+0000","last_clean":"2024-05-10T14:07:12.081409+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081409+0000","last_undegraded":"2024-05-10T14:07:12.081409+0000","last_fullsized":"2024-05-10T14:07:12.081409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079824+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079824+0000","last_peered":"2024-05-10T14:07:12.079824+0000","last_clean":"2024-05-10T14:07:12.079824+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079824+0000","last_undegraded":"2024-05-10T14:07:12.079824+0000","last_fullsized":"2024-05-10T14:07:12.079824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554228+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:11.554228+0000","last_peered":"2024-05-10T14:07:11.554228+0000","last_clean":"2024-05-10T14:07:11.554228+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:11.554228+0000","last_undegraded":"2024-05-10T14:07:11.554228+0000","last_fullsized":"2024-05-10T14:07:11.554228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:33.180177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550475+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550475+0000","last_peered":"2024-05-10T14:07:11.550475+0000","last_clean":"2024-05-10T14:07:11.550475+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550475+0000","last_undegraded":"2024-05-10T14:07:11.550475+0000","last_fullsized":"2024-05-10T14:07:11.550475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555673+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:11.555673+0000","last_peered":"2024-05-10T14:07:11.555673+0000","last_clean":"2024-05-10T14:07:11.555673+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:11.555673+0000","last_undegraded":"2024-05-10T14:07:11.555673+0000","last_fullsized":"2024-05-10T14:07:11.555673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:37.425846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553359+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:11.553359+0000","last_peered":"2024-05-10T14:07:11.553359+0000","last_clean":"2024-05-10T14:07:11.553359+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:11.553359+0000","last_undegraded":"2024-05-10T14:07:11.553359+0000","last_fullsized":"2024-05-10T14:07:11.553359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549532+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549532+0000","last_peered":"2024-05-10T14:07:11.549532+0000","last_clean":"2024-05-10T14:07:11.549532+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549532+0000","last_undegraded":"2024-05-10T14:07:11.549532+0000","last_fullsized":"2024-05-10T14:07:11.549532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073945+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.073945+0000","last_peered":"2024-05-10T14:07:12.073945+0000","last_clean":"2024-05-10T14:07:12.073945+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.073945+0000","last_undegraded":"2024-05-10T14:07:12.073945+0000","last_fullsized":"2024-05-10T14:07:12.073945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555009+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555009+0000","last_peered":"2024-05-10T14:07:11.555009+0000","last_clean":"2024-05-10T14:07:11.555009+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555009+0000","last_undegraded":"2024-05-10T14:07:11.555009+0000","last_fullsized":"2024-05-10T14:07:11.555009+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:12.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"81'10","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074427+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:12.074427+0000","last_peered":"2024-05-10T14:07:12.074427+0000","last_clean":"2024-05-10T14:07:12.074427+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:12.074427+0000","last_undegraded":"2024-05-10T14:07:12.074427+0000","last_fullsized":"2024-05-10T14:07:12.074427+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550195+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:11.550195+0000","last_peered":"2024-05-10T14:07:11.550195+0000","last_clean":"2024-05-10T14:07:11.550195+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:11.550195+0000","last_undegraded":"2024-05-10T14:07:11.550195+0000","last_fullsized":"2024-05-10T14:07:11.550195+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:52.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073622+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073622+0000","last_peered":"2024-05-10T14:07:12.073622+0000","last_clean":"2024-05-10T14:07:12.073622+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073622+0000","last_undegraded":"2024-05-10T14:07:12.073622+0000","last_fullsized":"2024-05-10T14:07:12.073622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:08.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075091+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:12.075091+0000","last_peered":"2024-05-10T14:07:12.075091+0000","last_clean":"2024-05-10T14:07:12.075091+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:12.075091+0000","last_undegraded":"2024-05-10T14:07:12.075091+0000","last_fullsized":"2024-05-10T14:07:12.075091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555017+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555017+0000","last_peered":"2024-05-10T14:07:11.555017+0000","last_clean":"2024-05-10T14:07:11.555017+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555017+0000","last_undegraded":"2024-05-10T14:07:11.555017+0000","last_fullsized":"2024-05-10T14:07:11.555017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:47.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555476+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:11.555476+0000","last_peered":"2024-05-10T14:07:11.555476+0000","last_clean":"2024-05-10T14:07:11.555476+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:11.555476+0000","last_undegraded":"2024-05-10T14:07:11.555476+0000","last_fullsized":"2024-05-10T14:07:11.555476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:13.896241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'15","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083134+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:12.083134+0000","last_peered":"2024-05-10T14:07:12.083134+0000","last_clean":"2024-05-10T14:07:12.083134+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:12.083134+0000","last_undegraded":"2024-05-10T14:07:12.083134+0000","last_fullsized":"2024-05-10T14:07:12.083134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554347+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:11.554347+0000","last_peered":"2024-05-10T14:07:11.554347+0000","last_clean":"2024-05-10T14:07:11.554347+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:11.554347+0000","last_undegraded":"2024-05-10T14:07:11.554347+0000","last_fullsized":"2024-05-10T14:07:11.554347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:47.045146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082687+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:12.082687+0000","last_peered":"2024-05-10T14:07:12.082687+0000","last_clean":"2024-05-10T14:07:12.082687+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:12.082687+0000","last_undegraded":"2024-05-10T14:07:12.082687+0000","last_fullsized":"2024-05-10T14:07:12.082687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'15","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549354+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:11.549354+0000","last_peered":"2024-05-10T14:07:11.549354+0000","last_clean":"2024-05-10T14:07:11.549354+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:11.549354+0000","last_undegraded":"2024-05-10T14:07:11.549354+0000","last_fullsized":"2024-05-10T14:07:11.549354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:14.353688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"81'20","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075462+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:12.075462+0000","last_peered":"2024-05-10T14:07:12.075462+0000","last_clean":"2024-05-10T14:07:12.075462+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:12.075462+0000","last_undegraded":"2024-05-10T14:07:12.075462+0000","last_fullsized":"2024-05-10T14:07:12.075462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550653+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550653+0000","last_peered":"2024-05-10T14:07:11.550653+0000","last_clean":"2024-05-10T14:07:11.550653+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550653+0000","last_undegraded":"2024-05-10T14:07:11.550653+0000","last_fullsized":"2024-05-10T14:07:11.550653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:50.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"81'10","reported_seq":301,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554321+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:11.554321+0000","last_peered":"2024-05-10T14:07:11.554321+0000","last_clean":"2024-05-10T14:07:11.554321+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:11.554321+0000","last_undegraded":"2024-05-10T14:07:11.554321+0000","last_fullsized":"2024-05-10T14:07:11.554321+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:10.732947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548392+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548392+0000","last_peered":"2024-05-10T14:07:11.548392+0000","last_clean":"2024-05-10T14:07:11.548392+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548392+0000","last_undegraded":"2024-05-10T14:07:11.548392+0000","last_fullsized":"2024-05-10T14:07:11.548392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:38.949126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554759+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554759+0000","last_peered":"2024-05-10T14:07:11.554759+0000","last_clean":"2024-05-10T14:07:11.554759+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554759+0000","last_undegraded":"2024-05-10T14:07:11.554759+0000","last_fullsized":"2024-05-10T14:07:11.554759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:27.515039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076842+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:12.076842+0000","last_peered":"2024-05-10T14:07:12.076842+0000","last_clean":"2024-05-10T14:07:12.076842+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:12.076842+0000","last_undegraded":"2024-05-10T14:07:12.076842+0000","last_fullsized":"2024-05-10T14:07:12.076842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072614+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:12.072614+0000","last_peered":"2024-05-10T14:07:12.072614+0000","last_clean":"2024-05-10T14:07:12.072614+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:12.072614+0000","last_undegraded":"2024-05-10T14:07:12.072614+0000","last_fullsized":"2024-05-10T14:07:12.072614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074531+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074531+0000","last_peered":"2024-05-10T14:07:12.074531+0000","last_clean":"2024-05-10T14:07:12.074531+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074531+0000","last_undegraded":"2024-05-10T14:07:12.074531+0000","last_fullsized":"2024-05-10T14:07:12.074531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:40.307785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074815+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074815+0000","last_peered":"2024-05-10T14:07:12.074815+0000","last_clean":"2024-05-10T14:07:12.074815+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074815+0000","last_undegraded":"2024-05-10T14:07:12.074815+0000","last_fullsized":"2024-05-10T14:07:12.074815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552380+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552380+0000","last_peered":"2024-05-10T14:07:11.552380+0000","last_clean":"2024-05-10T14:07:11.552380+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552380+0000","last_undegraded":"2024-05-10T14:07:11.552380+0000","last_fullsized":"2024-05-10T14:07:11.552380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:50.902547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'14","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072973+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:12.072973+0000","last_peered":"2024-05-10T14:07:12.072973+0000","last_clean":"2024-05-10T14:07:12.072973+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:12.072973+0000","last_undegraded":"2024-05-10T14:07:12.072973+0000","last_fullsized":"2024-05-10T14:07:12.072973+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550200+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550200+0000","last_peered":"2024-05-10T14:07:11.550200+0000","last_clean":"2024-05-10T14:07:11.550200+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550200+0000","last_undegraded":"2024-05-10T14:07:11.550200+0000","last_fullsized":"2024-05-10T14:07:11.550200+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:48:47.337132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552750+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552750+0000","last_peered":"2024-05-10T14:07:11.552750+0000","last_clean":"2024-05-10T14:07:11.552750+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552750+0000","last_undegraded":"2024-05-10T14:07:11.552750+0000","last_fullsized":"2024-05-10T14:07:11.552750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:39.474909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554785+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554785+0000","last_peered":"2024-05-10T14:07:11.554785+0000","last_clean":"2024-05-10T14:07:11.554785+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554785+0000","last_undegraded":"2024-05-10T14:07:11.554785+0000","last_fullsized":"2024-05-10T14:07:11.554785+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:22.963586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"81'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550032+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:11.550032+0000","last_peered":"2024-05-10T14:07:11.550032+0000","last_clean":"2024-05-10T14:07:11.550032+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:11.550032+0000","last_undegraded":"2024-05-10T14:07:11.550032+0000","last_fullsized":"2024-05-10T14:07:11.550032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075442+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.075442+0000","last_peered":"2024-05-10T14:07:12.075442+0000","last_clean":"2024-05-10T14:07:12.075442+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.075442+0000","last_undegraded":"2024-05-10T14:07:12.075442+0000","last_fullsized":"2024-05-10T14:07:12.075442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549388+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549388+0000","last_peered":"2024-05-10T14:07:11.549388+0000","last_clean":"2024-05-10T14:07:11.549388+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549388+0000","last_undegraded":"2024-05-10T14:07:11.549388+0000","last_fullsized":"2024-05-10T14:07:11.549388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:17.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"81'16","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555844+0000","last_change":"2024-05-10T14:02:36.708409+0000","last_active":"2024-05-10T14:07:11.555844+0000","last_peered":"2024-05-10T14:07:11.555844+0000","last_clean":"2024-05-10T14:07:11.555844+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:11.555844+0000","last_undegraded":"2024-05-10T14:07:11.555844+0000","last_fullsized":"2024-05-10T14:07:11.555844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:37.846049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'17","reported_seq":296,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555085+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:11.555085+0000","last_peered":"2024-05-10T14:07:11.555085+0000","last_clean":"2024-05-10T14:07:11.555085+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:11.555085+0000","last_undegraded":"2024-05-10T14:07:11.555085+0000","last_fullsized":"2024-05-10T14:07:11.555085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":203,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080999+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:12.080999+0000","last_peered":"2024-05-10T14:07:12.080999+0000","last_clean":"2024-05-10T14:07:12.080999+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:12.080999+0000","last_undegraded":"2024-05-10T14:07:12.080999+0000","last_fullsized":"2024-05-10T14:07:12.080999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549647+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549647+0000","last_peered":"2024-05-10T14:07:11.549647+0000","last_clean":"2024-05-10T14:07:11.549647+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549647+0000","last_undegraded":"2024-05-10T14:07:11.549647+0000","last_fullsized":"2024-05-10T14:07:11.549647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078973+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:12.078973+0000","last_peered":"2024-05-10T14:07:12.078973+0000","last_clean":"2024-05-10T14:07:12.078973+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:12.078973+0000","last_undegraded":"2024-05-10T14:07:12.078973+0000","last_fullsized":"2024-05-10T14:07:12.078973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:09.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"81'18","reported_seq":217,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077168+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:12.077168+0000","last_peered":"2024-05-10T14:07:12.077168+0000","last_clean":"2024-05-10T14:07:12.077168+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:12.077168+0000","last_undegraded":"2024-05-10T14:07:12.077168+0000","last_fullsized":"2024-05-10T14:07:12.077168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549496+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549496+0000","last_peered":"2024-05-10T14:07:11.549496+0000","last_clean":"2024-05-10T14:07:11.549496+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549496+0000","last_undegraded":"2024-05-10T14:07:11.549496+0000","last_fullsized":"2024-05-10T14:07:11.549496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:06.977684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"81'16","reported_seq":218,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080066+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:12.080066+0000","last_peered":"2024-05-10T14:07:12.080066+0000","last_clean":"2024-05-10T14:07:12.080066+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:12.080066+0000","last_undegraded":"2024-05-10T14:07:12.080066+0000","last_fullsized":"2024-05-10T14:07:12.080066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074628+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074628+0000","last_peered":"2024-05-10T14:07:12.074628+0000","last_clean":"2024-05-10T14:07:12.074628+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074628+0000","last_undegraded":"2024-05-10T14:07:12.074628+0000","last_fullsized":"2024-05-10T14:07:12.074628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.724292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074954+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074954+0000","last_peered":"2024-05-10T14:07:12.074954+0000","last_clean":"2024-05-10T14:07:12.074954+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074954+0000","last_undegraded":"2024-05-10T14:07:12.074954+0000","last_fullsized":"2024-05-10T14:07:12.074954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073072+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073072+0000","last_peered":"2024-05-10T14:07:12.073072+0000","last_clean":"2024-05-10T14:07:12.073072+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073072+0000","last_undegraded":"2024-05-10T14:07:12.073072+0000","last_fullsized":"2024-05-10T14:07:12.073072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'37","reported_seq":337,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073234+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:12.073234+0000","last_peered":"2024-05-10T14:07:12.073234+0000","last_clean":"2024-05-10T14:07:12.073234+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:12.073234+0000","last_undegraded":"2024-05-10T14:07:12.073234+0000","last_fullsized":"2024-05-10T14:07:12.073234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":39,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552257+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552257+0000","last_peered":"2024-05-10T14:07:11.552257+0000","last_clean":"2024-05-10T14:07:11.552257+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552257+0000","last_undegraded":"2024-05-10T14:07:11.552257+0000","last_fullsized":"2024-05-10T14:07:11.552257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:02.542945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555371+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555371+0000","last_peered":"2024-05-10T14:07:11.555371+0000","last_clean":"2024-05-10T14:07:11.555371+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555371+0000","last_undegraded":"2024-05-10T14:07:11.555371+0000","last_fullsized":"2024-05-10T14:07:11.555371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:54.723605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074004+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074004+0000","last_peered":"2024-05-10T14:07:12.074004+0000","last_clean":"2024-05-10T14:07:12.074004+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074004+0000","last_undegraded":"2024-05-10T14:07:12.074004+0000","last_fullsized":"2024-05-10T14:07:12.074004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:20.704104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553894+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:11.553894+0000","last_peered":"2024-05-10T14:07:11.553894+0000","last_clean":"2024-05-10T14:07:11.553894+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:11.553894+0000","last_undegraded":"2024-05-10T14:07:11.553894+0000","last_fullsized":"2024-05-10T14:07:11.553894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:43.297913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073844+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073844+0000","last_peered":"2024-05-10T14:07:12.073844+0000","last_clean":"2024-05-10T14:07:12.073844+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073844+0000","last_undegraded":"2024-05-10T14:07:12.073844+0000","last_fullsized":"2024-05-10T14:07:12.073844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:03.213569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551597+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551597+0000","last_peered":"2024-05-10T14:07:11.551597+0000","last_clean":"2024-05-10T14:07:11.551597+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551597+0000","last_undegraded":"2024-05-10T14:07:11.551597+0000","last_fullsized":"2024-05-10T14:07:11.551597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:33.458811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554491+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:11.554491+0000","last_peered":"2024-05-10T14:07:11.554491+0000","last_clean":"2024-05-10T14:07:11.554491+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:11.554491+0000","last_undegraded":"2024-05-10T14:07:11.554491+0000","last_fullsized":"2024-05-10T14:07:11.554491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:41.198140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074222+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:12.074222+0000","last_peered":"2024-05-10T14:07:12.074222+0000","last_clean":"2024-05-10T14:07:12.074222+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:12.074222+0000","last_undegraded":"2024-05-10T14:07:12.074222+0000","last_fullsized":"2024-05-10T14:07:12.074222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:53.445200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"81'20","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072664+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:12.072664+0000","last_peered":"2024-05-10T14:07:12.072664+0000","last_clean":"2024-05-10T14:07:12.072664+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:12.072664+0000","last_undegraded":"2024-05-10T14:07:12.072664+0000","last_fullsized":"2024-05-10T14:07:12.072664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:37.969964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074302+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.074302+0000","last_peered":"2024-05-10T14:07:12.074302+0000","last_clean":"2024-05-10T14:07:12.074302+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.074302+0000","last_undegraded":"2024-05-10T14:07:12.074302+0000","last_fullsized":"2024-05-10T14:07:12.074302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:21.570414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074708+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074708+0000","last_peered":"2024-05-10T14:07:12.074708+0000","last_clean":"2024-05-10T14:07:12.074708+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074708+0000","last_undegraded":"2024-05-10T14:07:12.074708+0000","last_fullsized":"2024-05-10T14:07:12.074708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:13:36.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'17","reported_seq":194,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074718+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:12.074718+0000","last_peered":"2024-05-10T14:07:12.074718+0000","last_clean":"2024-05-10T14:07:12.074718+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:12.074718+0000","last_undegraded":"2024-05-10T14:07:12.074718+0000","last_fullsized":"2024-05-10T14:07:12.074718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554724+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:11.554724+0000","last_peered":"2024-05-10T14:07:11.554724+0000","last_clean":"2024-05-10T14:07:11.554724+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:11.554724+0000","last_undegraded":"2024-05-10T14:07:11.554724+0000","last_fullsized":"2024-05-10T14:07:11.554724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:51.031947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548842+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548842+0000","last_peered":"2024-05-10T14:07:11.548842+0000","last_clean":"2024-05-10T14:07:11.548842+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548842+0000","last_undegraded":"2024-05-10T14:07:11.548842+0000","last_fullsized":"2024-05-10T14:07:11.548842+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:58.484385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554074+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554074+0000","last_peered":"2024-05-10T14:07:11.554074+0000","last_clean":"2024-05-10T14:07:11.554074+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554074+0000","last_undegraded":"2024-05-10T14:07:11.554074+0000","last_fullsized":"2024-05-10T14:07:11.554074+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.552986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'15","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554801+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:11.554801+0000","last_peered":"2024-05-10T14:07:11.554801+0000","last_clean":"2024-05-10T14:07:11.554801+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:11.554801+0000","last_undegraded":"2024-05-10T14:07:11.554801+0000","last_fullsized":"2024-05-10T14:07:11.554801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:40.612543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074182+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.074182+0000","last_peered":"2024-05-10T14:07:12.074182+0000","last_clean":"2024-05-10T14:07:12.074182+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.074182+0000","last_undegraded":"2024-05-10T14:07:12.074182+0000","last_fullsized":"2024-05-10T14:07:12.074182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:29.686981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075156+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075156+0000","last_peered":"2024-05-10T14:07:12.075156+0000","last_clean":"2024-05-10T14:07:12.075156+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075156+0000","last_undegraded":"2024-05-10T14:07:12.075156+0000","last_fullsized":"2024-05-10T14:07:12.075156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548961+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.548961+0000","last_peered":"2024-05-10T14:07:11.548961+0000","last_clean":"2024-05-10T14:07:11.548961+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.548961+0000","last_undegraded":"2024-05-10T14:07:11.548961+0000","last_fullsized":"2024-05-10T14:07:11.548961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"81'22","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080460+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:12.080460+0000","last_peered":"2024-05-10T14:07:12.080460+0000","last_clean":"2024-05-10T14:07:12.080460+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:12.080460+0000","last_undegraded":"2024-05-10T14:07:12.080460+0000","last_fullsized":"2024-05-10T14:07:12.080460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548696+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548696+0000","last_peered":"2024-05-10T14:07:11.548696+0000","last_clean":"2024-05-10T14:07:11.548696+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548696+0000","last_undegraded":"2024-05-10T14:07:11.548696+0000","last_fullsized":"2024-05-10T14:07:11.548696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:58.748518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"80'1","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075247+0000","last_change":"2024-05-10T14:04:06.329507+0000","last_active":"2024-05-10T14:07:12.075247+0000","last_peered":"2024-05-10T14:07:12.075247+0000","last_clean":"2024-05-10T14:07:12.075247+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:12.075247+0000","last_undegraded":"2024-05-10T14:07:12.075247+0000","last_fullsized":"2024-05-10T14:07:12.075247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:25.728680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548319+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:11.548319+0000","last_peered":"2024-05-10T14:07:11.548319+0000","last_clean":"2024-05-10T14:07:11.548319+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:11.548319+0000","last_undegraded":"2024-05-10T14:07:11.548319+0000","last_fullsized":"2024-05-10T14:07:11.548319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549295+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:11.549295+0000","last_peered":"2024-05-10T14:07:11.549295+0000","last_clean":"2024-05-10T14:07:11.549295+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:11.549295+0000","last_undegraded":"2024-05-10T14:07:11.549295+0000","last_fullsized":"2024-05-10T14:07:11.549295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:38:11.044801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551032+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551032+0000","last_peered":"2024-05-10T14:07:11.551032+0000","last_clean":"2024-05-10T14:07:11.551032+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551032+0000","last_undegraded":"2024-05-10T14:07:11.551032+0000","last_fullsized":"2024-05-10T14:07:11.551032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:59.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553538+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:11.553538+0000","last_peered":"2024-05-10T14:07:11.553538+0000","last_clean":"2024-05-10T14:07:11.553538+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:11.553538+0000","last_undegraded":"2024-05-10T14:07:11.553538+0000","last_fullsized":"2024-05-10T14:07:11.553538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072872+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:12.072872+0000","last_peered":"2024-05-10T14:07:12.072872+0000","last_clean":"2024-05-10T14:07:12.072872+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:12.072872+0000","last_undegraded":"2024-05-10T14:07:12.072872+0000","last_fullsized":"2024-05-10T14:07:12.072872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:27.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073737+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073737+0000","last_peered":"2024-05-10T14:07:12.073737+0000","last_clean":"2024-05-10T14:07:12.073737+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073737+0000","last_undegraded":"2024-05-10T14:07:12.073737+0000","last_fullsized":"2024-05-10T14:07:12.073737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:04:07.066421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:01.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.553223+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:11.553223+0000","last_peered":"2024-05-10T14:07:11.553223+0000","last_clean":"2024-05-10T14:07:11.553223+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:11.553223+0000","last_undegraded":"2024-05-10T14:07:11.553223+0000","last_fullsized":"2024-05-10T14:07:11.553223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:57.491984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077794+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077794+0000","last_peered":"2024-05-10T14:07:12.077794+0000","last_clean":"2024-05-10T14:07:12.077794+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077794+0000","last_undegraded":"2024-05-10T14:07:12.077794+0000","last_fullsized":"2024-05-10T14:07:12.077794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548579+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:11.548579+0000","last_peered":"2024-05-10T14:07:11.548579+0000","last_clean":"2024-05-10T14:07:11.548579+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:11.548579+0000","last_undegraded":"2024-05-10T14:07:11.548579+0000","last_fullsized":"2024-05-10T14:07:11.548579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:10.456039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075775+0000","last_change":"2024-05-10T14:04:06.329636+0000","last_active":"2024-05-10T14:07:12.075775+0000","last_peered":"2024-05-10T14:07:12.075775+0000","last_clean":"2024-05-10T14:07:12.075775+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:12.075775+0000","last_undegraded":"2024-05-10T14:07:12.075775+0000","last_fullsized":"2024-05-10T14:07:12.075775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:53:09.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077612+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077612+0000","last_peered":"2024-05-10T14:07:12.077612+0000","last_clean":"2024-05-10T14:07:12.077612+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077612+0000","last_undegraded":"2024-05-10T14:07:12.077612+0000","last_fullsized":"2024-05-10T14:07:12.077612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"81'10","reported_seq":46,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079988+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:12.079988+0000","last_peered":"2024-05-10T14:07:12.079988+0000","last_clean":"2024-05-10T14:07:12.079988+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:12.079988+0000","last_undegraded":"2024-05-10T14:07:12.079988+0000","last_fullsized":"2024-05-10T14:07:12.079988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073822+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:12.073822+0000","last_peered":"2024-05-10T14:07:12.073822+0000","last_clean":"2024-05-10T14:07:12.073822+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:12.073822+0000","last_undegraded":"2024-05-10T14:07:12.073822+0000","last_fullsized":"2024-05-10T14:07:12.073822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:16.077857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.547951+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:11.547951+0000","last_peered":"2024-05-10T14:07:11.547951+0000","last_clean":"2024-05-10T14:07:11.547951+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:11.547951+0000","last_undegraded":"2024-05-10T14:07:11.547951+0000","last_fullsized":"2024-05-10T14:07:11.547951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:17.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074716+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074716+0000","last_peered":"2024-05-10T14:07:12.074716+0000","last_clean":"2024-05-10T14:07:12.074716+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074716+0000","last_undegraded":"2024-05-10T14:07:12.074716+0000","last_fullsized":"2024-05-10T14:07:12.074716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:08.580401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"81'14","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074052+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:12.074052+0000","last_peered":"2024-05-10T14:07:12.074052+0000","last_clean":"2024-05-10T14:07:12.074052+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:12.074052+0000","last_undegraded":"2024-05-10T14:07:12.074052+0000","last_fullsized":"2024-05-10T14:07:12.074052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552492+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:11.552492+0000","last_peered":"2024-05-10T14:07:11.552492+0000","last_clean":"2024-05-10T14:07:11.552492+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:11.552492+0000","last_undegraded":"2024-05-10T14:07:11.552492+0000","last_fullsized":"2024-05-10T14:07:11.552492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:30.109026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074867+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074867+0000","last_peered":"2024-05-10T14:07:12.074867+0000","last_clean":"2024-05-10T14:07:12.074867+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074867+0000","last_undegraded":"2024-05-10T14:07:12.074867+0000","last_fullsized":"2024-05-10T14:07:12.074867+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:45.875457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073037+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073037+0000","last_peered":"2024-05-10T14:07:12.073037+0000","last_clean":"2024-05-10T14:07:12.073037+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073037+0000","last_undegraded":"2024-05-10T14:07:12.073037+0000","last_fullsized":"2024-05-10T14:07:12.073037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"81'16","reported_seq":52,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082680+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:12.082680+0000","last_peered":"2024-05-10T14:07:12.082680+0000","last_clean":"2024-05-10T14:07:12.082680+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:12.082680+0000","last_undegraded":"2024-05-10T14:07:12.082680+0000","last_fullsized":"2024-05-10T14:07:12.082680+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077404+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077404+0000","last_peered":"2024-05-10T14:07:12.077404+0000","last_clean":"2024-05-10T14:07:12.077404+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077404+0000","last_undegraded":"2024-05-10T14:07:12.077404+0000","last_fullsized":"2024-05-10T14:07:12.077404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550664+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550664+0000","last_peered":"2024-05-10T14:07:11.550664+0000","last_clean":"2024-05-10T14:07:11.550664+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550664+0000","last_undegraded":"2024-05-10T14:07:11.550664+0000","last_fullsized":"2024-05-10T14:07:11.550664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":58,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551820+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551820+0000","last_peered":"2024-05-10T14:07:11.551820+0000","last_clean":"2024-05-10T14:07:11.551820+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551820+0000","last_undegraded":"2024-05-10T14:07:11.551820+0000","last_fullsized":"2024-05-10T14:07:11.551820+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:23.429115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"81'12","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554939+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:11.554939+0000","last_peered":"2024-05-10T14:07:11.554939+0000","last_clean":"2024-05-10T14:07:11.554939+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:11.554939+0000","last_undegraded":"2024-05-10T14:07:11.554939+0000","last_fullsized":"2024-05-10T14:07:11.554939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556160+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556160+0000","last_peered":"2024-05-10T14:07:11.556160+0000","last_clean":"2024-05-10T14:07:11.556160+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556160+0000","last_undegraded":"2024-05-10T14:07:11.556160+0000","last_fullsized":"2024-05-10T14:07:11.556160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:11.576296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073897+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073897+0000","last_peered":"2024-05-10T14:07:12.073897+0000","last_clean":"2024-05-10T14:07:12.073897+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073897+0000","last_undegraded":"2024-05-10T14:07:12.073897+0000","last_fullsized":"2024-05-10T14:07:12.073897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'15","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081383+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:12.081383+0000","last_peered":"2024-05-10T14:07:12.081383+0000","last_clean":"2024-05-10T14:07:12.081383+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:12.081383+0000","last_undegraded":"2024-05-10T14:07:12.081383+0000","last_fullsized":"2024-05-10T14:07:12.081383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"81'16","reported_seq":214,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074906+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:12.074906+0000","last_peered":"2024-05-10T14:07:12.074906+0000","last_clean":"2024-05-10T14:07:12.074906+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:12.074906+0000","last_undegraded":"2024-05-10T14:07:12.074906+0000","last_fullsized":"2024-05-10T14:07:12.074906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073264+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073264+0000","last_peered":"2024-05-10T14:07:12.073264+0000","last_clean":"2024-05-10T14:07:12.073264+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073264+0000","last_undegraded":"2024-05-10T14:07:12.073264+0000","last_fullsized":"2024-05-10T14:07:12.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"81'10","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073160+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:12.073160+0000","last_peered":"2024-05-10T14:07:12.073160+0000","last_clean":"2024-05-10T14:07:12.073160+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:12.073160+0000","last_undegraded":"2024-05-10T14:07:12.073160+0000","last_fullsized":"2024-05-10T14:07:12.073160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:42.438907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551248+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551248+0000","last_peered":"2024-05-10T14:07:11.551248+0000","last_clean":"2024-05-10T14:07:11.551248+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551248+0000","last_undegraded":"2024-05-10T14:07:11.551248+0000","last_fullsized":"2024-05-10T14:07:11.551248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:15.770998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548996+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:11.548996+0000","last_peered":"2024-05-10T14:07:11.548996+0000","last_clean":"2024-05-10T14:07:11.548996+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:11.548996+0000","last_undegraded":"2024-05-10T14:07:11.548996+0000","last_fullsized":"2024-05-10T14:07:11.548996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552102+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552102+0000","last_peered":"2024-05-10T14:07:11.552102+0000","last_clean":"2024-05-10T14:07:11.552102+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552102+0000","last_undegraded":"2024-05-10T14:07:11.552102+0000","last_fullsized":"2024-05-10T14:07:11.552102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:57.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"81'6","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554640+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:11.554640+0000","last_peered":"2024-05-10T14:07:11.554640+0000","last_clean":"2024-05-10T14:07:11.554640+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:11.554640+0000","last_undegraded":"2024-05-10T14:07:11.554640+0000","last_fullsized":"2024-05-10T14:07:11.554640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.339148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548815+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548815+0000","last_peered":"2024-05-10T14:07:11.548815+0000","last_clean":"2024-05-10T14:07:11.548815+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548815+0000","last_undegraded":"2024-05-10T14:07:11.548815+0000","last_fullsized":"2024-05-10T14:07:11.548815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075683+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075683+0000","last_peered":"2024-05-10T14:07:12.075683+0000","last_clean":"2024-05-10T14:07:12.075683+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075683+0000","last_undegraded":"2024-05-10T14:07:12.075683+0000","last_fullsized":"2024-05-10T14:07:12.075683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:02:35.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"81'10","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548974+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:11.548974+0000","last_peered":"2024-05-10T14:07:11.548974+0000","last_clean":"2024-05-10T14:07:11.548974+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:11.548974+0000","last_undegraded":"2024-05-10T14:07:11.548974+0000","last_fullsized":"2024-05-10T14:07:11.548974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073748+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073748+0000","last_peered":"2024-05-10T14:07:12.073748+0000","last_clean":"2024-05-10T14:07:12.073748+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073748+0000","last_undegraded":"2024-05-10T14:07:12.073748+0000","last_fullsized":"2024-05-10T14:07:12.073748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551825+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551825+0000","last_peered":"2024-05-10T14:07:11.551825+0000","last_clean":"2024-05-10T14:07:11.551825+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551825+0000","last_undegraded":"2024-05-10T14:07:11.551825+0000","last_fullsized":"2024-05-10T14:07:11.551825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551625+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551625+0000","last_peered":"2024-05-10T14:07:11.551625+0000","last_clean":"2024-05-10T14:07:11.551625+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551625+0000","last_undegraded":"2024-05-10T14:07:11.551625+0000","last_fullsized":"2024-05-10T14:07:11.551625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:06.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074123+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074123+0000","last_peered":"2024-05-10T14:07:12.074123+0000","last_clean":"2024-05-10T14:07:12.074123+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074123+0000","last_undegraded":"2024-05-10T14:07:12.074123+0000","last_fullsized":"2024-05-10T14:07:12.074123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:30.812476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554033+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554033+0000","last_peered":"2024-05-10T14:07:11.554033+0000","last_clean":"2024-05-10T14:07:11.554033+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554033+0000","last_undegraded":"2024-05-10T14:07:11.554033+0000","last_fullsized":"2024-05-10T14:07:11.554033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:10:20.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550568+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550568+0000","last_peered":"2024-05-10T14:07:11.550568+0000","last_clean":"2024-05-10T14:07:11.550568+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550568+0000","last_undegraded":"2024-05-10T14:07:11.550568+0000","last_fullsized":"2024-05-10T14:07:11.550568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:27.784903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548734+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548734+0000","last_peered":"2024-05-10T14:07:11.548734+0000","last_clean":"2024-05-10T14:07:11.548734+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548734+0000","last_undegraded":"2024-05-10T14:07:11.548734+0000","last_fullsized":"2024-05-10T14:07:11.548734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554459+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554459+0000","last_peered":"2024-05-10T14:07:11.554459+0000","last_clean":"2024-05-10T14:07:11.554459+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554459+0000","last_undegraded":"2024-05-10T14:07:11.554459+0000","last_fullsized":"2024-05-10T14:07:11.554459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.378628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075630+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.075630+0000","last_peered":"2024-05-10T14:07:12.075630+0000","last_clean":"2024-05-10T14:07:12.075630+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.075630+0000","last_undegraded":"2024-05-10T14:07:12.075630+0000","last_fullsized":"2024-05-10T14:07:12.075630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549103+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549103+0000","last_peered":"2024-05-10T14:07:11.549103+0000","last_clean":"2024-05-10T14:07:11.549103+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549103+0000","last_undegraded":"2024-05-10T14:07:11.549103+0000","last_fullsized":"2024-05-10T14:07:11.549103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555318+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555318+0000","last_peered":"2024-05-10T14:07:11.555318+0000","last_clean":"2024-05-10T14:07:11.555318+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555318+0000","last_undegraded":"2024-05-10T14:07:11.555318+0000","last_fullsized":"2024-05-10T14:07:11.555318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:19.090100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":229,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552097+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552097+0000","last_peered":"2024-05-10T14:07:11.552097+0000","last_clean":"2024-05-10T14:07:11.552097+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552097+0000","last_undegraded":"2024-05-10T14:07:11.552097+0000","last_fullsized":"2024-05-10T14:07:11.552097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:17.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074350+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074350+0000","last_peered":"2024-05-10T14:07:12.074350+0000","last_clean":"2024-05-10T14:07:12.074350+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074350+0000","last_undegraded":"2024-05-10T14:07:12.074350+0000","last_fullsized":"2024-05-10T14:07:12.074350+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:17.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073526+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073526+0000","last_peered":"2024-05-10T14:07:12.073526+0000","last_clean":"2024-05-10T14:07:12.073526+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073526+0000","last_undegraded":"2024-05-10T14:07:12.073526+0000","last_fullsized":"2024-05-10T14:07:12.073526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548647+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548647+0000","last_peered":"2024-05-10T14:07:11.548647+0000","last_clean":"2024-05-10T14:07:11.548647+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548647+0000","last_undegraded":"2024-05-10T14:07:11.548647+0000","last_fullsized":"2024-05-10T14:07:11.548647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556094+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:11.556094+0000","last_peered":"2024-05-10T14:07:11.556094+0000","last_clean":"2024-05-10T14:07:11.556094+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:11.556094+0000","last_undegraded":"2024-05-10T14:07:11.556094+0000","last_fullsized":"2024-05-10T14:07:11.556094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075494+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:12.075494+0000","last_peered":"2024-05-10T14:07:12.075494+0000","last_clean":"2024-05-10T14:07:12.075494+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:12.075494+0000","last_undegraded":"2024-05-10T14:07:12.075494+0000","last_fullsized":"2024-05-10T14:07:12.075494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":692,"num_read_kb":451,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710760,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41252,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39176,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332664,"statfs":{"total":96636764160,"available":96596647936,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509505,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37736,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334104,"statfs":{"total":96636764160,"available":96598122496,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:18.913 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T14:07:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:19.251 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":151,"fsid":"1bde99e9-eb8f-4424-90fa-e3ab2b41b8b9","created":"2024-05-10T14:02:05.240552+0000","modified":"2024-05-10T14:07:11.541491+0000","last_up_change":"2024-05-10T14:04:05.266195+0000","last_in_change":"2024-05-10T14:06:55.297244+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T14:02:18.137473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T14:02:23.522518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T14:02:29.396923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T14:02:30.972010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T14:02:32.919979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T14:02:34.837119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T14:02:36.725909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T14:02:38.855802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f64c785c-eaab-4e55-836b-580d80434ea8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6825","nonce":3410152266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6827","nonce":3410152266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6831","nonce":3410152266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3410152266},{"type":"v1","addr":"172.21.15.16:6829","nonce":3410152266}]},"public_addr":"172.21.15.16:6825/3410152266","cluster_addr":"172.21.15.16:6827/3410152266","heartbeat_back_addr":"172.21.15.16:6831/3410152266","heartbeat_front_addr":"172.21.15.16:6829/3410152266","state":["exists","up"]},{"osd":1,"uuid":"db35bdb1-1358-4158-9dc4-7ffac65632fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6801","nonce":54311254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6803","nonce":54311254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6807","nonce":54311254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":54311254},{"type":"v1","addr":"172.21.15.16:6805","nonce":54311254}]},"public_addr":"172.21.15.16:6801/54311254","cluster_addr":"172.21.15.16:6803/54311254","heartbeat_back_addr":"172.21.15.16:6807/54311254","heartbeat_front_addr":"172.21.15.16:6805/54311254","state":["exists","up"]},{"osd":2,"uuid":"28c46e2b-cef4-4688-956e-8da9955e626a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971206838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6819","nonce":2971206838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6823","nonce":2971206838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2971206838},{"type":"v1","addr":"172.21.15.16:6821","nonce":2971206838}]},"public_addr":"172.21.15.16:6817/2971206838","cluster_addr":"172.21.15.16:6819/2971206838","heartbeat_back_addr":"172.21.15.16:6823/2971206838","heartbeat_front_addr":"172.21.15.16:6821/2971206838","state":["exists","up"]},{"osd":3,"uuid":"0032870c-d3a1-43dd-9fc9-b4091efab1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6809","nonce":1375538686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6811","nonce":1375538686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6815","nonce":1375538686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1375538686},{"type":"v1","addr":"172.21.15.16:6813","nonce":1375538686}]},"public_addr":"172.21.15.16:6809/1375538686","cluster_addr":"172.21.15.16:6811/1375538686","heartbeat_back_addr":"172.21.15.16:6815/1375538686","heartbeat_front_addr":"172.21.15.16:6813/1375538686","state":["exists","up"]},{"osd":4,"uuid":"2d515a59-3855-4fbe-a1e4-8c6296681688","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6801","nonce":2365858723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6804","nonce":2365858723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6812","nonce":2365858723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2365858723},{"type":"v1","addr":"172.21.15.130:6808","nonce":2365858723}]},"public_addr":"172.21.15.130:6801/2365858723","cluster_addr":"172.21.15.130:6804/2365858723","heartbeat_back_addr":"172.21.15.130:6812/2365858723","heartbeat_front_addr":"172.21.15.130:6808/2365858723","state":["exists","up"]},{"osd":5,"uuid":"13696b08-e381-4169-8842-acf9b90c0025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":55,"up_from":70,"up_thru":135,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6817","nonce":3659833369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6819","nonce":3659833369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6823","nonce":3659833369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3659833369},{"type":"v1","addr":"172.21.15.130:6821","nonce":3659833369}]},"public_addr":"172.21.15.130:6817/3659833369","cluster_addr":"172.21.15.130:6819/3659833369","heartbeat_back_addr":"172.21.15.130:6823/3659833369","heartbeat_front_addr":"172.21.15.130:6821/3659833369","state":["exists","up"]},{"osd":6,"uuid":"85508497-b5a2-42b4-88fb-10a4884bc5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6825","nonce":111783121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6827","nonce":111783121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6831","nonce":111783121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":111783121},{"type":"v1","addr":"172.21.15.130:6829","nonce":111783121}]},"public_addr":"172.21.15.130:6825/111783121","cluster_addr":"172.21.15.130:6827/111783121","heartbeat_back_addr":"172.21.15.130:6831/111783121","heartbeat_front_addr":"172.21.15.130:6829/111783121","state":["exists","up"]},{"osd":7,"uuid":"c2edb963-9e6f-45d7-a4a8-27287ec42c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6805","nonce":2943413119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6809","nonce":2943413119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6815","nonce":2943413119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2943413119},{"type":"v1","addr":"172.21.15.130:6813","nonce":2943413119}]},"public_addr":"172.21.15.130:6805/2943413119","cluster_addr":"172.21.15.130:6809/2943413119","heartbeat_back_addr":"172.21.15.130:6815/2943413119","heartbeat_front_addr":"172.21.15.130:6813/2943413119","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.119223+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:12.952675+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.237065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.190030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.261800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.095723+0000","dead_epoch":56},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.214564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T14:02:13.277528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T14:07:20.269 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T14:07:20.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:20.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-10T14:07:20.435 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:20.435 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:20.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T14:07:20.753 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T14:07:20.774 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T14:07:20.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:20.919 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:20.919 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:20.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T14:07:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T14:07:21.245 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T14:07:21.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:21.396 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:21.397 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:21.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T14:07:21.692 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T14:07:21.711 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T14:07:21.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:21.854 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:21.855 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:21.855 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:21.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T14:07:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T14:07:22.183 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T14:07:22.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:22.330 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:22.330 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:22.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T14:07:22.633 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T14:07:22.651 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T14:07:22.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:22.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:22.793 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:22.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T14:07:23.087 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T14:07:23.105 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T14:07:23.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:23.260 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:23.261 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:23.261 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:23.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T14:07:23.572 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T14:07:23.593 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T14:07:23.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T14:07:23.754 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-10T14:07:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T14:07:23.755 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-10T14:07:23.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T14:07:24.067 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T14:07:24.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:24.439 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:24.445 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:24.459 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-05-10T14:07:24.221340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1042,"num_read_kb":785,"num_write":639,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302664,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672056,"statfs":{"total":773094113280,"available":772784185344,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005426"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083417+0000","last_change":"2024-05-10T14:06:56.367845+0000","last_active":"2024-05-10T14:07:12.083417+0000","last_peered":"2024-05-10T14:07:12.083417+0000","last_clean":"2024-05-10T14:07:12.083417+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:12.083417+0000","last_undegraded":"2024-05-10T14:07:12.083417+0000","last_fullsized":"2024-05-10T14:07:12.083417+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:50.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074720+0000","last_change":"2024-05-10T14:04:06.312669+0000","last_active":"2024-05-10T14:07:12.074720+0000","last_peered":"2024-05-10T14:07:12.074720+0000","last_clean":"2024-05-10T14:07:12.074720+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:12.074720+0000","last_undegraded":"2024-05-10T14:07:12.074720+0000","last_fullsized":"2024-05-10T14:07:12.074720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:42.551541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074970+0000","last_change":"2024-05-10T14:02:30.632298+0000","last_active":"2024-05-10T14:07:12.074970+0000","last_peered":"2024-05-10T14:07:12.074970+0000","last_clean":"2024-05-10T14:07:12.074970+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:12.074970+0000","last_undegraded":"2024-05-10T14:07:12.074970+0000","last_fullsized":"2024-05-10T14:07:12.074970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:50:10.714621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081650+0000","last_change":"2024-05-10T14:06:56.384708+0000","last_active":"2024-05-10T14:07:12.081650+0000","last_peered":"2024-05-10T14:07:12.081650+0000","last_clean":"2024-05-10T14:07:12.081650+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:12.081650+0000","last_undegraded":"2024-05-10T14:07:12.081650+0000","last_fullsized":"2024-05-10T14:07:12.081650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:50.891945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074103+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074103+0000","last_peered":"2024-05-10T14:07:12.074103+0000","last_clean":"2024-05-10T14:07:12.074103+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074103+0000","last_undegraded":"2024-05-10T14:07:12.074103+0000","last_fullsized":"2024-05-10T14:07:12.074103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550329+0000","last_change":"2024-05-10T14:02:32.691803+0000","last_active":"2024-05-10T14:07:11.550329+0000","last_peered":"2024-05-10T14:07:11.550329+0000","last_clean":"2024-05-10T14:07:11.550329+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:11.550329+0000","last_undegraded":"2024-05-10T14:07:11.550329+0000","last_fullsized":"2024-05-10T14:07:11.550329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.005720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075926+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.075926+0000","last_peered":"2024-05-10T14:07:12.075926+0000","last_clean":"2024-05-10T14:07:12.075926+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.075926+0000","last_undegraded":"2024-05-10T14:07:12.075926+0000","last_fullsized":"2024-05-10T14:07:12.075926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:59:39.976561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074060+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:12.074060+0000","last_peered":"2024-05-10T14:07:12.074060+0000","last_clean":"2024-05-10T14:07:12.074060+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:12.074060+0000","last_undegraded":"2024-05-10T14:07:12.074060+0000","last_fullsized":"2024-05-10T14:07:12.074060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079815+0000","last_change":"2024-05-10T14:06:56.369834+0000","last_active":"2024-05-10T14:07:12.079815+0000","last_peered":"2024-05-10T14:07:12.079815+0000","last_clean":"2024-05-10T14:07:12.079815+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:12.079815+0000","last_undegraded":"2024-05-10T14:07:12.079815+0000","last_fullsized":"2024-05-10T14:07:12.079815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:53.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078692+0000","last_change":"2024-05-10T14:02:32.681418+0000","last_active":"2024-05-10T14:07:12.078692+0000","last_peered":"2024-05-10T14:07:12.078692+0000","last_clean":"2024-05-10T14:07:12.078692+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:12.078692+0000","last_undegraded":"2024-05-10T14:07:12.078692+0000","last_fullsized":"2024-05-10T14:07:12.078692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:13.194880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075200+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075200+0000","last_peered":"2024-05-10T14:07:12.075200+0000","last_clean":"2024-05-10T14:07:12.075200+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075200+0000","last_undegraded":"2024-05-10T14:07:12.075200+0000","last_fullsized":"2024-05-10T14:07:12.075200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:26.443339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549471+0000","last_change":"2024-05-10T14:02:32.694036+0000","last_active":"2024-05-10T14:07:11.549471+0000","last_peered":"2024-05-10T14:07:11.549471+0000","last_clean":"2024-05-10T14:07:11.549471+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:11.549471+0000","last_undegraded":"2024-05-10T14:07:11.549471+0000","last_fullsized":"2024-05-10T14:07:11.549471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:55.577611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080767+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080767+0000","last_peered":"2024-05-10T14:07:12.080767+0000","last_clean":"2024-05-10T14:07:12.080767+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080767+0000","last_undegraded":"2024-05-10T14:07:12.080767+0000","last_fullsized":"2024-05-10T14:07:12.080767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078526+0000","last_change":"2024-05-10T14:04:06.321698+0000","last_active":"2024-05-10T14:07:12.078526+0000","last_peered":"2024-05-10T14:07:12.078526+0000","last_clean":"2024-05-10T14:07:12.078526+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:12.078526+0000","last_undegraded":"2024-05-10T14:07:12.078526+0000","last_fullsized":"2024-05-10T14:07:12.078526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:52.228649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548389+0000","last_change":"2024-05-10T14:04:06.306820+0000","last_active":"2024-05-10T14:07:11.548389+0000","last_peered":"2024-05-10T14:07:11.548389+0000","last_clean":"2024-05-10T14:07:11.548389+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:11.548389+0000","last_undegraded":"2024-05-10T14:07:11.548389+0000","last_fullsized":"2024-05-10T14:07:11.548389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556028+0000","last_change":"2024-05-10T14:02:32.676382+0000","last_active":"2024-05-10T14:07:11.556028+0000","last_peered":"2024-05-10T14:07:11.556028+0000","last_clean":"2024-05-10T14:07:11.556028+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:11.556028+0000","last_undegraded":"2024-05-10T14:07:11.556028+0000","last_fullsized":"2024-05-10T14:07:11.556028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549205+0000","last_change":"2024-05-10T14:02:32.692544+0000","last_active":"2024-05-10T14:07:11.549205+0000","last_peered":"2024-05-10T14:07:11.549205+0000","last_clean":"2024-05-10T14:07:11.549205+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:11.549205+0000","last_undegraded":"2024-05-10T14:07:11.549205+0000","last_fullsized":"2024-05-10T14:07:11.549205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:23.689528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083567+0000","last_change":"2024-05-10T14:06:56.361334+0000","last_active":"2024-05-10T14:07:12.083567+0000","last_peered":"2024-05-10T14:07:12.083567+0000","last_clean":"2024-05-10T14:07:12.083567+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:12.083567+0000","last_undegraded":"2024-05-10T14:07:12.083567+0000","last_fullsized":"2024-05-10T14:07:12.083567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:37.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":40,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081404+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081404+0000","last_peered":"2024-05-10T14:07:12.081404+0000","last_clean":"2024-05-10T14:07:12.081404+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081404+0000","last_undegraded":"2024-05-10T14:07:12.081404+0000","last_fullsized":"2024-05-10T14:07:12.081404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:10.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081529+0000","last_change":"2024-05-10T14:04:06.319636+0000","last_active":"2024-05-10T14:07:12.081529+0000","last_peered":"2024-05-10T14:07:12.081529+0000","last_clean":"2024-05-10T14:07:12.081529+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:12.081529+0000","last_undegraded":"2024-05-10T14:07:12.081529+0000","last_fullsized":"2024-05-10T14:07:12.081529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:03:56.983759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075909+0000","last_change":"2024-05-10T14:04:06.322535+0000","last_active":"2024-05-10T14:07:12.075909+0000","last_peered":"2024-05-10T14:07:12.075909+0000","last_clean":"2024-05-10T14:07:12.075909+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:12.075909+0000","last_undegraded":"2024-05-10T14:07:12.075909+0000","last_fullsized":"2024-05-10T14:07:12.075909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:31.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079884+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:12.079884+0000","last_peered":"2024-05-10T14:07:12.079884+0000","last_clean":"2024-05-10T14:07:12.079884+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:12.079884+0000","last_undegraded":"2024-05-10T14:07:12.079884+0000","last_fullsized":"2024-05-10T14:07:12.079884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:17.720514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.696271+0000","last_change":"2024-05-10T14:02:32.668085+0000","last_active":"2024-05-10T14:07:21.696271+0000","last_peered":"2024-05-10T14:07:21.696271+0000","last_clean":"2024-05-10T14:07:21.696271+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:21.696271+0000","last_undegraded":"2024-05-10T14:07:21.696271+0000","last_fullsized":"2024-05-10T14:07:21.696271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550665+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:11.550665+0000","last_peered":"2024-05-10T14:07:11.550665+0000","last_clean":"2024-05-10T14:07:11.550665+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:11.550665+0000","last_undegraded":"2024-05-10T14:07:11.550665+0000","last_fullsized":"2024-05-10T14:07:11.550665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:16:48.286053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.696614+0000","last_change":"2024-05-10T14:02:32.675706+0000","last_active":"2024-05-10T14:07:21.696614+0000","last_peered":"2024-05-10T14:07:21.696614+0000","last_clean":"2024-05-10T14:07:21.696614+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:21.696614+0000","last_undegraded":"2024-05-10T14:07:21.696614+0000","last_fullsized":"2024-05-10T14:07:21.696614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167441+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:22.167441+0000","last_peered":"2024-05-10T14:07:22.167441+0000","last_clean":"2024-05-10T14:07:22.167441+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:22.167441+0000","last_undegraded":"2024-05-10T14:07:22.167441+0000","last_fullsized":"2024-05-10T14:07:22.167441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549641+0000","last_change":"2024-05-10T14:02:32.693784+0000","last_active":"2024-05-10T14:07:11.549641+0000","last_peered":"2024-05-10T14:07:11.549641+0000","last_clean":"2024-05-10T14:07:11.549641+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:11.549641+0000","last_undegraded":"2024-05-10T14:07:11.549641+0000","last_fullsized":"2024-05-10T14:07:11.549641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:38:19.473942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174408+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.174408+0000","last_peered":"2024-05-10T14:07:12.174408+0000","last_clean":"2024-05-10T14:07:12.174408+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.174408+0000","last_undegraded":"2024-05-10T14:07:12.174408+0000","last_fullsized":"2024-05-10T14:07:12.174408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548228+0000","last_change":"2024-05-10T14:02:40.723356+0000","last_active":"2024-05-10T14:07:11.548228+0000","last_peered":"2024-05-10T14:07:11.548228+0000","last_clean":"2024-05-10T14:07:11.548228+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:11.548228+0000","last_undegraded":"2024-05-10T14:07:11.548228+0000","last_fullsized":"2024-05-10T14:07:11.548228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:16.366203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":59,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555117+0000","last_change":"2024-05-10T14:06:12.294568+0000","last_active":"2024-05-10T14:07:11.555117+0000","last_peered":"2024-05-10T14:07:11.555117+0000","last_clean":"2024-05-10T14:07:11.555117+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:11.555117+0000","last_undegraded":"2024-05-10T14:07:11.555117+0000","last_fullsized":"2024-05-10T14:07:11.555117+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080221+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080221+0000","last_peered":"2024-05-10T14:07:12.080221+0000","last_clean":"2024-05-10T14:07:12.080221+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080221+0000","last_undegraded":"2024-05-10T14:07:12.080221+0000","last_fullsized":"2024-05-10T14:07:12.080221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:09.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077024+0000","last_change":"2024-05-10T14:04:06.321829+0000","last_active":"2024-05-10T14:07:12.077024+0000","last_peered":"2024-05-10T14:07:12.077024+0000","last_clean":"2024-05-10T14:07:12.077024+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:12.077024+0000","last_undegraded":"2024-05-10T14:07:12.077024+0000","last_fullsized":"2024-05-10T14:07:12.077024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:13.845767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"151'13","reported_seq":305,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.664349+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:17.664349+0000","last_peered":"2024-05-10T14:07:17.664349+0000","last_clean":"2024-05-10T14:07:17.664349+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:17.664349+0000","last_undegraded":"2024-05-10T14:07:17.664349+0000","last_fullsized":"2024-05-10T14:07:17.664349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083975+0000","last_change":"2024-05-10T14:06:56.361662+0000","last_active":"2024-05-10T14:07:12.083975+0000","last_peered":"2024-05-10T14:07:12.083975+0000","last_clean":"2024-05-10T14:07:12.083975+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:12.083975+0000","last_undegraded":"2024-05-10T14:07:12.083975+0000","last_fullsized":"2024-05-10T14:07:12.083975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:14.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'1","reported_seq":178,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074393+0000","last_change":"2024-05-10T14:04:06.312805+0000","last_active":"2024-05-10T14:07:12.074393+0000","last_peered":"2024-05-10T14:07:12.074393+0000","last_clean":"2024-05-10T14:07:12.074393+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:12.074393+0000","last_undegraded":"2024-05-10T14:07:12.074393+0000","last_fullsized":"2024-05-10T14:07:12.074393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:57.106229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076430+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076430+0000","last_peered":"2024-05-10T14:07:12.076430+0000","last_clean":"2024-05-10T14:07:12.076430+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076430+0000","last_undegraded":"2024-05-10T14:07:12.076430+0000","last_fullsized":"2024-05-10T14:07:12.076430+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:13.031184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072490+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072490+0000","last_peered":"2024-05-10T14:07:12.072490+0000","last_clean":"2024-05-10T14:07:12.072490+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072490+0000","last_undegraded":"2024-05-10T14:07:12.072490+0000","last_fullsized":"2024-05-10T14:07:12.072490+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:24.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.172429+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:17.172429+0000","last_peered":"2024-05-10T14:07:17.172429+0000","last_clean":"2024-05-10T14:07:17.172429+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:17.172429+0000","last_undegraded":"2024-05-10T14:07:17.172429+0000","last_fullsized":"2024-05-10T14:07:17.172429+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549943+0000","last_change":"2024-05-10T14:02:36.698442+0000","last_active":"2024-05-10T14:07:11.549943+0000","last_peered":"2024-05-10T14:07:11.549943+0000","last_clean":"2024-05-10T14:07:11.549943+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:11.549943+0000","last_undegraded":"2024-05-10T14:07:11.549943+0000","last_fullsized":"2024-05-10T14:07:11.549943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:55.226684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549752+0000","last_change":"2024-05-10T14:02:38.717148+0000","last_active":"2024-05-10T14:07:11.549752+0000","last_peered":"2024-05-10T14:07:11.549752+0000","last_clean":"2024-05-10T14:07:11.549752+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:11.549752+0000","last_undegraded":"2024-05-10T14:07:11.549752+0000","last_fullsized":"2024-05-10T14:07:11.549752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:43.220899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073675+0000","last_change":"2024-05-10T14:02:40.716451+0000","last_active":"2024-05-10T14:07:12.073675+0000","last_peered":"2024-05-10T14:07:12.073675+0000","last_clean":"2024-05-10T14:07:12.073675+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:12.073675+0000","last_undegraded":"2024-05-10T14:07:12.073675+0000","last_fullsized":"2024-05-10T14:07:12.073675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.756824+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:20.756824+0000","last_peered":"2024-05-10T14:07:20.756824+0000","last_clean":"2024-05-10T14:07:20.756824+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:20.756824+0000","last_undegraded":"2024-05-10T14:07:20.756824+0000","last_fullsized":"2024-05-10T14:07:20.756824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080521+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080521+0000","last_peered":"2024-05-10T14:07:12.080521+0000","last_clean":"2024-05-10T14:07:12.080521+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080521+0000","last_undegraded":"2024-05-10T14:07:12.080521+0000","last_fullsized":"2024-05-10T14:07:12.080521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:39.380541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555045+0000","last_change":"2024-05-10T14:02:34.689573+0000","last_active":"2024-05-10T14:07:11.555045+0000","last_peered":"2024-05-10T14:07:11.555045+0000","last_clean":"2024-05-10T14:07:11.555045+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:11.555045+0000","last_undegraded":"2024-05-10T14:07:11.555045+0000","last_fullsized":"2024-05-10T14:07:11.555045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.159609+0000","last_change":"2024-05-10T14:02:36.699564+0000","last_active":"2024-05-10T14:07:17.159609+0000","last_peered":"2024-05-10T14:07:17.159609+0000","last_clean":"2024-05-10T14:07:17.159609+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:17.159609+0000","last_undegraded":"2024-05-10T14:07:17.159609+0000","last_fullsized":"2024-05-10T14:07:17.159609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"151'18","reported_seq":43,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.325836+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:17.325836+0000","last_peered":"2024-05-10T14:07:17.325836+0000","last_clean":"2024-05-10T14:07:17.325836+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:17.325836+0000","last_undegraded":"2024-05-10T14:07:17.325836+0000","last_fullsized":"2024-05-10T14:07:17.325836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:30:56.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549124+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:11.549124+0000","last_peered":"2024-05-10T14:07:11.549124+0000","last_clean":"2024-05-10T14:07:11.549124+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:11.549124+0000","last_undegraded":"2024-05-10T14:07:11.549124+0000","last_fullsized":"2024-05-10T14:07:11.549124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.625058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167556+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:22.167556+0000","last_peered":"2024-05-10T14:07:22.167556+0000","last_clean":"2024-05-10T14:07:22.167556+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:22.167556+0000","last_undegraded":"2024-05-10T14:07:22.167556+0000","last_fullsized":"2024-05-10T14:07:22.167556+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075819+0000","last_change":"2024-05-10T14:02:30.660441+0000","last_active":"2024-05-10T14:07:12.075819+0000","last_peered":"2024-05-10T14:07:12.075819+0000","last_clean":"2024-05-10T14:07:12.075819+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:12.075819+0000","last_undegraded":"2024-05-10T14:07:12.075819+0000","last_fullsized":"2024-05-10T14:07:12.075819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:51:11.573969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079811+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079811+0000","last_peered":"2024-05-10T14:07:12.079811+0000","last_clean":"2024-05-10T14:07:12.079811+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079811+0000","last_undegraded":"2024-05-10T14:07:12.079811+0000","last_fullsized":"2024-05-10T14:07:12.079811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:50.911955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"151'13","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.618327+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:17.618327+0000","last_peered":"2024-05-10T14:07:17.618327+0000","last_clean":"2024-05-10T14:07:17.618327+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:17.618327+0000","last_undegraded":"2024-05-10T14:07:17.618327+0000","last_fullsized":"2024-05-10T14:07:17.618327+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:33:46.506383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"151'18","reported_seq":298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.168046+0000","last_change":"2024-05-10T14:02:38.700623+0000","last_active":"2024-05-10T14:07:22.168046+0000","last_peered":"2024-05-10T14:07:22.168046+0000","last_clean":"2024-05-10T14:07:22.168046+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:22.168046+0000","last_undegraded":"2024-05-10T14:07:22.168046+0000","last_fullsized":"2024-05-10T14:07:22.168046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074287+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074287+0000","last_peered":"2024-05-10T14:07:12.074287+0000","last_clean":"2024-05-10T14:07:12.074287+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074287+0000","last_undegraded":"2024-05-10T14:07:12.074287+0000","last_fullsized":"2024-05-10T14:07:12.074287+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:25.224869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083282+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083282+0000","last_peered":"2024-05-10T14:07:12.083282+0000","last_clean":"2024-05-10T14:07:12.083282+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083282+0000","last_undegraded":"2024-05-10T14:07:12.083282+0000","last_fullsized":"2024-05-10T14:07:12.083282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:47.271937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081167+0000","last_change":"2024-05-10T14:06:56.367827+0000","last_active":"2024-05-10T14:07:12.081167+0000","last_peered":"2024-05-10T14:07:12.081167+0000","last_clean":"2024-05-10T14:07:12.081167+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:12.081167+0000","last_undegraded":"2024-05-10T14:07:12.081167+0000","last_fullsized":"2024-05-10T14:07:12.081167+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:55.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"151'23","reported_seq":227,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.440329+0000","last_change":"2024-05-10T14:04:06.317774+0000","last_active":"2024-05-10T14:07:17.440329+0000","last_peered":"2024-05-10T14:07:17.440329+0000","last_clean":"2024-05-10T14:07:17.440329+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:17.440329+0000","last_undegraded":"2024-05-10T14:07:17.440329+0000","last_fullsized":"2024-05-10T14:07:17.440329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:07:19.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073336+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073336+0000","last_peered":"2024-05-10T14:07:12.073336+0000","last_clean":"2024-05-10T14:07:12.073336+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073336+0000","last_undegraded":"2024-05-10T14:07:12.073336+0000","last_fullsized":"2024-05-10T14:07:12.073336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:35.774089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076797+0000","last_change":"2024-05-10T14:04:06.313013+0000","last_active":"2024-05-10T14:07:12.076797+0000","last_peered":"2024-05-10T14:07:12.076797+0000","last_clean":"2024-05-10T14:07:12.076797+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:12.076797+0000","last_undegraded":"2024-05-10T14:07:12.076797+0000","last_fullsized":"2024-05-10T14:07:12.076797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:32.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550764+0000","last_change":"2024-05-10T14:02:32.699686+0000","last_active":"2024-05-10T14:07:11.550764+0000","last_peered":"2024-05-10T14:07:11.550764+0000","last_clean":"2024-05-10T14:07:11.550764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:11.550764+0000","last_undegraded":"2024-05-10T14:07:11.550764+0000","last_fullsized":"2024-05-10T14:07:11.550764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:25.495038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083570+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083570+0000","last_peered":"2024-05-10T14:07:12.083570+0000","last_clean":"2024-05-10T14:07:12.083570+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083570+0000","last_undegraded":"2024-05-10T14:07:12.083570+0000","last_fullsized":"2024-05-10T14:07:12.083570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:39:07.758165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550768+0000","last_change":"2024-05-10T14:02:34.693707+0000","last_active":"2024-05-10T14:07:11.550768+0000","last_peered":"2024-05-10T14:07:11.550768+0000","last_clean":"2024-05-10T14:07:11.550768+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:11.550768+0000","last_undegraded":"2024-05-10T14:07:11.550768+0000","last_fullsized":"2024-05-10T14:07:11.550768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"151'13","reported_seq":309,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.534757+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:17.534757+0000","last_peered":"2024-05-10T14:07:17.534757+0000","last_clean":"2024-05-10T14:07:17.534757+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:17.534757+0000","last_undegraded":"2024-05-10T14:07:17.534757+0000","last_fullsized":"2024-05-10T14:07:17.534757+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548525+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548525+0000","last_peered":"2024-05-10T14:07:11.548525+0000","last_clean":"2024-05-10T14:07:11.548525+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548525+0000","last_undegraded":"2024-05-10T14:07:11.548525+0000","last_fullsized":"2024-05-10T14:07:11.548525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078524+0000","last_change":"2024-05-10T14:02:40.726927+0000","last_active":"2024-05-10T14:07:12.078524+0000","last_peered":"2024-05-10T14:07:12.078524+0000","last_clean":"2024-05-10T14:07:12.078524+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:12.078524+0000","last_undegraded":"2024-05-10T14:07:12.078524+0000","last_fullsized":"2024-05-10T14:07:12.078524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:53.609342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078548+0000","last_change":"2024-05-10T14:02:32.694932+0000","last_active":"2024-05-10T14:07:12.078548+0000","last_peered":"2024-05-10T14:07:12.078548+0000","last_clean":"2024-05-10T14:07:12.078548+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:12.078548+0000","last_undegraded":"2024-05-10T14:07:12.078548+0000","last_fullsized":"2024-05-10T14:07:12.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.351628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083159+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083159+0000","last_peered":"2024-05-10T14:07:12.083159+0000","last_clean":"2024-05-10T14:07:12.083159+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083159+0000","last_undegraded":"2024-05-10T14:07:12.083159+0000","last_fullsized":"2024-05-10T14:07:12.083159+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:02.654145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554876+0000","last_change":"2024-05-10T14:02:34.695200+0000","last_active":"2024-05-10T14:07:11.554876+0000","last_peered":"2024-05-10T14:07:11.554876+0000","last_clean":"2024-05-10T14:07:11.554876+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:11.554876+0000","last_undegraded":"2024-05-10T14:07:11.554876+0000","last_fullsized":"2024-05-10T14:07:11.554876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"151'19","reported_seq":59,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.454511+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:17.454511+0000","last_peered":"2024-05-10T14:07:17.454511+0000","last_clean":"2024-05-10T14:07:17.454511+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:17.454511+0000","last_undegraded":"2024-05-10T14:07:17.454511+0000","last_fullsized":"2024-05-10T14:07:17.454511+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:33.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"151'18","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.690445+0000","last_change":"2024-05-10T14:02:38.725209+0000","last_active":"2024-05-10T14:07:17.690445+0000","last_peered":"2024-05-10T14:07:17.690445+0000","last_clean":"2024-05-10T14:07:17.690445+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:17.690445+0000","last_undegraded":"2024-05-10T14:07:17.690445+0000","last_fullsized":"2024-05-10T14:07:17.690445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074575+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074575+0000","last_peered":"2024-05-10T14:07:12.074575+0000","last_clean":"2024-05-10T14:07:12.074575+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074575+0000","last_undegraded":"2024-05-10T14:07:12.074575+0000","last_fullsized":"2024-05-10T14:07:12.074575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074852+0000","last_change":"2024-05-10T14:02:32.690889+0000","last_active":"2024-05-10T14:07:12.074852+0000","last_peered":"2024-05-10T14:07:12.074852+0000","last_clean":"2024-05-10T14:07:12.074852+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:12.074852+0000","last_undegraded":"2024-05-10T14:07:12.074852+0000","last_fullsized":"2024-05-10T14:07:12.074852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076261+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076261+0000","last_peered":"2024-05-10T14:07:12.076261+0000","last_clean":"2024-05-10T14:07:12.076261+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076261+0000","last_undegraded":"2024-05-10T14:07:12.076261+0000","last_fullsized":"2024-05-10T14:07:12.076261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:43.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552475+0000","last_change":"2024-05-10T14:02:34.687658+0000","last_active":"2024-05-10T14:07:11.552475+0000","last_peered":"2024-05-10T14:07:11.552475+0000","last_clean":"2024-05-10T14:07:11.552475+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:11.552475+0000","last_undegraded":"2024-05-10T14:07:11.552475+0000","last_fullsized":"2024-05-10T14:07:11.552475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"151'20","reported_seq":325,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.560072+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:17.560072+0000","last_peered":"2024-05-10T14:07:17.560072+0000","last_clean":"2024-05-10T14:07:17.560072+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:17.560072+0000","last_undegraded":"2024-05-10T14:07:17.560072+0000","last_fullsized":"2024-05-10T14:07:17.560072+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550341+0000","last_change":"2024-05-10T14:06:56.370395+0000","last_active":"2024-05-10T14:07:11.550341+0000","last_peered":"2024-05-10T14:07:11.550341+0000","last_clean":"2024-05-10T14:07:11.550341+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:11.550341+0000","last_undegraded":"2024-05-10T14:07:11.550341+0000","last_fullsized":"2024-05-10T14:07:11.550341+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'1","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074554+0000","last_change":"2024-05-10T14:02:40.723304+0000","last_active":"2024-05-10T14:07:12.074554+0000","last_peered":"2024-05-10T14:07:12.074554+0000","last_clean":"2024-05-10T14:07:12.074554+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:12.074554+0000","last_undegraded":"2024-05-10T14:07:12.074554+0000","last_fullsized":"2024-05-10T14:07:12.074554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:14.814621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551113+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551113+0000","last_peered":"2024-05-10T14:07:11.551113+0000","last_clean":"2024-05-10T14:07:11.551113+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551113+0000","last_undegraded":"2024-05-10T14:07:11.551113+0000","last_fullsized":"2024-05-10T14:07:11.551113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:37.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552857+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552857+0000","last_peered":"2024-05-10T14:07:11.552857+0000","last_clean":"2024-05-10T14:07:11.552857+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552857+0000","last_undegraded":"2024-05-10T14:07:11.552857+0000","last_fullsized":"2024-05-10T14:07:11.552857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554895+0000","last_change":"2024-05-10T14:06:56.370780+0000","last_active":"2024-05-10T14:07:11.554895+0000","last_peered":"2024-05-10T14:07:11.554895+0000","last_clean":"2024-05-10T14:07:11.554895+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:11.554895+0000","last_undegraded":"2024-05-10T14:07:11.554895+0000","last_fullsized":"2024-05-10T14:07:11.554895+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"151'15","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.564908+0000","last_change":"2024-05-10T14:02:36.690456+0000","last_active":"2024-05-10T14:07:17.564908+0000","last_peered":"2024-05-10T14:07:17.564908+0000","last_clean":"2024-05-10T14:07:17.564908+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:17.564908+0000","last_undegraded":"2024-05-10T14:07:17.564908+0000","last_fullsized":"2024-05-10T14:07:17.564908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:59.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174591+0000","last_change":"2024-05-10T14:02:38.734191+0000","last_active":"2024-05-10T14:07:12.174591+0000","last_peered":"2024-05-10T14:07:12.174591+0000","last_clean":"2024-05-10T14:07:12.174591+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:12.174591+0000","last_undegraded":"2024-05-10T14:07:12.174591+0000","last_fullsized":"2024-05-10T14:07:12.174591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549526+0000","last_change":"2024-05-10T14:04:06.306602+0000","last_active":"2024-05-10T14:07:11.549526+0000","last_peered":"2024-05-10T14:07:11.549526+0000","last_clean":"2024-05-10T14:07:11.549526+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:11.549526+0000","last_undegraded":"2024-05-10T14:07:11.549526+0000","last_fullsized":"2024-05-10T14:07:11.549526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549799+0000","last_change":"2024-05-10T14:02:32.678155+0000","last_active":"2024-05-10T14:07:11.549799+0000","last_peered":"2024-05-10T14:07:11.549799+0000","last_clean":"2024-05-10T14:07:11.549799+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:11.549799+0000","last_undegraded":"2024-05-10T14:07:11.549799+0000","last_fullsized":"2024-05-10T14:07:11.549799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:40.985834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.078832+0000","last_change":"2024-05-10T14:02:30.656474+0000","last_active":"2024-05-10T14:07:12.078832+0000","last_peered":"2024-05-10T14:07:12.078832+0000","last_clean":"2024-05-10T14:07:12.078832+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:12.078832+0000","last_undegraded":"2024-05-10T14:07:12.078832+0000","last_fullsized":"2024-05-10T14:07:12.078832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:42.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073335+0000","last_change":"2024-05-10T14:02:34.698880+0000","last_active":"2024-05-10T14:07:12.073335+0000","last_peered":"2024-05-10T14:07:12.073335+0000","last_clean":"2024-05-10T14:07:12.073335+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:12.073335+0000","last_undegraded":"2024-05-10T14:07:12.073335+0000","last_fullsized":"2024-05-10T14:07:12.073335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:58:14.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"151'25","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.946829+0000","last_change":"2024-05-10T14:07:21.946892+0000","last_active":"2024-05-10T14:07:21.946829+0000","last_peered":"2024-05-10T14:07:21.946829+0000","last_clean":"2024-05-10T14:07:21.946829+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:21.946829+0000","last_undegraded":"2024-05-10T14:07:21.946829+0000","last_fullsized":"2024-05-10T14:07:21.946829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.946746+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:50.542836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"151'20","reported_seq":300,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.681208+0000","last_change":"2024-05-10T14:04:06.324659+0000","last_active":"2024-05-10T14:07:17.681208+0000","last_peered":"2024-05-10T14:07:17.681208+0000","last_clean":"2024-05-10T14:07:17.681208+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:17.681208+0000","last_undegraded":"2024-05-10T14:07:17.681208+0000","last_fullsized":"2024-05-10T14:07:17.681208+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072672+0000","last_change":"2024-05-10T14:02:40.727839+0000","last_active":"2024-05-10T14:07:12.072672+0000","last_peered":"2024-05-10T14:07:12.072672+0000","last_clean":"2024-05-10T14:07:12.072672+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:12.072672+0000","last_undegraded":"2024-05-10T14:07:12.072672+0000","last_fullsized":"2024-05-10T14:07:12.072672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:07.540199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551080+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551080+0000","last_peered":"2024-05-10T14:07:11.551080+0000","last_clean":"2024-05-10T14:07:11.551080+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551080+0000","last_undegraded":"2024-05-10T14:07:11.551080+0000","last_fullsized":"2024-05-10T14:07:11.551080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:49.870847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548385+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548385+0000","last_peered":"2024-05-10T14:07:11.548385+0000","last_clean":"2024-05-10T14:07:11.548385+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548385+0000","last_undegraded":"2024-05-10T14:07:11.548385+0000","last_fullsized":"2024-05-10T14:07:11.548385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:29.519205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":209,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.292851+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:17.292851+0000","last_peered":"2024-05-10T14:07:17.292851+0000","last_clean":"2024-05-10T14:07:17.292851+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:17.292851+0000","last_undegraded":"2024-05-10T14:07:17.292851+0000","last_fullsized":"2024-05-10T14:07:17.292851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:57.778170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549794+0000","last_change":"2024-05-10T14:02:36.760120+0000","last_active":"2024-05-10T14:07:11.549794+0000","last_peered":"2024-05-10T14:07:11.549794+0000","last_clean":"2024-05-10T14:07:11.549794+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:11.549794+0000","last_undegraded":"2024-05-10T14:07:11.549794+0000","last_fullsized":"2024-05-10T14:07:11.549794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"151'18","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.330382+0000","last_change":"2024-05-10T14:02:38.724105+0000","last_active":"2024-05-10T14:07:17.330382+0000","last_peered":"2024-05-10T14:07:17.330382+0000","last_clean":"2024-05-10T14:07:17.330382+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:17.330382+0000","last_undegraded":"2024-05-10T14:07:17.330382+0000","last_fullsized":"2024-05-10T14:07:17.330382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:39.393971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550065+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550065+0000","last_peered":"2024-05-10T14:07:11.550065+0000","last_clean":"2024-05-10T14:07:11.550065+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550065+0000","last_undegraded":"2024-05-10T14:07:11.550065+0000","last_fullsized":"2024-05-10T14:07:11.550065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:50:00.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:02:32.685594+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:37:24.543848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548111+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.548111+0000","last_peered":"2024-05-10T14:07:11.548111+0000","last_clean":"2024-05-10T14:07:11.548111+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.548111+0000","last_undegraded":"2024-05-10T14:07:11.548111+0000","last_fullsized":"2024-05-10T14:07:11.548111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550598+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550598+0000","last_peered":"2024-05-10T14:07:11.550598+0000","last_clean":"2024-05-10T14:07:11.550598+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550598+0000","last_undegraded":"2024-05-10T14:07:11.550598+0000","last_fullsized":"2024-05-10T14:07:11.550598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:46.173729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"151'21","reported_seq":224,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.416506+0000","last_change":"2024-05-10T14:04:06.322222+0000","last_active":"2024-05-10T14:07:17.416506+0000","last_peered":"2024-05-10T14:07:17.416506+0000","last_clean":"2024-05-10T14:07:17.416506+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:17.416506+0000","last_undegraded":"2024-05-10T14:07:17.416506+0000","last_fullsized":"2024-05-10T14:07:17.416506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:16.594570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077705+0000","last_change":"2024-05-10T14:02:38.732107+0000","last_active":"2024-05-10T14:07:12.077705+0000","last_peered":"2024-05-10T14:07:12.077705+0000","last_clean":"2024-05-10T14:07:12.077705+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:12.077705+0000","last_undegraded":"2024-05-10T14:07:12.077705+0000","last_fullsized":"2024-05-10T14:07:12.077705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:59.443460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073227+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073227+0000","last_peered":"2024-05-10T14:07:12.073227+0000","last_clean":"2024-05-10T14:07:12.073227+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073227+0000","last_undegraded":"2024-05-10T14:07:12.073227+0000","last_fullsized":"2024-05-10T14:07:12.073227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:03.074306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079532+0000","last_change":"2024-05-10T14:02:32.701225+0000","last_active":"2024-05-10T14:07:12.079532+0000","last_peered":"2024-05-10T14:07:12.079532+0000","last_clean":"2024-05-10T14:07:12.079532+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:12.079532+0000","last_undegraded":"2024-05-10T14:07:12.079532+0000","last_fullsized":"2024-05-10T14:07:12.079532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:24.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":42,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076591+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076591+0000","last_peered":"2024-05-10T14:07:12.076591+0000","last_clean":"2024-05-10T14:07:12.076591+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076591+0000","last_undegraded":"2024-05-10T14:07:12.076591+0000","last_fullsized":"2024-05-10T14:07:12.076591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:16:20.718859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077164+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077164+0000","last_peered":"2024-05-10T14:07:12.077164+0000","last_clean":"2024-05-10T14:07:12.077164+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077164+0000","last_undegraded":"2024-05-10T14:07:12.077164+0000","last_fullsized":"2024-05-10T14:07:12.077164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:11:46.276748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549611+0000","last_change":"2024-05-10T14:04:06.295652+0000","last_active":"2024-05-10T14:07:11.549611+0000","last_peered":"2024-05-10T14:07:11.549611+0000","last_clean":"2024-05-10T14:07:11.549611+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:11.549611+0000","last_undegraded":"2024-05-10T14:07:11.549611+0000","last_fullsized":"2024-05-10T14:07:11.549611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082604+0000","last_change":"2024-05-10T14:06:56.375790+0000","last_active":"2024-05-10T14:07:12.082604+0000","last_peered":"2024-05-10T14:07:12.082604+0000","last_clean":"2024-05-10T14:07:12.082604+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:12.082604+0000","last_undegraded":"2024-05-10T14:07:12.082604+0000","last_fullsized":"2024-05-10T14:07:12.082604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:33:11.573460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"151'25","reported_seq":239,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.642386+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:17.642386+0000","last_peered":"2024-05-10T14:07:17.642386+0000","last_clean":"2024-05-10T14:07:17.642386+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:17.642386+0000","last_undegraded":"2024-05-10T14:07:17.642386+0000","last_fullsized":"2024-05-10T14:07:17.642386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:08:39.359840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074666+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074666+0000","last_peered":"2024-05-10T14:07:12.074666+0000","last_clean":"2024-05-10T14:07:12.074666+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074666+0000","last_undegraded":"2024-05-10T14:07:12.074666+0000","last_fullsized":"2024-05-10T14:07:12.074666+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075221+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075221+0000","last_peered":"2024-05-10T14:07:12.075221+0000","last_clean":"2024-05-10T14:07:12.075221+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075221+0000","last_undegraded":"2024-05-10T14:07:12.075221+0000","last_fullsized":"2024-05-10T14:07:12.075221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:37:43.613088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074990+0000","last_change":"2024-05-10T14:02:32.690313+0000","last_active":"2024-05-10T14:07:12.074990+0000","last_peered":"2024-05-10T14:07:12.074990+0000","last_clean":"2024-05-10T14:07:12.074990+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:12.074990+0000","last_undegraded":"2024-05-10T14:07:12.074990+0000","last_fullsized":"2024-05-10T14:07:12.074990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076007+0000","last_change":"2024-05-10T14:06:56.394589+0000","last_active":"2024-05-10T14:07:12.076007+0000","last_peered":"2024-05-10T14:07:12.076007+0000","last_clean":"2024-05-10T14:07:12.076007+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:12.076007+0000","last_undegraded":"2024-05-10T14:07:12.076007+0000","last_fullsized":"2024-05-10T14:07:12.076007+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:11.085999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073113+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073113+0000","last_peered":"2024-05-10T14:07:12.073113+0000","last_clean":"2024-05-10T14:07:12.073113+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073113+0000","last_undegraded":"2024-05-10T14:07:12.073113+0000","last_fullsized":"2024-05-10T14:07:12.073113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080447+0000","last_change":"2024-05-10T14:04:06.322382+0000","last_active":"2024-05-10T14:07:12.080447+0000","last_peered":"2024-05-10T14:07:12.080447+0000","last_clean":"2024-05-10T14:07:12.080447+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:12.080447+0000","last_undegraded":"2024-05-10T14:07:12.080447+0000","last_fullsized":"2024-05-10T14:07:12.080447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:56.339316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"151'48","reported_seq":361,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.636923+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:17.636923+0000","last_peered":"2024-05-10T14:07:17.636923+0000","last_clean":"2024-05-10T14:07:17.636923+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:17.636923+0000","last_undegraded":"2024-05-10T14:07:17.636923+0000","last_fullsized":"2024-05-10T14:07:17.636923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:02.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082884+0000","last_change":"2024-05-10T14:06:56.379405+0000","last_active":"2024-05-10T14:07:12.082884+0000","last_peered":"2024-05-10T14:07:12.082884+0000","last_clean":"2024-05-10T14:07:12.082884+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:12.082884+0000","last_undegraded":"2024-05-10T14:07:12.082884+0000","last_fullsized":"2024-05-10T14:07:12.082884+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:27.490904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":242,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072421+0000","last_change":"2024-05-10T14:02:40.754367+0000","last_active":"2024-05-10T14:07:12.072421+0000","last_peered":"2024-05-10T14:07:12.072421+0000","last_clean":"2024-05-10T14:07:12.072421+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:12.072421+0000","last_undegraded":"2024-05-10T14:07:12.072421+0000","last_fullsized":"2024-05-10T14:07:12.072421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:58.441005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075043+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075043+0000","last_peered":"2024-05-10T14:07:12.075043+0000","last_clean":"2024-05-10T14:07:12.075043+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075043+0000","last_undegraded":"2024-05-10T14:07:12.075043+0000","last_fullsized":"2024-05-10T14:07:12.075043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:39:18.152268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552363+0000","last_change":"2024-05-10T14:02:24.590447+0000","last_active":"2024-05-10T14:07:11.552363+0000","last_peered":"2024-05-10T14:07:11.552363+0000","last_clean":"2024-05-10T14:07:11.552363+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:11.552363+0000","last_undegraded":"2024-05-10T14:07:11.552363+0000","last_fullsized":"2024-05-10T14:07:11.552363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072395+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072395+0000","last_peered":"2024-05-10T14:07:12.072395+0000","last_clean":"2024-05-10T14:07:12.072395+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072395+0000","last_undegraded":"2024-05-10T14:07:12.072395+0000","last_fullsized":"2024-05-10T14:07:12.072395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:32.466002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555495+0000","last_change":"2024-05-10T14:04:06.327615+0000","last_active":"2024-05-10T14:07:11.555495+0000","last_peered":"2024-05-10T14:07:11.555495+0000","last_clean":"2024-05-10T14:07:11.555495+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:11.555495+0000","last_undegraded":"2024-05-10T14:07:11.555495+0000","last_fullsized":"2024-05-10T14:07:11.555495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084118+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084118+0000","last_peered":"2024-05-10T14:07:12.084118+0000","last_clean":"2024-05-10T14:07:12.084118+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084118+0000","last_undegraded":"2024-05-10T14:07:12.084118+0000","last_fullsized":"2024-05-10T14:07:12.084118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:55.533551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074074+0000","last_change":"2024-05-10T14:02:38.717246+0000","last_active":"2024-05-10T14:07:12.074074+0000","last_peered":"2024-05-10T14:07:12.074074+0000","last_clean":"2024-05-10T14:07:12.074074+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:12.074074+0000","last_undegraded":"2024-05-10T14:07:12.074074+0000","last_fullsized":"2024-05-10T14:07:12.074074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.171535+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:12.171535+0000","last_peered":"2024-05-10T14:07:12.171535+0000","last_clean":"2024-05-10T14:07:12.171535+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:12.171535+0000","last_undegraded":"2024-05-10T14:07:12.171535+0000","last_fullsized":"2024-05-10T14:07:12.171535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073504+0000","last_change":"2024-05-10T14:02:32.693821+0000","last_active":"2024-05-10T14:07:12.073504+0000","last_peered":"2024-05-10T14:07:12.073504+0000","last_clean":"2024-05-10T14:07:12.073504+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:12.073504+0000","last_undegraded":"2024-05-10T14:07:12.073504+0000","last_fullsized":"2024-05-10T14:07:12.073504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:47.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074375+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074375+0000","last_peered":"2024-05-10T14:07:12.074375+0000","last_clean":"2024-05-10T14:07:12.074375+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074375+0000","last_undegraded":"2024-05-10T14:07:12.074375+0000","last_fullsized":"2024-05-10T14:07:12.074375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:13:54.665356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550650+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.550650+0000","last_peered":"2024-05-10T14:07:11.550650+0000","last_clean":"2024-05-10T14:07:11.550650+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.550650+0000","last_undegraded":"2024-05-10T14:07:11.550650+0000","last_fullsized":"2024-05-10T14:07:11.550650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:32.931128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073883+0000","last_change":"2024-05-10T14:02:34.692302+0000","last_active":"2024-05-10T14:07:12.073883+0000","last_peered":"2024-05-10T14:07:12.073883+0000","last_clean":"2024-05-10T14:07:12.073883+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:12.073883+0000","last_undegraded":"2024-05-10T14:07:12.073883+0000","last_fullsized":"2024-05-10T14:07:12.073883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551712+0000","last_change":"2024-05-10T14:02:36.700607+0000","last_active":"2024-05-10T14:07:11.551712+0000","last_peered":"2024-05-10T14:07:11.551712+0000","last_clean":"2024-05-10T14:07:11.551712+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:11.551712+0000","last_undegraded":"2024-05-10T14:07:11.551712+0000","last_fullsized":"2024-05-10T14:07:11.551712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081834+0000","last_change":"2024-05-10T14:02:38.718029+0000","last_active":"2024-05-10T14:07:12.081834+0000","last_peered":"2024-05-10T14:07:12.081834+0000","last_clean":"2024-05-10T14:07:12.081834+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:12.081834+0000","last_undegraded":"2024-05-10T14:07:12.081834+0000","last_fullsized":"2024-05-10T14:07:12.081834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:01:55.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075169+0000","last_change":"2024-05-10T14:04:06.313886+0000","last_active":"2024-05-10T14:07:12.075169+0000","last_peered":"2024-05-10T14:07:12.075169+0000","last_clean":"2024-05-10T14:07:12.075169+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:12.075169+0000","last_undegraded":"2024-05-10T14:07:12.075169+0000","last_fullsized":"2024-05-10T14:07:12.075169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:08.466930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072776+0000","last_change":"2024-05-10T14:04:06.305850+0000","last_active":"2024-05-10T14:07:12.072776+0000","last_peered":"2024-05-10T14:07:12.072776+0000","last_clean":"2024-05-10T14:07:12.072776+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:12.072776+0000","last_undegraded":"2024-05-10T14:07:12.072776+0000","last_fullsized":"2024-05-10T14:07:12.072776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:33:02.036910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":212,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.696101+0000","last_change":"2024-05-10T14:03:11.206075+0000","last_active":"2024-05-10T14:07:21.696101+0000","last_peered":"2024-05-10T14:07:21.696101+0000","last_clean":"2024-05-10T14:07:21.696101+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:21.696101+0000","last_undegraded":"2024-05-10T14:07:21.696101+0000","last_fullsized":"2024-05-10T14:07:21.696101+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073620+0000","last_change":"2024-05-10T14:02:24.797001+0000","last_active":"2024-05-10T14:07:12.073620+0000","last_peered":"2024-05-10T14:07:12.073620+0000","last_clean":"2024-05-10T14:07:12.073620+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:12.073620+0000","last_undegraded":"2024-05-10T14:07:12.073620+0000","last_fullsized":"2024-05-10T14:07:12.073620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:42.414615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"28'1","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.315905+0000","last_change":"2024-05-10T14:02:34.696035+0000","last_active":"2024-05-10T14:07:17.315905+0000","last_peered":"2024-05-10T14:07:17.315905+0000","last_clean":"2024-05-10T14:07:17.315905+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:17.315905+0000","last_undegraded":"2024-05-10T14:07:17.315905+0000","last_fullsized":"2024-05-10T14:07:17.315905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"151'26","reported_seq":300,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.629120+0000","last_change":"2024-05-10T14:02:36.708692+0000","last_active":"2024-05-10T14:07:17.629120+0000","last_peered":"2024-05-10T14:07:17.629120+0000","last_clean":"2024-05-10T14:07:17.629120+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:17.629120+0000","last_undegraded":"2024-05-10T14:07:17.629120+0000","last_fullsized":"2024-05-10T14:07:17.629120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550107+0000","last_change":"2024-05-10T14:02:38.707007+0000","last_active":"2024-05-10T14:07:11.550107+0000","last_peered":"2024-05-10T14:07:11.550107+0000","last_clean":"2024-05-10T14:07:11.550107+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:11.550107+0000","last_undegraded":"2024-05-10T14:07:11.550107+0000","last_fullsized":"2024-05-10T14:07:11.550107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:59.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174507+0000","last_change":"2024-05-10T14:02:40.755857+0000","last_active":"2024-05-10T14:07:12.174507+0000","last_peered":"2024-05-10T14:07:12.174507+0000","last_clean":"2024-05-10T14:07:12.174507+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:12.174507+0000","last_undegraded":"2024-05-10T14:07:12.174507+0000","last_fullsized":"2024-05-10T14:07:12.174507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"81'3","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074753+0000","last_change":"2024-05-10T14:04:06.319015+0000","last_active":"2024-05-10T14:07:12.074753+0000","last_peered":"2024-05-10T14:07:12.074753+0000","last_clean":"2024-05-10T14:07:12.074753+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:12.074753+0000","last_undegraded":"2024-05-10T14:07:12.074753+0000","last_fullsized":"2024-05-10T14:07:12.074753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073505+0000","last_change":"2024-05-10T14:02:30.636022+0000","last_active":"2024-05-10T14:07:12.073505+0000","last_peered":"2024-05-10T14:07:12.073505+0000","last_clean":"2024-05-10T14:07:12.073505+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:12.073505+0000","last_undegraded":"2024-05-10T14:07:12.073505+0000","last_fullsized":"2024-05-10T14:07:12.073505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:31:31.503995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083738+0000","last_change":"2024-05-10T14:06:56.379646+0000","last_active":"2024-05-10T14:07:12.083738+0000","last_peered":"2024-05-10T14:07:12.083738+0000","last_clean":"2024-05-10T14:07:12.083738+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:12.083738+0000","last_undegraded":"2024-05-10T14:07:12.083738+0000","last_fullsized":"2024-05-10T14:07:12.083738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:42.476770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077922+0000","last_change":"2024-05-10T14:02:34.686193+0000","last_active":"2024-05-10T14:07:12.077922+0000","last_peered":"2024-05-10T14:07:12.077922+0000","last_clean":"2024-05-10T14:07:12.077922+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:12.077922+0000","last_undegraded":"2024-05-10T14:07:12.077922+0000","last_fullsized":"2024-05-10T14:07:12.077922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:16.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072370+0000","last_change":"2024-05-10T14:02:36.759478+0000","last_active":"2024-05-10T14:07:12.072370+0000","last_peered":"2024-05-10T14:07:12.072370+0000","last_clean":"2024-05-10T14:07:12.072370+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:12.072370+0000","last_undegraded":"2024-05-10T14:07:12.072370+0000","last_fullsized":"2024-05-10T14:07:12.072370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:07:20.849549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"151'20","reported_seq":197,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.324321+0000","last_change":"2024-05-10T14:04:06.317309+0000","last_active":"2024-05-10T14:07:17.324321+0000","last_peered":"2024-05-10T14:07:17.324321+0000","last_clean":"2024-05-10T14:07:17.324321+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:17.324321+0000","last_undegraded":"2024-05-10T14:07:17.324321+0000","last_fullsized":"2024-05-10T14:07:17.324321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:40.191974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.171594+0000","last_change":"2024-05-10T14:02:40.754138+0000","last_active":"2024-05-10T14:07:12.171594+0000","last_peered":"2024-05-10T14:07:12.171594+0000","last_clean":"2024-05-10T14:07:12.171594+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:12.171594+0000","last_undegraded":"2024-05-10T14:07:12.171594+0000","last_fullsized":"2024-05-10T14:07:12.171594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548971+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548971+0000","last_peered":"2024-05-10T14:07:11.548971+0000","last_clean":"2024-05-10T14:07:11.548971+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548971+0000","last_undegraded":"2024-05-10T14:07:11.548971+0000","last_fullsized":"2024-05-10T14:07:11.548971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554202+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554202+0000","last_peered":"2024-05-10T14:07:11.554202+0000","last_clean":"2024-05-10T14:07:11.554202+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554202+0000","last_undegraded":"2024-05-10T14:07:11.554202+0000","last_fullsized":"2024-05-10T14:07:11.554202+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075060+0000","last_change":"2024-05-10T14:02:24.591649+0000","last_active":"2024-05-10T14:07:12.075060+0000","last_peered":"2024-05-10T14:07:12.075060+0000","last_clean":"2024-05-10T14:07:12.075060+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:12.075060+0000","last_undegraded":"2024-05-10T14:07:12.075060+0000","last_fullsized":"2024-05-10T14:07:12.075060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:04.896603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549043+0000","last_change":"2024-05-10T14:02:34.680764+0000","last_active":"2024-05-10T14:07:11.549043+0000","last_peered":"2024-05-10T14:07:11.549043+0000","last_clean":"2024-05-10T14:07:11.549043+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:11.549043+0000","last_undegraded":"2024-05-10T14:07:11.549043+0000","last_fullsized":"2024-05-10T14:07:11.549043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:32.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550574+0000","last_change":"2024-05-10T14:02:36.702983+0000","last_active":"2024-05-10T14:07:11.550574+0000","last_peered":"2024-05-10T14:07:11.550574+0000","last_clean":"2024-05-10T14:07:11.550574+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:11.550574+0000","last_undegraded":"2024-05-10T14:07:11.550574+0000","last_fullsized":"2024-05-10T14:07:11.550574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:03.191010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"151'18","reported_seq":290,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.686084+0000","last_change":"2024-05-10T14:02:38.702366+0000","last_active":"2024-05-10T14:07:17.686084+0000","last_peered":"2024-05-10T14:07:17.686084+0000","last_clean":"2024-05-10T14:07:17.686084+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:17.686084+0000","last_undegraded":"2024-05-10T14:07:17.686084+0000","last_fullsized":"2024-05-10T14:07:17.686084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174475+0000","last_change":"2024-05-10T14:02:40.715885+0000","last_active":"2024-05-10T14:07:12.174475+0000","last_peered":"2024-05-10T14:07:12.174475+0000","last_clean":"2024-05-10T14:07:12.174475+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:12.174475+0000","last_undegraded":"2024-05-10T14:07:12.174475+0000","last_fullsized":"2024-05-10T14:07:12.174475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548758+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548758+0000","last_peered":"2024-05-10T14:07:11.548758+0000","last_clean":"2024-05-10T14:07:11.548758+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548758+0000","last_undegraded":"2024-05-10T14:07:11.548758+0000","last_fullsized":"2024-05-10T14:07:11.548758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:14.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075176+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075176+0000","last_peered":"2024-05-10T14:07:12.075176+0000","last_clean":"2024-05-10T14:07:12.075176+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075176+0000","last_undegraded":"2024-05-10T14:07:12.075176+0000","last_fullsized":"2024-05-10T14:07:12.075176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082755+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082755+0000","last_peered":"2024-05-10T14:07:12.082755+0000","last_clean":"2024-05-10T14:07:12.082755+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082755+0000","last_undegraded":"2024-05-10T14:07:12.082755+0000","last_fullsized":"2024-05-10T14:07:12.082755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:12.188593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549085+0000","last_change":"2024-05-10T14:02:34.689499+0000","last_active":"2024-05-10T14:07:11.549085+0000","last_peered":"2024-05-10T14:07:11.549085+0000","last_clean":"2024-05-10T14:07:11.549085+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:11.549085+0000","last_undegraded":"2024-05-10T14:07:11.549085+0000","last_fullsized":"2024-05-10T14:07:11.549085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"151'31","reported_seq":75,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.651890+0000","last_change":"2024-05-10T14:06:56.439526+0000","last_active":"2024-05-10T14:07:17.651890+0000","last_peered":"2024-05-10T14:07:17.651890+0000","last_clean":"2024-05-10T14:07:17.651890+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:17.651890+0000","last_undegraded":"2024-05-10T14:07:17.651890+0000","last_fullsized":"2024-05-10T14:07:17.651890+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:01:39.492428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548831+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548831+0000","last_peered":"2024-05-10T14:07:11.548831+0000","last_clean":"2024-05-10T14:07:11.548831+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548831+0000","last_undegraded":"2024-05-10T14:07:11.548831+0000","last_fullsized":"2024-05-10T14:07:11.548831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076879+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.076879+0000","last_peered":"2024-05-10T14:07:12.076879+0000","last_clean":"2024-05-10T14:07:12.076879+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.076879+0000","last_undegraded":"2024-05-10T14:07:12.076879+0000","last_fullsized":"2024-05-10T14:07:12.076879+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:22.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"151'2","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.003773+0000","last_change":"2024-05-10T14:07:21.003800+0000","last_active":"2024-05-10T14:07:21.003773+0000","last_peered":"2024-05-10T14:07:21.003773+0000","last_clean":"2024-05-10T14:07:21.003773+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:21.003773+0000","last_undegraded":"2024-05-10T14:07:21.003773+0000","last_fullsized":"2024-05-10T14:07:21.003773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.003698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:46:49.956112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549770+0000","last_change":"2024-05-10T14:02:32.693632+0000","last_active":"2024-05-10T14:07:11.549770+0000","last_peered":"2024-05-10T14:07:11.549770+0000","last_clean":"2024-05-10T14:07:11.549770+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:11.549770+0000","last_undegraded":"2024-05-10T14:07:11.549770+0000","last_fullsized":"2024-05-10T14:07:11.549770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:55.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550331+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:11.550331+0000","last_peered":"2024-05-10T14:07:11.550331+0000","last_clean":"2024-05-10T14:07:11.550331+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:11.550331+0000","last_undegraded":"2024-05-10T14:07:11.550331+0000","last_fullsized":"2024-05-10T14:07:11.550331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:36.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072921+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:12.072921+0000","last_peered":"2024-05-10T14:07:12.072921+0000","last_clean":"2024-05-10T14:07:12.072921+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:12.072921+0000","last_undegraded":"2024-05-10T14:07:12.072921+0000","last_fullsized":"2024-05-10T14:07:12.072921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:22:56.103260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.449117+0000","last_change":"2024-05-10T14:02:36.702111+0000","last_active":"2024-05-10T14:07:17.449117+0000","last_peered":"2024-05-10T14:07:17.449117+0000","last_clean":"2024-05-10T14:07:17.449117+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:17.449117+0000","last_undegraded":"2024-05-10T14:07:17.449117+0000","last_fullsized":"2024-05-10T14:07:17.449117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.168014+0000","last_change":"2024-05-10T14:02:38.706662+0000","last_active":"2024-05-10T14:07:22.168014+0000","last_peered":"2024-05-10T14:07:22.168014+0000","last_clean":"2024-05-10T14:07:22.168014+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:22.168014+0000","last_undegraded":"2024-05-10T14:07:22.168014+0000","last_fullsized":"2024-05-10T14:07:22.168014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551135+0000","last_change":"2024-05-10T14:06:56.342168+0000","last_active":"2024-05-10T14:07:11.551135+0000","last_peered":"2024-05-10T14:07:11.551135+0000","last_clean":"2024-05-10T14:07:11.551135+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:11.551135+0000","last_undegraded":"2024-05-10T14:07:11.551135+0000","last_fullsized":"2024-05-10T14:07:11.551135+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072720+0000","last_change":"2024-05-10T14:02:32.697169+0000","last_active":"2024-05-10T14:07:12.072720+0000","last_peered":"2024-05-10T14:07:12.072720+0000","last_clean":"2024-05-10T14:07:12.072720+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:12.072720+0000","last_undegraded":"2024-05-10T14:07:12.072720+0000","last_fullsized":"2024-05-10T14:07:12.072720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:50.035183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082640+0000","last_change":"2024-05-10T14:06:56.390713+0000","last_active":"2024-05-10T14:07:12.082640+0000","last_peered":"2024-05-10T14:07:12.082640+0000","last_clean":"2024-05-10T14:07:12.082640+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:12.082640+0000","last_undegraded":"2024-05-10T14:07:12.082640+0000","last_fullsized":"2024-05-10T14:07:12.082640+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:10.709638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.172388+0000","last_change":"2024-05-10T14:02:34.694276+0000","last_active":"2024-05-10T14:07:17.172388+0000","last_peered":"2024-05-10T14:07:17.172388+0000","last_clean":"2024-05-10T14:07:17.172388+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:17.172388+0000","last_undegraded":"2024-05-10T14:07:17.172388+0000","last_fullsized":"2024-05-10T14:07:17.172388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"49'5","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.175439+0000","last_change":"2024-05-10T14:04:06.319283+0000","last_active":"2024-05-10T14:07:17.175439+0000","last_peered":"2024-05-10T14:07:17.175439+0000","last_clean":"2024-05-10T14:07:17.175439+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:17.175439+0000","last_undegraded":"2024-05-10T14:07:17.175439+0000","last_fullsized":"2024-05-10T14:07:17.175439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081872+0000","last_change":"2024-05-10T14:06:56.367883+0000","last_active":"2024-05-10T14:07:12.081872+0000","last_peered":"2024-05-10T14:07:12.081872+0000","last_clean":"2024-05-10T14:07:12.081872+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:12.081872+0000","last_undegraded":"2024-05-10T14:07:12.081872+0000","last_fullsized":"2024-05-10T14:07:12.081872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:26.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":243,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073783+0000","last_change":"2024-05-10T14:02:40.724251+0000","last_active":"2024-05-10T14:07:12.073783+0000","last_peered":"2024-05-10T14:07:12.073783+0000","last_clean":"2024-05-10T14:07:12.073783+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:12.073783+0000","last_undegraded":"2024-05-10T14:07:12.073783+0000","last_fullsized":"2024-05-10T14:07:12.073783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'1","reported_seq":231,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551766+0000","last_change":"2024-05-10T14:06:56.440965+0000","last_active":"2024-05-10T14:07:11.551766+0000","last_peered":"2024-05-10T14:07:11.551766+0000","last_clean":"2024-05-10T14:07:11.551766+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:11.551766+0000","last_undegraded":"2024-05-10T14:07:11.551766+0000","last_fullsized":"2024-05-10T14:07:11.551766+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075822+0000","last_change":"2024-05-10T14:06:56.380312+0000","last_active":"2024-05-10T14:07:12.075822+0000","last_peered":"2024-05-10T14:07:12.075822+0000","last_clean":"2024-05-10T14:07:12.075822+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:12.075822+0000","last_undegraded":"2024-05-10T14:07:12.075822+0000","last_fullsized":"2024-05-10T14:07:12.075822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:57:11.927031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074950+0000","last_change":"2024-05-10T14:06:56.380076+0000","last_active":"2024-05-10T14:07:12.074950+0000","last_peered":"2024-05-10T14:07:12.074950+0000","last_clean":"2024-05-10T14:07:12.074950+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:12.074950+0000","last_undegraded":"2024-05-10T14:07:12.074950+0000","last_fullsized":"2024-05-10T14:07:12.074950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:31.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.612317+0000","last_change":"2024-05-10T14:02:36.700808+0000","last_active":"2024-05-10T14:07:17.612317+0000","last_peered":"2024-05-10T14:07:17.612317+0000","last_clean":"2024-05-10T14:07:17.612317+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:17.612317+0000","last_undegraded":"2024-05-10T14:07:17.612317+0000","last_fullsized":"2024-05-10T14:07:17.612317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077854+0000","last_change":"2024-05-10T14:02:38.717613+0000","last_active":"2024-05-10T14:07:12.077854+0000","last_peered":"2024-05-10T14:07:12.077854+0000","last_clean":"2024-05-10T14:07:12.077854+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:12.077854+0000","last_undegraded":"2024-05-10T14:07:12.077854+0000","last_fullsized":"2024-05-10T14:07:12.077854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:57.470112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076580+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076580+0000","last_peered":"2024-05-10T14:07:12.076580+0000","last_clean":"2024-05-10T14:07:12.076580+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076580+0000","last_undegraded":"2024-05-10T14:07:12.076580+0000","last_fullsized":"2024-05-10T14:07:12.076580+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:04.338354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.171467+0000","last_change":"2024-05-10T14:04:06.306796+0000","last_active":"2024-05-10T14:07:12.171467+0000","last_peered":"2024-05-10T14:07:12.171467+0000","last_clean":"2024-05-10T14:07:12.171467+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:12.171467+0000","last_undegraded":"2024-05-10T14:07:12.171467+0000","last_fullsized":"2024-05-10T14:07:12.171467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.020307+0000","last_change":"2024-05-10T14:07:22.020307+0000","last_active":"2024-05-10T14:07:22.020307+0000","last_peered":"2024-05-10T14:07:22.020307+0000","last_clean":"2024-05-10T14:07:22.020307+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:22.020307+0000","last_undegraded":"2024-05-10T14:07:22.020307+0000","last_fullsized":"2024-05-10T14:07:22.020307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.020202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:27.695256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077612+0000","last_change":"2024-05-10T14:02:34.691850+0000","last_active":"2024-05-10T14:07:12.077612+0000","last_peered":"2024-05-10T14:07:12.077612+0000","last_clean":"2024-05-10T14:07:12.077612+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:12.077612+0000","last_undegraded":"2024-05-10T14:07:12.077612+0000","last_fullsized":"2024-05-10T14:07:12.077612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:11.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"151'13","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.580860+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:17.580860+0000","last_peered":"2024-05-10T14:07:17.580860+0000","last_clean":"2024-05-10T14:07:17.580860+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:17.580860+0000","last_undegraded":"2024-05-10T14:07:17.580860+0000","last_fullsized":"2024-05-10T14:07:17.580860+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:43:18.015203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757341+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:20.757341+0000","last_peered":"2024-05-10T14:07:20.757341+0000","last_clean":"2024-05-10T14:07:20.757341+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:20.757341+0000","last_undegraded":"2024-05-10T14:07:20.757341+0000","last_fullsized":"2024-05-10T14:07:20.757341+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082387+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082387+0000","last_peered":"2024-05-10T14:07:12.082387+0000","last_clean":"2024-05-10T14:07:12.082387+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082387+0000","last_undegraded":"2024-05-10T14:07:12.082387+0000","last_fullsized":"2024-05-10T14:07:12.082387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:32.250355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167248+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:22.167248+0000","last_peered":"2024-05-10T14:07:22.167248+0000","last_clean":"2024-05-10T14:07:22.167248+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:22.167248+0000","last_undegraded":"2024-05-10T14:07:22.167248+0000","last_fullsized":"2024-05-10T14:07:22.167248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074754+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074754+0000","last_peered":"2024-05-10T14:07:12.074754+0000","last_clean":"2024-05-10T14:07:12.074754+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074754+0000","last_undegraded":"2024-05-10T14:07:12.074754+0000","last_fullsized":"2024-05-10T14:07:12.074754+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"151'20","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.572596+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:17.572596+0000","last_peered":"2024-05-10T14:07:17.572596+0000","last_clean":"2024-05-10T14:07:17.572596+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:17.572596+0000","last_undegraded":"2024-05-10T14:07:17.572596+0000","last_fullsized":"2024-05-10T14:07:17.572596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:37.789391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076557+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076557+0000","last_peered":"2024-05-10T14:07:12.076557+0000","last_clean":"2024-05-10T14:07:12.076557+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076557+0000","last_undegraded":"2024-05-10T14:07:12.076557+0000","last_fullsized":"2024-05-10T14:07:12.076557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:13.231344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.168135+0000","last_change":"2024-05-10T14:02:40.757420+0000","last_active":"2024-05-10T14:07:22.168135+0000","last_peered":"2024-05-10T14:07:22.168135+0000","last_clean":"2024-05-10T14:07:22.168135+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:22.168135+0000","last_undegraded":"2024-05-10T14:07:22.168135+0000","last_fullsized":"2024-05-10T14:07:22.168135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074908+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074908+0000","last_peered":"2024-05-10T14:07:12.074908+0000","last_clean":"2024-05-10T14:07:12.074908+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074908+0000","last_undegraded":"2024-05-10T14:07:12.074908+0000","last_fullsized":"2024-05-10T14:07:12.074908+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073075+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:12.073075+0000","last_peered":"2024-05-10T14:07:12.073075+0000","last_clean":"2024-05-10T14:07:12.073075+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:12.073075+0000","last_undegraded":"2024-05-10T14:07:12.073075+0000","last_fullsized":"2024-05-10T14:07:12.073075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:20.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081960+0000","last_change":"2024-05-10T14:02:34.691366+0000","last_active":"2024-05-10T14:07:12.081960+0000","last_peered":"2024-05-10T14:07:12.081960+0000","last_clean":"2024-05-10T14:07:12.081960+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:12.081960+0000","last_undegraded":"2024-05-10T14:07:12.081960+0000","last_fullsized":"2024-05-10T14:07:12.081960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:35.827761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"151'19","reported_seq":59,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.589888+0000","last_change":"2024-05-10T14:06:56.419072+0000","last_active":"2024-05-10T14:07:17.589888+0000","last_peered":"2024-05-10T14:07:17.589888+0000","last_clean":"2024-05-10T14:07:17.589888+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:17.589888+0000","last_undegraded":"2024-05-10T14:07:17.589888+0000","last_fullsized":"2024-05-10T14:07:17.589888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:10.598688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074515+0000","last_change":"2024-05-10T14:02:38.712166+0000","last_active":"2024-05-10T14:07:12.074515+0000","last_peered":"2024-05-10T14:07:12.074515+0000","last_clean":"2024-05-10T14:07:12.074515+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:12.074515+0000","last_undegraded":"2024-05-10T14:07:12.074515+0000","last_fullsized":"2024-05-10T14:07:12.074515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:09:54.537584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077526+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:12.077526+0000","last_peered":"2024-05-10T14:07:12.077526+0000","last_clean":"2024-05-10T14:07:12.077526+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:12.077526+0000","last_undegraded":"2024-05-10T14:07:12.077526+0000","last_fullsized":"2024-05-10T14:07:12.077526+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:31:34.278337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550758+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:11.550758+0000","last_peered":"2024-05-10T14:07:11.550758+0000","last_clean":"2024-05-10T14:07:11.550758+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:11.550758+0000","last_undegraded":"2024-05-10T14:07:11.550758+0000","last_fullsized":"2024-05-10T14:07:11.550758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":59,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551932+0000","last_change":"2024-05-10T14:06:12.294585+0000","last_active":"2024-05-10T14:07:11.551932+0000","last_peered":"2024-05-10T14:07:11.551932+0000","last_clean":"2024-05-10T14:07:11.551932+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:11.551932+0000","last_undegraded":"2024-05-10T14:07:11.551932+0000","last_fullsized":"2024-05-10T14:07:11.551932+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551525+0000","last_change":"2024-05-10T14:02:34.682563+0000","last_active":"2024-05-10T14:07:11.551525+0000","last_peered":"2024-05-10T14:07:11.551525+0000","last_clean":"2024-05-10T14:07:11.551525+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:11.551525+0000","last_undegraded":"2024-05-10T14:07:11.551525+0000","last_fullsized":"2024-05-10T14:07:11.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:37.223380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.476218+0000","last_change":"2024-05-10T14:02:36.760142+0000","last_active":"2024-05-10T14:07:17.476218+0000","last_peered":"2024-05-10T14:07:17.476218+0000","last_clean":"2024-05-10T14:07:17.476218+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:17.476218+0000","last_undegraded":"2024-05-10T14:07:17.476218+0000","last_fullsized":"2024-05-10T14:07:17.476218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074532+0000","last_change":"2024-05-10T14:02:38.730961+0000","last_active":"2024-05-10T14:07:12.074532+0000","last_peered":"2024-05-10T14:07:12.074532+0000","last_clean":"2024-05-10T14:07:12.074532+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:12.074532+0000","last_undegraded":"2024-05-10T14:07:12.074532+0000","last_fullsized":"2024-05-10T14:07:12.074532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:48.214147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076855+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076855+0000","last_peered":"2024-05-10T14:07:12.076855+0000","last_clean":"2024-05-10T14:07:12.076855+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076855+0000","last_undegraded":"2024-05-10T14:07:12.076855+0000","last_fullsized":"2024-05-10T14:07:12.076855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:40:32.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"80'1","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.556280+0000","last_change":"2024-05-10T14:02:32.687921+0000","last_active":"2024-05-10T14:07:11.556280+0000","last_peered":"2024-05-10T14:07:11.556280+0000","last_clean":"2024-05-10T14:07:11.556280+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:11.556280+0000","last_undegraded":"2024-05-10T14:07:11.556280+0000","last_fullsized":"2024-05-10T14:07:11.556280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073951+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:12.073951+0000","last_peered":"2024-05-10T14:07:12.073951+0000","last_clean":"2024-05-10T14:07:12.073951+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:12.073951+0000","last_undegraded":"2024-05-10T14:07:12.073951+0000","last_fullsized":"2024-05-10T14:07:12.073951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074796+0000","last_change":"2024-05-10T14:02:34.699359+0000","last_active":"2024-05-10T14:07:12.074796+0000","last_peered":"2024-05-10T14:07:12.074796+0000","last_clean":"2024-05-10T14:07:12.074796+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:12.074796+0000","last_undegraded":"2024-05-10T14:07:12.074796+0000","last_fullsized":"2024-05-10T14:07:12.074796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:27.662663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550304+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550304+0000","last_peered":"2024-05-10T14:07:11.550304+0000","last_clean":"2024-05-10T14:07:11.550304+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550304+0000","last_undegraded":"2024-05-10T14:07:11.550304+0000","last_fullsized":"2024-05-10T14:07:11.550304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:45.570924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"151'18","reported_seq":284,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.322718+0000","last_change":"2024-05-10T14:02:38.714976+0000","last_active":"2024-05-10T14:07:17.322718+0000","last_peered":"2024-05-10T14:07:17.322718+0000","last_clean":"2024-05-10T14:07:17.322718+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:17.322718+0000","last_undegraded":"2024-05-10T14:07:17.322718+0000","last_fullsized":"2024-05-10T14:07:17.322718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:25.265085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075606+0000","last_change":"2024-05-10T14:06:56.397481+0000","last_active":"2024-05-10T14:07:12.075606+0000","last_peered":"2024-05-10T14:07:12.075606+0000","last_clean":"2024-05-10T14:07:12.075606+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:12.075606+0000","last_undegraded":"2024-05-10T14:07:12.075606+0000","last_fullsized":"2024-05-10T14:07:12.075606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:53.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549410+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:11.549410+0000","last_peered":"2024-05-10T14:07:11.549410+0000","last_clean":"2024-05-10T14:07:11.549410+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:11.549410+0000","last_undegraded":"2024-05-10T14:07:11.549410+0000","last_fullsized":"2024-05-10T14:07:11.549410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:51:21.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075825+0000","last_change":"2024-05-10T14:04:06.314434+0000","last_active":"2024-05-10T14:07:12.075825+0000","last_peered":"2024-05-10T14:07:12.075825+0000","last_clean":"2024-05-10T14:07:12.075825+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:12.075825+0000","last_undegraded":"2024-05-10T14:07:12.075825+0000","last_fullsized":"2024-05-10T14:07:12.075825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:57.198173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080246+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080246+0000","last_peered":"2024-05-10T14:07:12.080246+0000","last_clean":"2024-05-10T14:07:12.080246+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080246+0000","last_undegraded":"2024-05-10T14:07:12.080246+0000","last_fullsized":"2024-05-10T14:07:12.080246+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:02.136988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"151'19","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.519257+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:17.519257+0000","last_peered":"2024-05-10T14:07:17.519257+0000","last_clean":"2024-05-10T14:07:17.519257+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:17.519257+0000","last_undegraded":"2024-05-10T14:07:17.519257+0000","last_fullsized":"2024-05-10T14:07:17.519257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:40:07.100982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073301+0000","last_change":"2024-05-10T14:02:38.722117+0000","last_active":"2024-05-10T14:07:12.073301+0000","last_peered":"2024-05-10T14:07:12.073301+0000","last_clean":"2024-05-10T14:07:12.073301+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:12.073301+0000","last_undegraded":"2024-05-10T14:07:12.073301+0000","last_fullsized":"2024-05-10T14:07:12.073301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083848+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083848+0000","last_peered":"2024-05-10T14:07:12.083848+0000","last_clean":"2024-05-10T14:07:12.083848+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083848+0000","last_undegraded":"2024-05-10T14:07:12.083848+0000","last_fullsized":"2024-05-10T14:07:12.083848+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:41:06.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550727+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:11.550727+0000","last_peered":"2024-05-10T14:07:11.550727+0000","last_clean":"2024-05-10T14:07:11.550727+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:11.550727+0000","last_undegraded":"2024-05-10T14:07:11.550727+0000","last_fullsized":"2024-05-10T14:07:11.550727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:09.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076368+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076368+0000","last_peered":"2024-05-10T14:07:12.076368+0000","last_clean":"2024-05-10T14:07:12.076368+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076368+0000","last_undegraded":"2024-05-10T14:07:12.076368+0000","last_fullsized":"2024-05-10T14:07:12.076368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:48.782443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077422+0000","last_change":"2024-05-10T14:04:06.316887+0000","last_active":"2024-05-10T14:07:12.077422+0000","last_peered":"2024-05-10T14:07:12.077422+0000","last_clean":"2024-05-10T14:07:12.077422+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:12.077422+0000","last_undegraded":"2024-05-10T14:07:12.077422+0000","last_fullsized":"2024-05-10T14:07:12.077422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:48.001881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"151'13","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.527765+0000","last_change":"2024-05-10T14:02:36.694965+0000","last_active":"2024-05-10T14:07:17.527765+0000","last_peered":"2024-05-10T14:07:17.527765+0000","last_clean":"2024-05-10T14:07:17.527765+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:17.527765+0000","last_undegraded":"2024-05-10T14:07:17.527765+0000","last_fullsized":"2024-05-10T14:07:17.527765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077934+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:12.077934+0000","last_peered":"2024-05-10T14:07:12.077934+0000","last_clean":"2024-05-10T14:07:12.077934+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:12.077934+0000","last_undegraded":"2024-05-10T14:07:12.077934+0000","last_fullsized":"2024-05-10T14:07:12.077934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:37:06.266810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551343+0000","last_change":"2024-05-10T14:02:40.757047+0000","last_active":"2024-05-10T14:07:11.551343+0000","last_peered":"2024-05-10T14:07:11.551343+0000","last_clean":"2024-05-10T14:07:11.551343+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:11.551343+0000","last_undegraded":"2024-05-10T14:07:11.551343+0000","last_fullsized":"2024-05-10T14:07:11.551343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167479+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:22.167479+0000","last_peered":"2024-05-10T14:07:22.167479+0000","last_clean":"2024-05-10T14:07:22.167479+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:22.167479+0000","last_undegraded":"2024-05-10T14:07:22.167479+0000","last_fullsized":"2024-05-10T14:07:22.167479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552219+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552219+0000","last_peered":"2024-05-10T14:07:11.552219+0000","last_clean":"2024-05-10T14:07:11.552219+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552219+0000","last_undegraded":"2024-05-10T14:07:11.552219+0000","last_fullsized":"2024-05-10T14:07:11.552219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548297+0000","last_change":"2024-05-10T14:02:34.693798+0000","last_active":"2024-05-10T14:07:11.548297+0000","last_peered":"2024-05-10T14:07:11.548297+0000","last_clean":"2024-05-10T14:07:11.548297+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:11.548297+0000","last_undegraded":"2024-05-10T14:07:11.548297+0000","last_fullsized":"2024-05-10T14:07:11.548297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:06:45.243375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"151'9","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.463440+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:17.463440+0000","last_peered":"2024-05-10T14:07:17.463440+0000","last_clean":"2024-05-10T14:07:17.463440+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:17.463440+0000","last_undegraded":"2024-05-10T14:07:17.463440+0000","last_fullsized":"2024-05-10T14:07:17.463440+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548528+0000","last_change":"2024-05-10T14:02:38.710501+0000","last_active":"2024-05-10T14:07:11.548528+0000","last_peered":"2024-05-10T14:07:11.548528+0000","last_clean":"2024-05-10T14:07:11.548528+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:11.548528+0000","last_undegraded":"2024-05-10T14:07:11.548528+0000","last_fullsized":"2024-05-10T14:07:11.548528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:37:32.855968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083967+0000","last_change":"2024-05-10T14:06:56.395131+0000","last_active":"2024-05-10T14:07:12.083967+0000","last_peered":"2024-05-10T14:07:12.083967+0000","last_clean":"2024-05-10T14:07:12.083967+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:12.083967+0000","last_undegraded":"2024-05-10T14:07:12.083967+0000","last_fullsized":"2024-05-10T14:07:12.083967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:03:18.090373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548928+0000","last_change":"2024-05-10T14:02:32.681531+0000","last_active":"2024-05-10T14:07:11.548928+0000","last_peered":"2024-05-10T14:07:11.548928+0000","last_clean":"2024-05-10T14:07:11.548928+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:11.548928+0000","last_undegraded":"2024-05-10T14:07:11.548928+0000","last_fullsized":"2024-05-10T14:07:11.548928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:48.882546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075725+0000","last_change":"2024-05-10T14:04:06.329806+0000","last_active":"2024-05-10T14:07:12.075725+0000","last_peered":"2024-05-10T14:07:12.075725+0000","last_clean":"2024-05-10T14:07:12.075725+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:12.075725+0000","last_undegraded":"2024-05-10T14:07:12.075725+0000","last_fullsized":"2024-05-10T14:07:12.075725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072487+0000","last_change":"2024-05-10T14:04:06.305942+0000","last_active":"2024-05-10T14:07:12.072487+0000","last_peered":"2024-05-10T14:07:12.072487+0000","last_clean":"2024-05-10T14:07:12.072487+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:12.072487+0000","last_undegraded":"2024-05-10T14:07:12.072487+0000","last_fullsized":"2024-05-10T14:07:12.072487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:00.089404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"151'13","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.482371+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:17.482371+0000","last_peered":"2024-05-10T14:07:17.482371+0000","last_clean":"2024-05-10T14:07:17.482371+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:17.482371+0000","last_undegraded":"2024-05-10T14:07:17.482371+0000","last_fullsized":"2024-05-10T14:07:17.482371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:21.295368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073782+0000","last_change":"2024-05-10T14:02:38.728257+0000","last_active":"2024-05-10T14:07:12.073782+0000","last_peered":"2024-05-10T14:07:12.073782+0000","last_clean":"2024-05-10T14:07:12.073782+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:12.073782+0000","last_undegraded":"2024-05-10T14:07:12.073782+0000","last_fullsized":"2024-05-10T14:07:12.073782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":245,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551894+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:11.551894+0000","last_peered":"2024-05-10T14:07:11.551894+0000","last_clean":"2024-05-10T14:07:11.551894+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:11.551894+0000","last_undegraded":"2024-05-10T14:07:11.551894+0000","last_fullsized":"2024-05-10T14:07:11.551894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:18.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074845+0000","last_change":"2024-05-10T14:02:32.696955+0000","last_active":"2024-05-10T14:07:12.074845+0000","last_peered":"2024-05-10T14:07:12.074845+0000","last_clean":"2024-05-10T14:07:12.074845+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:12.074845+0000","last_undegraded":"2024-05-10T14:07:12.074845+0000","last_fullsized":"2024-05-10T14:07:12.074845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:45:23.434029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075455+0000","last_change":"2024-05-10T14:02:30.661047+0000","last_active":"2024-05-10T14:07:12.075455+0000","last_peered":"2024-05-10T14:07:12.075455+0000","last_clean":"2024-05-10T14:07:12.075455+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:12.075455+0000","last_undegraded":"2024-05-10T14:07:12.075455+0000","last_fullsized":"2024-05-10T14:07:12.075455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:25:59.997458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074818+0000","last_change":"2024-05-10T14:02:32.693332+0000","last_active":"2024-05-10T14:07:12.074818+0000","last_peered":"2024-05-10T14:07:12.074818+0000","last_clean":"2024-05-10T14:07:12.074818+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:12.074818+0000","last_undegraded":"2024-05-10T14:07:12.074818+0000","last_fullsized":"2024-05-10T14:07:12.074818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:24.206529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551771+0000","last_change":"2024-05-10T14:04:06.320454+0000","last_active":"2024-05-10T14:07:11.551771+0000","last_peered":"2024-05-10T14:07:11.551771+0000","last_clean":"2024-05-10T14:07:11.551771+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:11.551771+0000","last_undegraded":"2024-05-10T14:07:11.551771+0000","last_fullsized":"2024-05-10T14:07:11.551771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076611+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076611+0000","last_peered":"2024-05-10T14:07:12.076611+0000","last_clean":"2024-05-10T14:07:12.076611+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076611+0000","last_undegraded":"2024-05-10T14:07:12.076611+0000","last_fullsized":"2024-05-10T14:07:12.076611+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:15:12.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074891+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.074891+0000","last_peered":"2024-05-10T14:07:12.074891+0000","last_clean":"2024-05-10T14:07:12.074891+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.074891+0000","last_undegraded":"2024-05-10T14:07:12.074891+0000","last_fullsized":"2024-05-10T14:07:12.074891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:03.931387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073614+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073614+0000","last_peered":"2024-05-10T14:07:12.073614+0000","last_clean":"2024-05-10T14:07:12.073614+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073614+0000","last_undegraded":"2024-05-10T14:07:12.073614+0000","last_fullsized":"2024-05-10T14:07:12.073614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:20:11.672776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074170+0000","last_change":"2024-05-10T14:03:11.211794+0000","last_active":"2024-05-10T14:07:12.074170+0000","last_peered":"2024-05-10T14:07:12.074170+0000","last_clean":"2024-05-10T14:07:12.074170+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:12.074170+0000","last_undegraded":"2024-05-10T14:07:12.074170+0000","last_fullsized":"2024-05-10T14:07:12.074170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554136+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554136+0000","last_peered":"2024-05-10T14:07:11.554136+0000","last_clean":"2024-05-10T14:07:11.554136+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554136+0000","last_undegraded":"2024-05-10T14:07:11.554136+0000","last_fullsized":"2024-05-10T14:07:11.554136+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550692+0000","last_change":"2024-05-10T14:06:12.277479+0000","last_active":"2024-05-10T14:07:11.550692+0000","last_peered":"2024-05-10T14:07:11.550692+0000","last_clean":"2024-05-10T14:07:11.550692+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:11.550692+0000","last_undegraded":"2024-05-10T14:07:11.550692+0000","last_fullsized":"2024-05-10T14:07:11.550692+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551139+0000","last_change":"2024-05-10T14:02:32.694857+0000","last_active":"2024-05-10T14:07:11.551139+0000","last_peered":"2024-05-10T14:07:11.551139+0000","last_clean":"2024-05-10T14:07:11.551139+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:11.551139+0000","last_undegraded":"2024-05-10T14:07:11.551139+0000","last_fullsized":"2024-05-10T14:07:11.551139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:33.807760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075117+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075117+0000","last_peered":"2024-05-10T14:07:12.075117+0000","last_clean":"2024-05-10T14:07:12.075117+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075117+0000","last_undegraded":"2024-05-10T14:07:12.075117+0000","last_fullsized":"2024-05-10T14:07:12.075117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:33.442609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548860+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548860+0000","last_peered":"2024-05-10T14:07:11.548860+0000","last_clean":"2024-05-10T14:07:11.548860+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548860+0000","last_undegraded":"2024-05-10T14:07:11.548860+0000","last_fullsized":"2024-05-10T14:07:11.548860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081703+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081703+0000","last_peered":"2024-05-10T14:07:12.081703+0000","last_clean":"2024-05-10T14:07:12.081703+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081703+0000","last_undegraded":"2024-05-10T14:07:12.081703+0000","last_fullsized":"2024-05-10T14:07:12.081703+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:52:31.965331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075918+0000","last_change":"2024-05-10T14:02:32.672643+0000","last_active":"2024-05-10T14:07:12.075918+0000","last_peered":"2024-05-10T14:07:12.075918+0000","last_clean":"2024-05-10T14:07:12.075918+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:12.075918+0000","last_undegraded":"2024-05-10T14:07:12.075918+0000","last_fullsized":"2024-05-10T14:07:12.075918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:31:53.320859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554587+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554587+0000","last_peered":"2024-05-10T14:07:11.554587+0000","last_clean":"2024-05-10T14:07:11.554587+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554587+0000","last_undegraded":"2024-05-10T14:07:11.554587+0000","last_fullsized":"2024-05-10T14:07:11.554587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174633+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.174633+0000","last_peered":"2024-05-10T14:07:12.174633+0000","last_clean":"2024-05-10T14:07:12.174633+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.174633+0000","last_undegraded":"2024-05-10T14:07:12.174633+0000","last_fullsized":"2024-05-10T14:07:12.174633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074010+0000","last_change":"2024-05-10T14:04:06.312134+0000","last_active":"2024-05-10T14:07:12.074010+0000","last_peered":"2024-05-10T14:07:12.074010+0000","last_clean":"2024-05-10T14:07:12.074010+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:12.074010+0000","last_undegraded":"2024-05-10T14:07:12.074010+0000","last_fullsized":"2024-05-10T14:07:12.074010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:38.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550945+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:11.550945+0000","last_peered":"2024-05-10T14:07:11.550945+0000","last_clean":"2024-05-10T14:07:11.550945+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:11.550945+0000","last_undegraded":"2024-05-10T14:07:11.550945+0000","last_fullsized":"2024-05-10T14:07:11.550945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:55:19.220171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549226+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549226+0000","last_peered":"2024-05-10T14:07:11.549226+0000","last_clean":"2024-05-10T14:07:11.549226+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549226+0000","last_undegraded":"2024-05-10T14:07:11.549226+0000","last_fullsized":"2024-05-10T14:07:11.549226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"80'1","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.555440+0000","last_change":"2024-05-10T14:02:32.682464+0000","last_active":"2024-05-10T14:07:11.555440+0000","last_peered":"2024-05-10T14:07:11.555440+0000","last_clean":"2024-05-10T14:07:11.555440+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:11.555440+0000","last_undegraded":"2024-05-10T14:07:11.555440+0000","last_fullsized":"2024-05-10T14:07:11.555440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":230,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552217+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:11.552217+0000","last_peered":"2024-05-10T14:07:11.552217+0000","last_clean":"2024-05-10T14:07:11.552217+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:11.552217+0000","last_undegraded":"2024-05-10T14:07:11.552217+0000","last_fullsized":"2024-05-10T14:07:11.552217+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551230+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551230+0000","last_peered":"2024-05-10T14:07:11.551230+0000","last_clean":"2024-05-10T14:07:11.551230+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551230+0000","last_undegraded":"2024-05-10T14:07:11.551230+0000","last_fullsized":"2024-05-10T14:07:11.551230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:24:00.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074394+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074394+0000","last_peered":"2024-05-10T14:07:12.074394+0000","last_clean":"2024-05-10T14:07:12.074394+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074394+0000","last_undegraded":"2024-05-10T14:07:12.074394+0000","last_fullsized":"2024-05-10T14:07:12.074394+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082252+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082252+0000","last_peered":"2024-05-10T14:07:12.082252+0000","last_clean":"2024-05-10T14:07:12.082252+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082252+0000","last_undegraded":"2024-05-10T14:07:12.082252+0000","last_fullsized":"2024-05-10T14:07:12.082252+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:12.671163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":261,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079069+0000","last_change":"2024-05-10T14:02:30.653980+0000","last_active":"2024-05-10T14:07:12.079069+0000","last_peered":"2024-05-10T14:07:12.079069+0000","last_clean":"2024-05-10T14:07:12.079069+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:12.079069+0000","last_undegraded":"2024-05-10T14:07:12.079069+0000","last_fullsized":"2024-05-10T14:07:12.079069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:40:31.154944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073568+0000","last_change":"2024-05-10T14:02:32.692407+0000","last_active":"2024-05-10T14:07:12.073568+0000","last_peered":"2024-05-10T14:07:12.073568+0000","last_clean":"2024-05-10T14:07:12.073568+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:12.073568+0000","last_undegraded":"2024-05-10T14:07:12.073568+0000","last_fullsized":"2024-05-10T14:07:12.073568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083448+0000","last_change":"2024-05-10T14:06:56.379964+0000","last_active":"2024-05-10T14:07:12.083448+0000","last_peered":"2024-05-10T14:07:12.083448+0000","last_clean":"2024-05-10T14:07:12.083448+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:12.083448+0000","last_undegraded":"2024-05-10T14:07:12.083448+0000","last_fullsized":"2024-05-10T14:07:12.083448+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:43:42.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548793+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548793+0000","last_peered":"2024-05-10T14:07:11.548793+0000","last_clean":"2024-05-10T14:07:11.548793+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548793+0000","last_undegraded":"2024-05-10T14:07:11.548793+0000","last_fullsized":"2024-05-10T14:07:11.548793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.158762+0000","last_change":"2024-05-10T14:02:30.650695+0000","last_active":"2024-05-10T14:07:12.158762+0000","last_peered":"2024-05-10T14:07:12.158762+0000","last_clean":"2024-05-10T14:07:12.158762+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:12.158762+0000","last_undegraded":"2024-05-10T14:07:12.158762+0000","last_fullsized":"2024-05-10T14:07:12.158762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076236+0000","last_change":"2024-05-10T14:06:56.362971+0000","last_active":"2024-05-10T14:07:12.076236+0000","last_peered":"2024-05-10T14:07:12.076236+0000","last_clean":"2024-05-10T14:07:12.076236+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:12.076236+0000","last_undegraded":"2024-05-10T14:07:12.076236+0000","last_fullsized":"2024-05-10T14:07:12.076236+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:28.832576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079546+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079546+0000","last_peered":"2024-05-10T14:07:12.079546+0000","last_clean":"2024-05-10T14:07:12.079546+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079546+0000","last_undegraded":"2024-05-10T14:07:12.079546+0000","last_fullsized":"2024-05-10T14:07:12.079546+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:00:32.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":176,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074240+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074240+0000","last_peered":"2024-05-10T14:07:12.074240+0000","last_clean":"2024-05-10T14:07:12.074240+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074240+0000","last_undegraded":"2024-05-10T14:07:12.074240+0000","last_fullsized":"2024-05-10T14:07:12.074240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:10:35.600723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757090+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:20.757090+0000","last_peered":"2024-05-10T14:07:20.757090+0000","last_clean":"2024-05-10T14:07:20.757090+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:20.757090+0000","last_undegraded":"2024-05-10T14:07:20.757090+0000","last_fullsized":"2024-05-10T14:07:20.757090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072892+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072892+0000","last_peered":"2024-05-10T14:07:12.072892+0000","last_clean":"2024-05-10T14:07:12.072892+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072892+0000","last_undegraded":"2024-05-10T14:07:12.072892+0000","last_fullsized":"2024-05-10T14:07:12.072892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:36.638560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'1","reported_seq":179,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079146+0000","last_change":"2024-05-10T14:04:06.325323+0000","last_active":"2024-05-10T14:07:12.079146+0000","last_peered":"2024-05-10T14:07:12.079146+0000","last_clean":"2024-05-10T14:07:12.079146+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:12.079146+0000","last_undegraded":"2024-05-10T14:07:12.079146+0000","last_fullsized":"2024-05-10T14:07:12.079146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:21.120837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":887,"num_read_kb":646,"num_write":483,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":536,"ondisk_log_size":536,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39720,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332120,"statfs":{"total":96636764160,"available":96596090880,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710761,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33536,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338304,"statfs":{"total":96636764160,"available":96602423296,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41244,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330596,"statfs":{"total":96636764160,"available":96594530304,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39168,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332672,"statfs":{"total":96636764160,"available":96596656128,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37724,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334116,"statfs":{"total":96636764160,"available":96598134784,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37148,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334692,"statfs":{"total":96636764160,"available":96598724608,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:24.472 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.473 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.473 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.473 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.473 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.473 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.474 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.475 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.476 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.477 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.478 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.479 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.480 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.481 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.482 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.483 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.483 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.483 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.483 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.484 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.485 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.486 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.487 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.488 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T14:02:18.520766+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=18, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.489 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.490 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.490 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.490 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.490 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.490 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.491 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.492 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.493 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.494 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.495 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.496 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.497 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.498 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.498 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.498 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.498 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.498 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.499 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.500 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.501 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.502 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.503 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.504 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.505 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.506 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.506 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.506 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.506 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.506 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.507 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.508 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.509 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.510 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.511 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.512 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.513 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.514 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:24.515 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T14:07:44.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:07:44.890 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:07:44.896 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:07:44.911 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-05-10T14:07:44.232367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1042,"num_read_kb":785,"num_write":639,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":885,"ondisk_log_size":885,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302664,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672056,"statfs":{"total":773094113280,"available":772784185344,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007022"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.237641+0000","last_change":"2024-05-10T14:07:32.237708+0000","last_active":"2024-05-10T14:07:32.237641+0000","last_peered":"2024-05-10T14:07:32.237641+0000","last_clean":"2024-05-10T14:07:32.237641+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:32.237641+0000","last_undegraded":"2024-05-10T14:07:32.237641+0000","last_fullsized":"2024-05-10T14:07:32.237641+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.237436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:27.467926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.602388+0000","last_change":"2024-05-10T14:07:32.602442+0000","last_active":"2024-05-10T14:07:32.602388+0000","last_peered":"2024-05-10T14:07:32.602388+0000","last_clean":"2024-05-10T14:07:32.602388+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:32.602388+0000","last_undegraded":"2024-05-10T14:07:32.602388+0000","last_fullsized":"2024-05-10T14:07:32.602388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.602188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:02.195947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.416102+0000","last_change":"2024-05-10T14:07:38.416269+0000","last_active":"2024-05-10T14:07:38.416102+0000","last_peered":"2024-05-10T14:07:38.416102+0000","last_clean":"2024-05-10T14:07:38.416102+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:38.416102+0000","last_undegraded":"2024-05-10T14:07:38.416102+0000","last_fullsized":"2024-05-10T14:07:38.416102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.415868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:46.847601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.226377+0000","last_change":"2024-05-10T14:07:35.226431+0000","last_active":"2024-05-10T14:07:35.226377+0000","last_peered":"2024-05-10T14:07:35.226377+0000","last_clean":"2024-05-10T14:07:35.226377+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:35.226377+0000","last_undegraded":"2024-05-10T14:07:35.226377+0000","last_fullsized":"2024-05-10T14:07:35.226377+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.226183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:23.586119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074103+0000","last_change":"2024-05-10T14:02:30.635978+0000","last_active":"2024-05-10T14:07:12.074103+0000","last_peered":"2024-05-10T14:07:12.074103+0000","last_clean":"2024-05-10T14:07:12.074103+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:12.074103+0000","last_undegraded":"2024-05-10T14:07:12.074103+0000","last_fullsized":"2024-05-10T14:07:12.074103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.665549+0000","last_change":"2024-05-10T14:07:27.665549+0000","last_active":"2024-05-10T14:07:27.665549+0000","last_peered":"2024-05-10T14:07:27.665549+0000","last_clean":"2024-05-10T14:07:27.665549+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:27.665549+0000","last_undegraded":"2024-05-10T14:07:27.665549+0000","last_fullsized":"2024-05-10T14:07:27.665549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.665294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:00.718867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076042+0000","last_change":"2024-05-10T14:04:06.312017+0000","last_active":"2024-05-10T14:07:12.076042+0000","last_peered":"2024-05-10T14:07:12.076042+0000","last_clean":"2024-05-10T14:07:12.076042+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:12.076042+0000","last_undegraded":"2024-05-10T14:07:12.076042+0000","last_fullsized":"2024-05-10T14:07:12.076042+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757237+0000","last_change":"2024-05-10T14:02:32.677366+0000","last_active":"2024-05-10T14:07:20.757237+0000","last_peered":"2024-05-10T14:07:20.757237+0000","last_clean":"2024-05-10T14:07:20.757237+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:20.757237+0000","last_undegraded":"2024-05-10T14:07:20.757237+0000","last_fullsized":"2024-05-10T14:07:20.757237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.267702+0000","last_change":"2024-05-10T14:07:30.267764+0000","last_active":"2024-05-10T14:07:30.267702+0000","last_peered":"2024-05-10T14:07:30.267702+0000","last_clean":"2024-05-10T14:07:30.267702+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:30.267702+0000","last_undegraded":"2024-05-10T14:07:30.267702+0000","last_fullsized":"2024-05-10T14:07:30.267702+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.267501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:53.900308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.371220+0000","last_change":"2024-05-10T14:07:38.371368+0000","last_active":"2024-05-10T14:07:38.371220+0000","last_peered":"2024-05-10T14:07:38.371220+0000","last_clean":"2024-05-10T14:07:38.371220+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:38.371220+0000","last_undegraded":"2024-05-10T14:07:38.371220+0000","last_fullsized":"2024-05-10T14:07:38.371220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.370951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:36.149428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075312+0000","last_change":"2024-05-10T14:04:06.322910+0000","last_active":"2024-05-10T14:07:12.075312+0000","last_peered":"2024-05-10T14:07:12.075312+0000","last_clean":"2024-05-10T14:07:12.075312+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:12.075312+0000","last_undegraded":"2024-05-10T14:07:12.075312+0000","last_fullsized":"2024-05-10T14:07:12.075312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.634740+0000","last_change":"2024-05-10T14:07:30.634849+0000","last_active":"2024-05-10T14:07:30.634740+0000","last_peered":"2024-05-10T14:07:30.634740+0000","last_clean":"2024-05-10T14:07:30.634740+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:30.634740+0000","last_undegraded":"2024-05-10T14:07:30.634740+0000","last_fullsized":"2024-05-10T14:07:30.634740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.634509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:32.832602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080870+0000","last_change":"2024-05-10T14:06:56.357790+0000","last_active":"2024-05-10T14:07:12.080870+0000","last_peered":"2024-05-10T14:07:12.080870+0000","last_clean":"2024-05-10T14:07:12.080870+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:12.080870+0000","last_undegraded":"2024-05-10T14:07:12.080870+0000","last_fullsized":"2024-05-10T14:07:12.080870+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.632741+0000","last_change":"2024-05-10T14:07:24.632859+0000","last_active":"2024-05-10T14:07:24.632741+0000","last_peered":"2024-05-10T14:07:24.632741+0000","last_clean":"2024-05-10T14:07:24.632741+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:24.632741+0000","last_undegraded":"2024-05-10T14:07:24.632741+0000","last_fullsized":"2024-05-10T14:07:24.632741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.632488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:19.285245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.716664+0000","last_change":"2024-05-10T14:07:22.716664+0000","last_active":"2024-05-10T14:07:22.716664+0000","last_peered":"2024-05-10T14:07:22.716664+0000","last_clean":"2024-05-10T14:07:22.716664+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:22.716664+0000","last_undegraded":"2024-05-10T14:07:22.716664+0000","last_fullsized":"2024-05-10T14:07:22.716664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.716512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:08.219910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.936216+0000","last_change":"2024-05-10T14:07:31.936276+0000","last_active":"2024-05-10T14:07:31.936216+0000","last_peered":"2024-05-10T14:07:31.936216+0000","last_clean":"2024-05-10T14:07:31.936216+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:31.936216+0000","last_undegraded":"2024-05-10T14:07:31.936216+0000","last_fullsized":"2024-05-10T14:07:31.936216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.936022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:58.355521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.661027+0000","last_change":"2024-05-10T14:07:36.661124+0000","last_active":"2024-05-10T14:07:36.661027+0000","last_peered":"2024-05-10T14:07:36.661027+0000","last_clean":"2024-05-10T14:07:36.661027+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:36.661027+0000","last_undegraded":"2024-05-10T14:07:36.661027+0000","last_fullsized":"2024-05-10T14:07:36.661027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:58.013075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.104577+0000","last_change":"2024-05-10T14:07:42.104635+0000","last_active":"2024-05-10T14:07:42.104577+0000","last_peered":"2024-05-10T14:07:42.104577+0000","last_clean":"2024-05-10T14:07:42.104577+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:42.104577+0000","last_undegraded":"2024-05-10T14:07:42.104577+0000","last_fullsized":"2024-05-10T14:07:42.104577+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.104368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:16.126208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'1","reported_seq":41,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081524+0000","last_change":"2024-05-10T14:06:56.479011+0000","last_active":"2024-05-10T14:07:12.081524+0000","last_peered":"2024-05-10T14:07:12.081524+0000","last_clean":"2024-05-10T14:07:12.081524+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:12.081524+0000","last_undegraded":"2024-05-10T14:07:12.081524+0000","last_fullsized":"2024-05-10T14:07:12.081524+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.449415+0000","last_change":"2024-05-10T14:07:41.449514+0000","last_active":"2024-05-10T14:07:41.449415+0000","last_peered":"2024-05-10T14:07:41.449415+0000","last_clean":"2024-05-10T14:07:41.449415+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:41.449415+0000","last_undegraded":"2024-05-10T14:07:41.449415+0000","last_fullsized":"2024-05-10T14:07:41.449415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.449090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:15:30.448952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.611226+0000","last_change":"2024-05-10T14:07:37.611279+0000","last_active":"2024-05-10T14:07:37.611226+0000","last_peered":"2024-05-10T14:07:37.611226+0000","last_clean":"2024-05-10T14:07:37.611226+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:37.611226+0000","last_undegraded":"2024-05-10T14:07:37.611226+0000","last_fullsized":"2024-05-10T14:07:37.611226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.611035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:58.598206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.170989+0000","last_change":"2024-05-10T14:04:06.321333+0000","last_active":"2024-05-10T14:07:22.170989+0000","last_peered":"2024-05-10T14:07:22.170989+0000","last_clean":"2024-05-10T14:07:22.170989+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:22.170989+0000","last_undegraded":"2024-05-10T14:07:22.170989+0000","last_fullsized":"2024-05-10T14:07:22.170989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.998725+0000","last_change":"2024-05-10T14:07:29.998792+0000","last_active":"2024-05-10T14:07:29.998725+0000","last_peered":"2024-05-10T14:07:29.998725+0000","last_clean":"2024-05-10T14:07:29.998725+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:29.998725+0000","last_undegraded":"2024-05-10T14:07:29.998725+0000","last_fullsized":"2024-05-10T14:07:29.998725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.998522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:47.669886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.174164+0000","last_change":"2024-05-10T14:02:30.663758+0000","last_active":"2024-05-10T14:07:22.174164+0000","last_peered":"2024-05-10T14:07:22.174164+0000","last_clean":"2024-05-10T14:07:22.174164+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:22.174164+0000","last_undegraded":"2024-05-10T14:07:22.174164+0000","last_fullsized":"2024-05-10T14:07:22.174164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.961826+0000","last_change":"2024-05-10T14:07:30.961888+0000","last_active":"2024-05-10T14:07:30.961826+0000","last_peered":"2024-05-10T14:07:30.961826+0000","last_clean":"2024-05-10T14:07:30.961826+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:30.961826+0000","last_undegraded":"2024-05-10T14:07:30.961826+0000","last_fullsized":"2024-05-10T14:07:30.961826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.961576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:58:37.950718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167441+0000","last_change":"2024-05-10T14:02:30.650884+0000","last_active":"2024-05-10T14:07:22.167441+0000","last_peered":"2024-05-10T14:07:22.167441+0000","last_clean":"2024-05-10T14:07:22.167441+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:22.167441+0000","last_undegraded":"2024-05-10T14:07:22.167441+0000","last_fullsized":"2024-05-10T14:07:22.167441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.692789+0000","last_change":"2024-05-10T14:07:32.692849+0000","last_active":"2024-05-10T14:07:32.692789+0000","last_peered":"2024-05-10T14:07:32.692789+0000","last_clean":"2024-05-10T14:07:32.692789+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:32.692789+0000","last_undegraded":"2024-05-10T14:07:32.692789+0000","last_fullsized":"2024-05-10T14:07:32.692789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.692565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:52:59.551145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174408+0000","last_change":"2024-05-10T14:02:30.647821+0000","last_active":"2024-05-10T14:07:12.174408+0000","last_peered":"2024-05-10T14:07:12.174408+0000","last_clean":"2024-05-10T14:07:12.174408+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:12.174408+0000","last_undegraded":"2024-05-10T14:07:12.174408+0000","last_fullsized":"2024-05-10T14:07:12.174408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.644834+0000","last_change":"2024-05-10T14:07:25.644834+0000","last_active":"2024-05-10T14:07:25.644834+0000","last_peered":"2024-05-10T14:07:25.644834+0000","last_clean":"2024-05-10T14:07:25.644834+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:25.644834+0000","last_undegraded":"2024-05-10T14:07:25.644834+0000","last_fullsized":"2024-05-10T14:07:25.644834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.644578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:23.828908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.952456+0000","last_change":"2024-05-10T14:07:38.952514+0000","last_active":"2024-05-10T14:07:38.952456+0000","last_peered":"2024-05-10T14:07:38.952456+0000","last_clean":"2024-05-10T14:07:38.952456+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:38.952456+0000","last_undegraded":"2024-05-10T14:07:38.952456+0000","last_fullsized":"2024-05-10T14:07:38.952456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.952232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:17.359369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080325+0000","last_change":"2024-05-10T14:06:56.356157+0000","last_active":"2024-05-10T14:07:12.080325+0000","last_peered":"2024-05-10T14:07:12.080325+0000","last_clean":"2024-05-10T14:07:12.080325+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:12.080325+0000","last_undegraded":"2024-05-10T14:07:12.080325+0000","last_fullsized":"2024-05-10T14:07:12.080325+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.606269+0000","last_change":"2024-05-10T14:07:29.606325+0000","last_active":"2024-05-10T14:07:29.606269+0000","last_peered":"2024-05-10T14:07:29.606269+0000","last_clean":"2024-05-10T14:07:29.606269+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:29.606269+0000","last_undegraded":"2024-05-10T14:07:29.606269+0000","last_fullsized":"2024-05-10T14:07:29.606269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.606068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:24.603115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"151'13","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757227+0000","last_change":"2024-05-10T14:06:56.463832+0000","last_active":"2024-05-10T14:07:20.757227+0000","last_peered":"2024-05-10T14:07:20.757227+0000","last_clean":"2024-05-10T14:07:20.757227+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:20.757227+0000","last_undegraded":"2024-05-10T14:07:20.757227+0000","last_fullsized":"2024-05-10T14:07:20.757227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.144113+0000","last_change":"2024-05-10T14:07:40.144171+0000","last_active":"2024-05-10T14:07:40.144113+0000","last_peered":"2024-05-10T14:07:40.144113+0000","last_clean":"2024-05-10T14:07:40.144113+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:40.144113+0000","last_undegraded":"2024-05-10T14:07:40.144113+0000","last_fullsized":"2024-05-10T14:07:40.144113+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.143924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:06.285310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"151'2","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.660750+0000","last_change":"2024-05-10T14:07:36.660899+0000","last_active":"2024-05-10T14:07:36.660750+0000","last_peered":"2024-05-10T14:07:36.660750+0000","last_clean":"2024-05-10T14:07:36.660750+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:36.660750+0000","last_undegraded":"2024-05-10T14:07:36.660750+0000","last_fullsized":"2024-05-10T14:07:36.660750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:47.156144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076539+0000","last_change":"2024-05-10T14:06:56.385149+0000","last_active":"2024-05-10T14:07:12.076539+0000","last_peered":"2024-05-10T14:07:12.076539+0000","last_clean":"2024-05-10T14:07:12.076539+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:12.076539+0000","last_undegraded":"2024-05-10T14:07:12.076539+0000","last_fullsized":"2024-05-10T14:07:12.076539+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":222,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072536+0000","last_change":"2024-05-10T14:06:56.395511+0000","last_active":"2024-05-10T14:07:12.072536+0000","last_peered":"2024-05-10T14:07:12.072536+0000","last_clean":"2024-05-10T14:07:12.072536+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:12.072536+0000","last_undegraded":"2024-05-10T14:07:12.072536+0000","last_fullsized":"2024-05-10T14:07:12.072536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.172429+0000","last_change":"2024-05-10T14:06:56.344157+0000","last_active":"2024-05-10T14:07:17.172429+0000","last_peered":"2024-05-10T14:07:17.172429+0000","last_clean":"2024-05-10T14:07:17.172429+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:17.172429+0000","last_undegraded":"2024-05-10T14:07:17.172429+0000","last_fullsized":"2024-05-10T14:07:17.172429+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"151'9","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.660022+0000","last_change":"2024-05-10T14:07:39.660111+0000","last_active":"2024-05-10T14:07:39.660022+0000","last_peered":"2024-05-10T14:07:39.660022+0000","last_clean":"2024-05-10T14:07:39.660022+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:39.660022+0000","last_undegraded":"2024-05-10T14:07:39.660022+0000","last_fullsized":"2024-05-10T14:07:39.660022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'9","last_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_deep_scrub":"151'9","last_deep_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.659812+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:39.197461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.630260+0000","last_change":"2024-05-10T14:07:23.630260+0000","last_active":"2024-05-10T14:07:23.630260+0000","last_peered":"2024-05-10T14:07:23.630260+0000","last_clean":"2024-05-10T14:07:23.630260+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:23.630260+0000","last_undegraded":"2024-05-10T14:07:23.630260+0000","last_fullsized":"2024-05-10T14:07:23.630260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.630010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:01.557663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.898720+0000","last_change":"2024-05-10T14:07:39.898720+0000","last_active":"2024-05-10T14:07:39.898720+0000","last_peered":"2024-05-10T14:07:39.898720+0000","last_clean":"2024-05-10T14:07:39.898720+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:39.898720+0000","last_undegraded":"2024-05-10T14:07:39.898720+0000","last_fullsized":"2024-05-10T14:07:39.898720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.898472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:05.577507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.756824+0000","last_change":"2024-05-10T14:02:32.679392+0000","last_active":"2024-05-10T14:07:20.756824+0000","last_peered":"2024-05-10T14:07:20.756824+0000","last_clean":"2024-05-10T14:07:20.756824+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:20.756824+0000","last_undegraded":"2024-05-10T14:07:20.756824+0000","last_fullsized":"2024-05-10T14:07:20.756824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080630+0000","last_change":"2024-05-10T14:06:56.357973+0000","last_active":"2024-05-10T14:07:12.080630+0000","last_peered":"2024-05-10T14:07:12.080630+0000","last_clean":"2024-05-10T14:07:12.080630+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:12.080630+0000","last_undegraded":"2024-05-10T14:07:12.080630+0000","last_fullsized":"2024-05-10T14:07:12.080630+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.745852+0000","last_change":"2024-05-10T14:07:38.745908+0000","last_active":"2024-05-10T14:07:38.745852+0000","last_peered":"2024-05-10T14:07:38.745852+0000","last_clean":"2024-05-10T14:07:38.745852+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:38.745852+0000","last_undegraded":"2024-05-10T14:07:38.745852+0000","last_fullsized":"2024-05-10T14:07:38.745852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.745597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:12.433474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"151'15","reported_seq":278,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.990369+0000","last_change":"2024-05-10T14:07:22.990427+0000","last_active":"2024-05-10T14:07:22.990369+0000","last_peered":"2024-05-10T14:07:22.990369+0000","last_clean":"2024-05-10T14:07:22.990369+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:22.990369+0000","last_undegraded":"2024-05-10T14:07:22.990369+0000","last_fullsized":"2024-05-10T14:07:22.990369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.990219+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:57.666673+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"151'18","reported_seq":44,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.677206+0000","last_change":"2024-05-10T14:06:56.503109+0000","last_active":"2024-05-10T14:07:17.677206+0000","last_peered":"2024-05-10T14:07:17.677206+0000","last_clean":"2024-05-10T14:07:17.677206+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:17.677206+0000","last_undegraded":"2024-05-10T14:07:17.677206+0000","last_fullsized":"2024-05-10T14:07:17.677206+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.637771+0000","last_change":"2024-05-10T14:02:40.757202+0000","last_active":"2024-05-10T14:07:22.637771+0000","last_peered":"2024-05-10T14:07:22.637771+0000","last_clean":"2024-05-10T14:07:22.637771+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:22.637771+0000","last_undegraded":"2024-05-10T14:07:22.637771+0000","last_fullsized":"2024-05-10T14:07:22.637771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167556+0000","last_change":"2024-05-10T14:06:56.376409+0000","last_active":"2024-05-10T14:07:22.167556+0000","last_peered":"2024-05-10T14:07:22.167556+0000","last_clean":"2024-05-10T14:07:22.167556+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:07:22.167556+0000","last_undegraded":"2024-05-10T14:07:22.167556+0000","last_fullsized":"2024-05-10T14:07:22.167556+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.369943+0000","last_change":"2024-05-10T14:07:35.370001+0000","last_active":"2024-05-10T14:07:35.369943+0000","last_peered":"2024-05-10T14:07:35.369943+0000","last_clean":"2024-05-10T14:07:35.369943+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:35.369943+0000","last_undegraded":"2024-05-10T14:07:35.369943+0000","last_fullsized":"2024-05-10T14:07:35.369943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.369718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:16.478783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079920+0000","last_change":"2024-05-10T14:04:06.305343+0000","last_active":"2024-05-10T14:07:12.079920+0000","last_peered":"2024-05-10T14:07:12.079920+0000","last_clean":"2024-05-10T14:07:12.079920+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:12.079920+0000","last_undegraded":"2024-05-10T14:07:12.079920+0000","last_fullsized":"2024-05-10T14:07:12.079920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"151'13","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.621232+0000","last_change":"2024-05-10T14:06:56.487074+0000","last_active":"2024-05-10T14:07:17.621232+0000","last_peered":"2024-05-10T14:07:17.621232+0000","last_clean":"2024-05-10T14:07:17.621232+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:17.621232+0000","last_undegraded":"2024-05-10T14:07:17.621232+0000","last_fullsized":"2024-05-10T14:07:17.621232+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"151'18","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.745533+0000","last_change":"2024-05-10T14:07:37.745595+0000","last_active":"2024-05-10T14:07:37.745533+0000","last_peered":"2024-05-10T14:07:37.745533+0000","last_clean":"2024-05-10T14:07:37.745533+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:37.745533+0000","last_undegraded":"2024-05-10T14:07:37.745533+0000","last_fullsized":"2024-05-10T14:07:37.745533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.745330+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:29.621889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074390+0000","last_change":"2024-05-10T14:06:56.383726+0000","last_active":"2024-05-10T14:07:12.074390+0000","last_peered":"2024-05-10T14:07:12.074390+0000","last_clean":"2024-05-10T14:07:12.074390+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:12.074390+0000","last_undegraded":"2024-05-10T14:07:12.074390+0000","last_fullsized":"2024-05-10T14:07:12.074390+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083408+0000","last_change":"2024-05-10T14:06:56.354807+0000","last_active":"2024-05-10T14:07:12.083408+0000","last_peered":"2024-05-10T14:07:12.083408+0000","last_clean":"2024-05-10T14:07:12.083408+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:12.083408+0000","last_undegraded":"2024-05-10T14:07:12.083408+0000","last_fullsized":"2024-05-10T14:07:12.083408+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.260202+0000","last_change":"2024-05-10T14:07:36.260256+0000","last_active":"2024-05-10T14:07:36.260202+0000","last_peered":"2024-05-10T14:07:36.260202+0000","last_clean":"2024-05-10T14:07:36.260202+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:36.260202+0000","last_undegraded":"2024-05-10T14:07:36.260202+0000","last_fullsized":"2024-05-10T14:07:36.260202+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.259997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:03.749329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"151'31","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.656642+0000","last_change":"2024-05-10T14:07:35.656737+0000","last_active":"2024-05-10T14:07:35.656642+0000","last_peered":"2024-05-10T14:07:35.656642+0000","last_clean":"2024-05-10T14:07:35.656642+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:35.656642+0000","last_undegraded":"2024-05-10T14:07:35.656642+0000","last_fullsized":"2024-05-10T14:07:35.656642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'31","last_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_deep_scrub":"151'31","last_deep_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.656449+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.334700+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073379+0000","last_change":"2024-05-10T14:04:06.319339+0000","last_active":"2024-05-10T14:07:12.073379+0000","last_peered":"2024-05-10T14:07:12.073379+0000","last_clean":"2024-05-10T14:07:12.073379+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:12.073379+0000","last_undegraded":"2024-05-10T14:07:12.073379+0000","last_fullsized":"2024-05-10T14:07:12.073379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.692534+0000","last_change":"2024-05-10T14:07:34.692594+0000","last_active":"2024-05-10T14:07:34.692534+0000","last_peered":"2024-05-10T14:07:34.692534+0000","last_clean":"2024-05-10T14:07:34.692534+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:34.692534+0000","last_undegraded":"2024-05-10T14:07:34.692534+0000","last_fullsized":"2024-05-10T14:07:34.692534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.692340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:57.318053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"151'2","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.684764+0000","last_change":"2024-05-10T14:07:29.684838+0000","last_active":"2024-05-10T14:07:29.684764+0000","last_peered":"2024-05-10T14:07:29.684764+0000","last_clean":"2024-05-10T14:07:29.684764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:29.684764+0000","last_undegraded":"2024-05-10T14:07:29.684764+0000","last_fullsized":"2024-05-10T14:07:29.684764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.684552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:27.463030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083690+0000","last_change":"2024-05-10T14:06:56.356574+0000","last_active":"2024-05-10T14:07:12.083690+0000","last_peered":"2024-05-10T14:07:12.083690+0000","last_clean":"2024-05-10T14:07:12.083690+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:12.083690+0000","last_undegraded":"2024-05-10T14:07:12.083690+0000","last_fullsized":"2024-05-10T14:07:12.083690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.008143+0000","last_change":"2024-05-10T14:07:27.008196+0000","last_active":"2024-05-10T14:07:27.008143+0000","last_peered":"2024-05-10T14:07:27.008143+0000","last_clean":"2024-05-10T14:07:27.008143+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:27.008143+0000","last_undegraded":"2024-05-10T14:07:27.008143+0000","last_fullsized":"2024-05-10T14:07:27.008143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.007961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:57.782722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"151'13","reported_seq":309,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.534757+0000","last_change":"2024-05-10T14:06:56.449106+0000","last_active":"2024-05-10T14:07:17.534757+0000","last_peered":"2024-05-10T14:07:17.534757+0000","last_clean":"2024-05-10T14:07:17.534757+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:07:17.534757+0000","last_undegraded":"2024-05-10T14:07:17.534757+0000","last_fullsized":"2024-05-10T14:07:17.534757+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548525+0000","last_change":"2024-05-10T14:02:38.709858+0000","last_active":"2024-05-10T14:07:11.548525+0000","last_peered":"2024-05-10T14:07:11.548525+0000","last_clean":"2024-05-10T14:07:11.548525+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:11.548525+0000","last_undegraded":"2024-05-10T14:07:11.548525+0000","last_fullsized":"2024-05-10T14:07:11.548525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.304635+0000","last_change":"2024-05-10T14:07:31.304690+0000","last_active":"2024-05-10T14:07:31.304635+0000","last_peered":"2024-05-10T14:07:31.304635+0000","last_clean":"2024-05-10T14:07:31.304635+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:31.304635+0000","last_undegraded":"2024-05-10T14:07:31.304635+0000","last_fullsized":"2024-05-10T14:07:31.304635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.304411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:20.601035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.412919+0000","last_change":"2024-05-10T14:07:39.412982+0000","last_active":"2024-05-10T14:07:39.412919+0000","last_peered":"2024-05-10T14:07:39.412919+0000","last_clean":"2024-05-10T14:07:39.412919+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:39.412919+0000","last_undegraded":"2024-05-10T14:07:39.412919+0000","last_fullsized":"2024-05-10T14:07:39.412919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.412716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:18.236570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083268+0000","last_change":"2024-05-10T14:06:56.396771+0000","last_active":"2024-05-10T14:07:12.083268+0000","last_peered":"2024-05-10T14:07:12.083268+0000","last_clean":"2024-05-10T14:07:12.083268+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:12.083268+0000","last_undegraded":"2024-05-10T14:07:12.083268+0000","last_fullsized":"2024-05-10T14:07:12.083268+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.976781+0000","last_change":"2024-05-10T14:07:24.976835+0000","last_active":"2024-05-10T14:07:24.976781+0000","last_peered":"2024-05-10T14:07:24.976781+0000","last_clean":"2024-05-10T14:07:24.976781+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:24.976781+0000","last_undegraded":"2024-05-10T14:07:24.976781+0000","last_fullsized":"2024-05-10T14:07:24.976781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.976605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:44.117604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"151'19","reported_seq":60,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.456797+0000","last_change":"2024-05-10T14:06:56.456421+0000","last_active":"2024-05-10T14:07:17.456797+0000","last_peered":"2024-05-10T14:07:17.456797+0000","last_clean":"2024-05-10T14:07:17.456797+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:17.456797+0000","last_undegraded":"2024-05-10T14:07:17.456797+0000","last_fullsized":"2024-05-10T14:07:17.456797+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.893802+0000","last_change":"2024-05-10T14:07:31.893901+0000","last_active":"2024-05-10T14:07:31.893802+0000","last_peered":"2024-05-10T14:07:31.893802+0000","last_clean":"2024-05-10T14:07:31.893802+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:31.893802+0000","last_undegraded":"2024-05-10T14:07:31.893802+0000","last_fullsized":"2024-05-10T14:07:31.893802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.893557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:57.455457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074575+0000","last_change":"2024-05-10T14:02:40.726330+0000","last_active":"2024-05-10T14:07:12.074575+0000","last_peered":"2024-05-10T14:07:12.074575+0000","last_clean":"2024-05-10T14:07:12.074575+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:12.074575+0000","last_undegraded":"2024-05-10T14:07:12.074575+0000","last_fullsized":"2024-05-10T14:07:12.074575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.877121+0000","last_change":"2024-05-10T14:07:38.877175+0000","last_active":"2024-05-10T14:07:38.877121+0000","last_peered":"2024-05-10T14:07:38.877121+0000","last_clean":"2024-05-10T14:07:38.877121+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:38.877121+0000","last_undegraded":"2024-05-10T14:07:38.877121+0000","last_fullsized":"2024-05-10T14:07:38.877121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.876927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:05.018313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076370+0000","last_change":"2024-05-10T14:04:06.309847+0000","last_active":"2024-05-10T14:07:12.076370+0000","last_peered":"2024-05-10T14:07:12.076370+0000","last_clean":"2024-05-10T14:07:12.076370+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:12.076370+0000","last_undegraded":"2024-05-10T14:07:12.076370+0000","last_fullsized":"2024-05-10T14:07:12.076370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.916316+0000","last_change":"2024-05-10T14:07:34.916435+0000","last_active":"2024-05-10T14:07:34.916316+0000","last_peered":"2024-05-10T14:07:34.916316+0000","last_clean":"2024-05-10T14:07:34.916316+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:34.916316+0000","last_undegraded":"2024-05-10T14:07:34.916316+0000","last_fullsized":"2024-05-10T14:07:34.916316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.916072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:12.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"151'20","reported_seq":325,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.560072+0000","last_change":"2024-05-10T14:06:56.413490+0000","last_active":"2024-05-10T14:07:17.560072+0000","last_peered":"2024-05-10T14:07:17.560072+0000","last_clean":"2024-05-10T14:07:17.560072+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:17.560072+0000","last_undegraded":"2024-05-10T14:07:17.560072+0000","last_fullsized":"2024-05-10T14:07:17.560072+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.933155+0000","last_change":"2024-05-10T14:07:39.933209+0000","last_active":"2024-05-10T14:07:39.933155+0000","last_peered":"2024-05-10T14:07:39.933155+0000","last_clean":"2024-05-10T14:07:39.933155+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:39.933155+0000","last_undegraded":"2024-05-10T14:07:39.933155+0000","last_fullsized":"2024-05-10T14:07:39.933155+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.932969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:54.182620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.342562+0000","last_change":"2024-05-10T14:07:26.342755+0000","last_active":"2024-05-10T14:07:26.342562+0000","last_peered":"2024-05-10T14:07:26.342562+0000","last_clean":"2024-05-10T14:07:26.342562+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:26.342562+0000","last_undegraded":"2024-05-10T14:07:26.342562+0000","last_fullsized":"2024-05-10T14:07:26.342562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.342326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:08.559071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551267+0000","last_change":"2024-05-10T14:02:32.674118+0000","last_active":"2024-05-10T14:07:11.551267+0000","last_peered":"2024-05-10T14:07:11.551267+0000","last_clean":"2024-05-10T14:07:11.551267+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:11.551267+0000","last_undegraded":"2024-05-10T14:07:11.551267+0000","last_fullsized":"2024-05-10T14:07:11.551267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552857+0000","last_change":"2024-05-10T14:02:30.643075+0000","last_active":"2024-05-10T14:07:11.552857+0000","last_peered":"2024-05-10T14:07:11.552857+0000","last_clean":"2024-05-10T14:07:11.552857+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:11.552857+0000","last_undegraded":"2024-05-10T14:07:11.552857+0000","last_fullsized":"2024-05-10T14:07:11.552857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.974047+0000","last_change":"2024-05-10T14:07:40.974106+0000","last_active":"2024-05-10T14:07:40.974047+0000","last_peered":"2024-05-10T14:07:40.974047+0000","last_clean":"2024-05-10T14:07:40.974047+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:40.974047+0000","last_undegraded":"2024-05-10T14:07:40.974047+0000","last_fullsized":"2024-05-10T14:07:40.974047+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.973826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:38.752303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"151'19","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.645048+0000","last_change":"2024-05-10T14:07:37.645212+0000","last_active":"2024-05-10T14:07:37.645048+0000","last_peered":"2024-05-10T14:07:37.645048+0000","last_clean":"2024-05-10T14:07:37.645048+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:37.645048+0000","last_undegraded":"2024-05-10T14:07:37.645048+0000","last_fullsized":"2024-05-10T14:07:37.645048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.644835+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:01.315245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.919490+0000","last_change":"2024-05-10T14:07:35.919556+0000","last_active":"2024-05-10T14:07:35.919490+0000","last_peered":"2024-05-10T14:07:35.919490+0000","last_clean":"2024-05-10T14:07:35.919490+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:35.919490+0000","last_undegraded":"2024-05-10T14:07:35.919490+0000","last_fullsized":"2024-05-10T14:07:35.919490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.919293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:00.436845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.706055+0000","last_change":"2024-05-10T14:07:24.706107+0000","last_active":"2024-05-10T14:07:24.706055+0000","last_peered":"2024-05-10T14:07:24.706055+0000","last_clean":"2024-05-10T14:07:24.706055+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:24.706055+0000","last_undegraded":"2024-05-10T14:07:24.706055+0000","last_fullsized":"2024-05-10T14:07:24.706055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.705845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:02.650652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.664306+0000","last_change":"2024-05-10T14:07:40.664371+0000","last_active":"2024-05-10T14:07:40.664306+0000","last_peered":"2024-05-10T14:07:40.664306+0000","last_clean":"2024-05-10T14:07:40.664306+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:40.664306+0000","last_undegraded":"2024-05-10T14:07:40.664306+0000","last_fullsized":"2024-05-10T14:07:40.664306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.664108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:18.608914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.338530+0000","last_change":"2024-05-10T14:07:34.338590+0000","last_active":"2024-05-10T14:07:34.338530+0000","last_peered":"2024-05-10T14:07:34.338530+0000","last_clean":"2024-05-10T14:07:34.338530+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:34.338530+0000","last_undegraded":"2024-05-10T14:07:34.338530+0000","last_fullsized":"2024-05-10T14:07:34.338530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.338336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:32.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.317337+0000","last_change":"2024-05-10T14:07:25.317396+0000","last_active":"2024-05-10T14:07:25.317337+0000","last_peered":"2024-05-10T14:07:25.317337+0000","last_clean":"2024-05-10T14:07:25.317337+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:25.317337+0000","last_undegraded":"2024-05-10T14:07:25.317337+0000","last_fullsized":"2024-05-10T14:07:25.317337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.317133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:28.900454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"151'25","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.946829+0000","last_change":"2024-05-10T14:07:21.946892+0000","last_active":"2024-05-10T14:07:21.946829+0000","last_peered":"2024-05-10T14:07:21.946829+0000","last_clean":"2024-05-10T14:07:21.946829+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:21.946829+0000","last_undegraded":"2024-05-10T14:07:21.946829+0000","last_fullsized":"2024-05-10T14:07:21.946829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.946746+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:50.542836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"151'20","reported_seq":308,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.930093+0000","last_change":"2024-05-10T14:07:35.930173+0000","last_active":"2024-05-10T14:07:35.930093+0000","last_peered":"2024-05-10T14:07:35.930093+0000","last_clean":"2024-05-10T14:07:35.930093+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:35.930093+0000","last_undegraded":"2024-05-10T14:07:35.930093+0000","last_fullsized":"2024-05-10T14:07:35.930093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.929856+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:54.849062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.354694+0000","last_change":"2024-05-10T14:07:28.354817+0000","last_active":"2024-05-10T14:07:28.354694+0000","last_peered":"2024-05-10T14:07:28.354694+0000","last_clean":"2024-05-10T14:07:28.354694+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:28.354694+0000","last_undegraded":"2024-05-10T14:07:28.354694+0000","last_fullsized":"2024-05-10T14:07:28.354694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.354451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:03.998380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551191+0000","last_change":"2024-05-10T14:02:32.673701+0000","last_active":"2024-05-10T14:07:11.551191+0000","last_peered":"2024-05-10T14:07:11.551191+0000","last_clean":"2024-05-10T14:07:11.551191+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:11.551191+0000","last_undegraded":"2024-05-10T14:07:11.551191+0000","last_fullsized":"2024-05-10T14:07:11.551191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548525+0000","last_change":"2024-05-10T14:02:30.625124+0000","last_active":"2024-05-10T14:07:11.548525+0000","last_peered":"2024-05-10T14:07:11.548525+0000","last_clean":"2024-05-10T14:07:11.548525+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:11.548525+0000","last_undegraded":"2024-05-10T14:07:11.548525+0000","last_fullsized":"2024-05-10T14:07:11.548525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'3","reported_seq":210,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.314726+0000","last_change":"2024-05-10T14:04:06.322868+0000","last_active":"2024-05-10T14:07:17.314726+0000","last_peered":"2024-05-10T14:07:17.314726+0000","last_clean":"2024-05-10T14:07:17.314726+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:17.314726+0000","last_undegraded":"2024-05-10T14:07:17.314726+0000","last_fullsized":"2024-05-10T14:07:17.314726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"151'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.722747+0000","last_change":"2024-05-10T14:07:33.722826+0000","last_active":"2024-05-10T14:07:33.722747+0000","last_peered":"2024-05-10T14:07:33.722747+0000","last_clean":"2024-05-10T14:07:33.722747+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:33.722747+0000","last_undegraded":"2024-05-10T14:07:33.722747+0000","last_fullsized":"2024-05-10T14:07:33.722747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.722526+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:19.592401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.335820+0000","last_change":"2024-05-10T14:07:27.335885+0000","last_active":"2024-05-10T14:07:27.335820+0000","last_peered":"2024-05-10T14:07:27.335820+0000","last_clean":"2024-05-10T14:07:27.335820+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:27.335820+0000","last_undegraded":"2024-05-10T14:07:27.335820+0000","last_fullsized":"2024-05-10T14:07:27.335820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.335623+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:05.493216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550190+0000","last_change":"2024-05-10T14:02:40.730353+0000","last_active":"2024-05-10T14:07:11.550190+0000","last_peered":"2024-05-10T14:07:11.550190+0000","last_clean":"2024-05-10T14:07:11.550190+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:11.550190+0000","last_undegraded":"2024-05-10T14:07:11.550190+0000","last_fullsized":"2024-05-10T14:07:11.550190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.450250+0000","last_change":"2024-05-10T14:07:35.450375+0000","last_active":"2024-05-10T14:07:35.450250+0000","last_peered":"2024-05-10T14:07:35.450250+0000","last_clean":"2024-05-10T14:07:35.450250+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:35.450250+0000","last_undegraded":"2024-05-10T14:07:35.450250+0000","last_fullsized":"2024-05-10T14:07:35.450250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.450011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:37:23.168333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548111+0000","last_change":"2024-05-10T14:02:30.643176+0000","last_active":"2024-05-10T14:07:11.548111+0000","last_peered":"2024-05-10T14:07:11.548111+0000","last_clean":"2024-05-10T14:07:11.548111+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:11.548111+0000","last_undegraded":"2024-05-10T14:07:11.548111+0000","last_fullsized":"2024-05-10T14:07:11.548111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550703+0000","last_change":"2024-05-10T14:04:06.303452+0000","last_active":"2024-05-10T14:07:11.550703+0000","last_peered":"2024-05-10T14:07:11.550703+0000","last_clean":"2024-05-10T14:07:11.550703+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:11.550703+0000","last_undegraded":"2024-05-10T14:07:11.550703+0000","last_fullsized":"2024-05-10T14:07:11.550703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"151'28","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.661172+0000","last_change":"2024-05-10T14:07:31.661259+0000","last_active":"2024-05-10T14:07:31.661172+0000","last_peered":"2024-05-10T14:07:31.661172+0000","last_clean":"2024-05-10T14:07:31.661172+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:31.661172+0000","last_undegraded":"2024-05-10T14:07:31.661172+0000","last_fullsized":"2024-05-10T14:07:31.661172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'28","last_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_deep_scrub":"151'28","last_deep_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.660968+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:32.223591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.354327+0000","last_change":"2024-05-10T14:07:29.354383+0000","last_active":"2024-05-10T14:07:29.354327+0000","last_peered":"2024-05-10T14:07:29.354327+0000","last_clean":"2024-05-10T14:07:29.354327+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:29.354327+0000","last_undegraded":"2024-05-10T14:07:29.354327+0000","last_fullsized":"2024-05-10T14:07:29.354327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.354128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.564422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073277+0000","last_change":"2024-05-10T14:04:06.319010+0000","last_active":"2024-05-10T14:07:12.073277+0000","last_peered":"2024-05-10T14:07:12.073277+0000","last_clean":"2024-05-10T14:07:12.073277+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:12.073277+0000","last_undegraded":"2024-05-10T14:07:12.073277+0000","last_fullsized":"2024-05-10T14:07:12.073277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.420075+0000","last_change":"2024-05-10T14:07:40.420215+0000","last_active":"2024-05-10T14:07:40.420075+0000","last_peered":"2024-05-10T14:07:40.420075+0000","last_clean":"2024-05-10T14:07:40.420075+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:40.420075+0000","last_undegraded":"2024-05-10T14:07:40.420075+0000","last_fullsized":"2024-05-10T14:07:40.420075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.419823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:00.289279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":43,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076710+0000","last_change":"2024-05-10T14:06:56.476169+0000","last_active":"2024-05-10T14:07:12.076710+0000","last_peered":"2024-05-10T14:07:12.076710+0000","last_clean":"2024-05-10T14:07:12.076710+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:12.076710+0000","last_undegraded":"2024-05-10T14:07:12.076710+0000","last_fullsized":"2024-05-10T14:07:12.076710+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:18.520766+0000","last_clean_scrub_stamp":"2024-05-10T14:02:18.520766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077288+0000","last_change":"2024-05-10T14:04:06.317679+0000","last_active":"2024-05-10T14:07:12.077288+0000","last_peered":"2024-05-10T14:07:12.077288+0000","last_clean":"2024-05-10T14:07:12.077288+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:12.077288+0000","last_undegraded":"2024-05-10T14:07:12.077288+0000","last_fullsized":"2024-05-10T14:07:12.077288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.674040+0000","last_change":"2024-05-10T14:07:26.674096+0000","last_active":"2024-05-10T14:07:26.674040+0000","last_peered":"2024-05-10T14:07:26.674040+0000","last_clean":"2024-05-10T14:07:26.674040+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:26.674040+0000","last_undegraded":"2024-05-10T14:07:26.674040+0000","last_fullsized":"2024-05-10T14:07:26.674040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.673817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:48.085080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.218116+0000","last_change":"2024-05-10T14:07:28.218179+0000","last_active":"2024-05-10T14:07:28.218116+0000","last_peered":"2024-05-10T14:07:28.218116+0000","last_clean":"2024-05-10T14:07:28.218116+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:28.218116+0000","last_undegraded":"2024-05-10T14:07:28.218116+0000","last_fullsized":"2024-05-10T14:07:28.218116+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.217921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:27.755571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"151'25","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.645580+0000","last_change":"2024-05-10T14:04:06.309289+0000","last_active":"2024-05-10T14:07:17.645580+0000","last_peered":"2024-05-10T14:07:17.645580+0000","last_clean":"2024-05-10T14:07:17.645580+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:17.645580+0000","last_undegraded":"2024-05-10T14:07:17.645580+0000","last_fullsized":"2024-05-10T14:07:17.645580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074666+0000","last_change":"2024-05-10T14:06:56.371907+0000","last_active":"2024-05-10T14:07:12.074666+0000","last_peered":"2024-05-10T14:07:12.074666+0000","last_clean":"2024-05-10T14:07:12.074666+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:12.074666+0000","last_undegraded":"2024-05-10T14:07:12.074666+0000","last_fullsized":"2024-05-10T14:07:12.074666+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":249,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075356+0000","last_change":"2024-05-10T14:04:06.320174+0000","last_active":"2024-05-10T14:07:12.075356+0000","last_peered":"2024-05-10T14:07:12.075356+0000","last_clean":"2024-05-10T14:07:12.075356+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:12.075356+0000","last_undegraded":"2024-05-10T14:07:12.075356+0000","last_fullsized":"2024-05-10T14:07:12.075356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.907821+0000","last_change":"2024-05-10T14:07:40.907880+0000","last_active":"2024-05-10T14:07:40.907821+0000","last_peered":"2024-05-10T14:07:40.907821+0000","last_clean":"2024-05-10T14:07:40.907821+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:40.907821+0000","last_undegraded":"2024-05-10T14:07:40.907821+0000","last_fullsized":"2024-05-10T14:07:40.907821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.907593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:32.784152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.156415+0000","last_change":"2024-05-10T14:07:39.156550+0000","last_active":"2024-05-10T14:07:39.156415+0000","last_peered":"2024-05-10T14:07:39.156415+0000","last_clean":"2024-05-10T14:07:39.156415+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:39.156415+0000","last_undegraded":"2024-05-10T14:07:39.156415+0000","last_fullsized":"2024-05-10T14:07:39.156415+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.156160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:25.026036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073113+0000","last_change":"2024-05-10T14:02:30.638399+0000","last_active":"2024-05-10T14:07:12.073113+0000","last_peered":"2024-05-10T14:07:12.073113+0000","last_clean":"2024-05-10T14:07:12.073113+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:12.073113+0000","last_undegraded":"2024-05-10T14:07:12.073113+0000","last_fullsized":"2024-05-10T14:07:12.073113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.649059+0000","last_change":"2024-05-10T14:07:33.649117+0000","last_active":"2024-05-10T14:07:33.649059+0000","last_peered":"2024-05-10T14:07:33.649059+0000","last_clean":"2024-05-10T14:07:33.649059+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:33.649059+0000","last_undegraded":"2024-05-10T14:07:33.649059+0000","last_fullsized":"2024-05-10T14:07:33.649059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.648851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:47:20.655715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"151'48","reported_seq":362,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.669103+0000","last_change":"2024-05-10T14:04:06.318792+0000","last_active":"2024-05-10T14:07:17.669103+0000","last_peered":"2024-05-10T14:07:17.669103+0000","last_clean":"2024-05-10T14:07:17.669103+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:17.669103+0000","last_undegraded":"2024-05-10T14:07:17.669103+0000","last_fullsized":"2024-05-10T14:07:17.669103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.168061+0000","last_change":"2024-05-10T14:07:27.168120+0000","last_active":"2024-05-10T14:07:27.168061+0000","last_peered":"2024-05-10T14:07:27.168061+0000","last_clean":"2024-05-10T14:07:27.168061+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:27.168061+0000","last_undegraded":"2024-05-10T14:07:27.168061+0000","last_fullsized":"2024-05-10T14:07:27.168061+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.167863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:12.671261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.413966+0000","last_change":"2024-05-10T14:07:30.414024+0000","last_active":"2024-05-10T14:07:30.413966+0000","last_peered":"2024-05-10T14:07:30.413966+0000","last_clean":"2024-05-10T14:07:30.413966+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:30.413966+0000","last_undegraded":"2024-05-10T14:07:30.413966+0000","last_fullsized":"2024-05-10T14:07:30.413966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.413749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:18:42.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'1","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075088+0000","last_change":"2024-05-10T14:04:06.318595+0000","last_active":"2024-05-10T14:07:12.075088+0000","last_peered":"2024-05-10T14:07:12.075088+0000","last_clean":"2024-05-10T14:07:12.075088+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:12.075088+0000","last_undegraded":"2024-05-10T14:07:12.075088+0000","last_fullsized":"2024-05-10T14:07:12.075088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.995125+0000","last_change":"2024-05-10T14:07:27.995186+0000","last_active":"2024-05-10T14:07:27.995125+0000","last_peered":"2024-05-10T14:07:27.995125+0000","last_clean":"2024-05-10T14:07:27.995125+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:27.995125+0000","last_undegraded":"2024-05-10T14:07:27.995125+0000","last_fullsized":"2024-05-10T14:07:27.995125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.994931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:05:35.411465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072441+0000","last_change":"2024-05-10T14:02:30.636551+0000","last_active":"2024-05-10T14:07:12.072441+0000","last_peered":"2024-05-10T14:07:12.072441+0000","last_clean":"2024-05-10T14:07:12.072441+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:12.072441+0000","last_undegraded":"2024-05-10T14:07:12.072441+0000","last_fullsized":"2024-05-10T14:07:12.072441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"151'2","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.891325+0000","last_change":"2024-05-10T14:07:36.891389+0000","last_active":"2024-05-10T14:07:36.891325+0000","last_peered":"2024-05-10T14:07:36.891325+0000","last_clean":"2024-05-10T14:07:36.891325+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:36.891325+0000","last_undegraded":"2024-05-10T14:07:36.891325+0000","last_fullsized":"2024-05-10T14:07:36.891325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.891129+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.075459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"90'16","reported_seq":55,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.084177+0000","last_change":"2024-05-10T14:06:56.500830+0000","last_active":"2024-05-10T14:07:12.084177+0000","last_peered":"2024-05-10T14:07:12.084177+0000","last_clean":"2024-05-10T14:07:12.084177+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:12.084177+0000","last_undegraded":"2024-05-10T14:07:12.084177+0000","last_fullsized":"2024-05-10T14:07:12.084177+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.909436+0000","last_change":"2024-05-10T14:07:27.909553+0000","last_active":"2024-05-10T14:07:27.909436+0000","last_peered":"2024-05-10T14:07:27.909436+0000","last_clean":"2024-05-10T14:07:27.909436+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:27.909436+0000","last_undegraded":"2024-05-10T14:07:27.909436+0000","last_fullsized":"2024-05-10T14:07:27.909436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.909206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:05.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":247,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.171535+0000","last_change":"2024-05-10T14:02:40.718654+0000","last_active":"2024-05-10T14:07:12.171535+0000","last_peered":"2024-05-10T14:07:12.171535+0000","last_clean":"2024-05-10T14:07:12.171535+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:12.171535+0000","last_undegraded":"2024-05-10T14:07:12.171535+0000","last_fullsized":"2024-05-10T14:07:12.171535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.424760+0000","last_change":"2024-05-10T14:07:31.424818+0000","last_active":"2024-05-10T14:07:31.424760+0000","last_peered":"2024-05-10T14:07:31.424760+0000","last_clean":"2024-05-10T14:07:31.424760+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:31.424760+0000","last_undegraded":"2024-05-10T14:07:31.424760+0000","last_fullsized":"2024-05-10T14:07:31.424760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.424555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:12:55.196458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074501+0000","last_change":"2024-05-10T14:04:06.303227+0000","last_active":"2024-05-10T14:07:12.074501+0000","last_peered":"2024-05-10T14:07:12.074501+0000","last_clean":"2024-05-10T14:07:12.074501+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:12.074501+0000","last_undegraded":"2024-05-10T14:07:12.074501+0000","last_fullsized":"2024-05-10T14:07:12.074501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551012+0000","last_change":"2024-05-10T14:02:30.635245+0000","last_active":"2024-05-10T14:07:11.551012+0000","last_peered":"2024-05-10T14:07:11.551012+0000","last_clean":"2024-05-10T14:07:11.551012+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:11.551012+0000","last_undegraded":"2024-05-10T14:07:11.551012+0000","last_fullsized":"2024-05-10T14:07:11.551012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.918113+0000","last_change":"2024-05-10T14:07:34.918174+0000","last_active":"2024-05-10T14:07:34.918113+0000","last_peered":"2024-05-10T14:07:34.918113+0000","last_clean":"2024-05-10T14:07:34.918113+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:34.918113+0000","last_undegraded":"2024-05-10T14:07:34.918113+0000","last_fullsized":"2024-05-10T14:07:34.918113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.917893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:03:28.952902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"151'18","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.749529+0000","last_change":"2024-05-10T14:07:34.749626+0000","last_active":"2024-05-10T14:07:34.749529+0000","last_peered":"2024-05-10T14:07:34.749529+0000","last_clean":"2024-05-10T14:07:34.749529+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:34.749529+0000","last_undegraded":"2024-05-10T14:07:34.749529+0000","last_fullsized":"2024-05-10T14:07:34.749529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.749322+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:55.388007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.396463+0000","last_change":"2024-05-10T14:07:25.396519+0000","last_active":"2024-05-10T14:07:25.396463+0000","last_peered":"2024-05-10T14:07:25.396463+0000","last_clean":"2024-05-10T14:07:25.396463+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:25.396463+0000","last_undegraded":"2024-05-10T14:07:25.396463+0000","last_fullsized":"2024-05-10T14:07:25.396463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.396270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:23.766029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.635601+0000","last_change":"2024-05-10T14:07:30.635716+0000","last_active":"2024-05-10T14:07:30.635601+0000","last_peered":"2024-05-10T14:07:30.635601+0000","last_clean":"2024-05-10T14:07:30.635601+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:30.635601+0000","last_undegraded":"2024-05-10T14:07:30.635601+0000","last_fullsized":"2024-05-10T14:07:30.635601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.635307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:42.884913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.390727+0000","last_change":"2024-05-10T14:07:32.390796+0000","last_active":"2024-05-10T14:07:32.390727+0000","last_peered":"2024-05-10T14:07:32.390727+0000","last_clean":"2024-05-10T14:07:32.390727+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:32.390727+0000","last_undegraded":"2024-05-10T14:07:32.390727+0000","last_fullsized":"2024-05-10T14:07:32.390727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.390537+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:21.254841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.952262+0000","last_change":"2024-05-10T14:07:23.952311+0000","last_active":"2024-05-10T14:07:23.952262+0000","last_peered":"2024-05-10T14:07:23.952262+0000","last_clean":"2024-05-10T14:07:23.952262+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:23.952262+0000","last_undegraded":"2024-05-10T14:07:23.952262+0000","last_fullsized":"2024-05-10T14:07:23.952262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.952085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:24.299018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.430535+0000","last_change":"2024-05-10T14:07:37.430591+0000","last_active":"2024-05-10T14:07:37.430535+0000","last_peered":"2024-05-10T14:07:37.430535+0000","last_clean":"2024-05-10T14:07:37.430535+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:37.430535+0000","last_undegraded":"2024-05-10T14:07:37.430535+0000","last_fullsized":"2024-05-10T14:07:37.430535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.430330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:37.578731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.942595+0000","last_change":"2024-05-10T14:07:32.942666+0000","last_active":"2024-05-10T14:07:32.942595+0000","last_peered":"2024-05-10T14:07:32.942595+0000","last_clean":"2024-05-10T14:07:32.942595+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:32.942595+0000","last_undegraded":"2024-05-10T14:07:32.942595+0000","last_fullsized":"2024-05-10T14:07:32.942595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.942400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:28.015020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"151'32","reported_seq":314,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.948039+0000","last_change":"2024-05-10T14:07:28.948130+0000","last_active":"2024-05-10T14:07:28.948039+0000","last_peered":"2024-05-10T14:07:28.948039+0000","last_clean":"2024-05-10T14:07:28.948039+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:28.948039+0000","last_undegraded":"2024-05-10T14:07:28.948039+0000","last_fullsized":"2024-05-10T14:07:28.948039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'32","last_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_deep_scrub":"151'32","last_deep_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.947807+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:52.580613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.681099+0000","last_change":"2024-05-10T14:07:26.681166+0000","last_active":"2024-05-10T14:07:26.681099+0000","last_peered":"2024-05-10T14:07:26.681099+0000","last_clean":"2024-05-10T14:07:26.681099+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:26.681099+0000","last_undegraded":"2024-05-10T14:07:26.681099+0000","last_fullsized":"2024-05-10T14:07:26.681099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.680864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:07.789929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.956250+0000","last_change":"2024-05-10T14:07:26.956314+0000","last_active":"2024-05-10T14:07:26.956250+0000","last_peered":"2024-05-10T14:07:26.956250+0000","last_clean":"2024-05-10T14:07:26.956250+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:26.956250+0000","last_undegraded":"2024-05-10T14:07:26.956250+0000","last_fullsized":"2024-05-10T14:07:26.956250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.956051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:53.568515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"151'4","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.975303+0000","last_change":"2024-05-10T14:07:23.975376+0000","last_active":"2024-05-10T14:07:23.975303+0000","last_peered":"2024-05-10T14:07:23.975303+0000","last_clean":"2024-05-10T14:07:23.975303+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:23.975303+0000","last_undegraded":"2024-05-10T14:07:23.975303+0000","last_fullsized":"2024-05-10T14:07:23.975303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.975105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:18:57.825330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.373385+0000","last_change":"2024-05-10T14:07:39.373441+0000","last_active":"2024-05-10T14:07:39.373385+0000","last_peered":"2024-05-10T14:07:39.373385+0000","last_clean":"2024-05-10T14:07:39.373385+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:39.373385+0000","last_undegraded":"2024-05-10T14:07:39.373385+0000","last_fullsized":"2024-05-10T14:07:39.373385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.373188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:55.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.232810+0000","last_change":"2024-05-10T14:07:29.232870+0000","last_active":"2024-05-10T14:07:29.232810+0000","last_peered":"2024-05-10T14:07:29.232810+0000","last_clean":"2024-05-10T14:07:29.232810+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:29.232810+0000","last_undegraded":"2024-05-10T14:07:29.232810+0000","last_fullsized":"2024-05-10T14:07:29.232810+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.232614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:07.177421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.339054+0000","last_change":"2024-05-10T14:07:32.339109+0000","last_active":"2024-05-10T14:07:32.339054+0000","last_peered":"2024-05-10T14:07:32.339054+0000","last_clean":"2024-05-10T14:07:32.339054+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:32.339054+0000","last_undegraded":"2024-05-10T14:07:32.339054+0000","last_fullsized":"2024-05-10T14:07:32.339054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.338865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:10.266519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"151'21","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.310389+0000","last_change":"2024-05-10T14:07:21.310444+0000","last_active":"2024-05-10T14:07:21.310389+0000","last_peered":"2024-05-10T14:07:21.310389+0000","last_clean":"2024-05-10T14:07:21.310389+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:21.310389+0000","last_undegraded":"2024-05-10T14:07:21.310389+0000","last_fullsized":"2024-05-10T14:07:21.310389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'21","last_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_deep_scrub":"151'21","last_deep_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.310310+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:56.364173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"151'20","reported_seq":206,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.590707+0000","last_change":"2024-05-10T14:07:23.590832+0000","last_active":"2024-05-10T14:07:23.590707+0000","last_peered":"2024-05-10T14:07:23.590707+0000","last_clean":"2024-05-10T14:07:23.590707+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:23.590707+0000","last_undegraded":"2024-05-10T14:07:23.590707+0000","last_fullsized":"2024-05-10T14:07:23.590707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.590396+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:50.454066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.722849+0000","last_change":"2024-05-10T14:07:30.723007+0000","last_active":"2024-05-10T14:07:30.722849+0000","last_peered":"2024-05-10T14:07:30.722849+0000","last_clean":"2024-05-10T14:07:30.722849+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:30.722849+0000","last_undegraded":"2024-05-10T14:07:30.722849+0000","last_fullsized":"2024-05-10T14:07:30.722849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.722607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:19.082543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548971+0000","last_change":"2024-05-10T14:06:56.374890+0000","last_active":"2024-05-10T14:07:11.548971+0000","last_peered":"2024-05-10T14:07:11.548971+0000","last_clean":"2024-05-10T14:07:11.548971+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:11.548971+0000","last_undegraded":"2024-05-10T14:07:11.548971+0000","last_fullsized":"2024-05-10T14:07:11.548971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554202+0000","last_change":"2024-05-10T14:06:56.375227+0000","last_active":"2024-05-10T14:07:11.554202+0000","last_peered":"2024-05-10T14:07:11.554202+0000","last_clean":"2024-05-10T14:07:11.554202+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:11.554202+0000","last_undegraded":"2024-05-10T14:07:11.554202+0000","last_fullsized":"2024-05-10T14:07:11.554202+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.463795+0000","last_change":"2024-05-10T14:07:36.463852+0000","last_active":"2024-05-10T14:07:36.463795+0000","last_peered":"2024-05-10T14:07:36.463795+0000","last_clean":"2024-05-10T14:07:36.463795+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:36.463795+0000","last_undegraded":"2024-05-10T14:07:36.463795+0000","last_fullsized":"2024-05-10T14:07:36.463795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.463569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:35:46.544710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.676778+0000","last_change":"2024-05-10T14:07:31.676842+0000","last_active":"2024-05-10T14:07:31.676778+0000","last_peered":"2024-05-10T14:07:31.676778+0000","last_clean":"2024-05-10T14:07:31.676778+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:31.676778+0000","last_undegraded":"2024-05-10T14:07:31.676778+0000","last_fullsized":"2024-05-10T14:07:31.676778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.676593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:51.546049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.657801+0000","last_change":"2024-05-10T14:07:41.657876+0000","last_active":"2024-05-10T14:07:41.657801+0000","last_peered":"2024-05-10T14:07:41.657801+0000","last_clean":"2024-05-10T14:07:41.657801+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:41.657801+0000","last_undegraded":"2024-05-10T14:07:41.657801+0000","last_fullsized":"2024-05-10T14:07:41.657801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.657598+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:05.290405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"151'18","reported_seq":298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.728833+0000","last_change":"2024-05-10T14:07:39.728896+0000","last_active":"2024-05-10T14:07:39.728833+0000","last_peered":"2024-05-10T14:07:39.728833+0000","last_clean":"2024-05-10T14:07:39.728833+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:39.728833+0000","last_undegraded":"2024-05-10T14:07:39.728833+0000","last_fullsized":"2024-05-10T14:07:39.728833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.728603+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:16.910850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.855396+0000","last_change":"2024-05-10T14:07:37.855543+0000","last_active":"2024-05-10T14:07:37.855396+0000","last_peered":"2024-05-10T14:07:37.855396+0000","last_clean":"2024-05-10T14:07:37.855396+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:37.855396+0000","last_undegraded":"2024-05-10T14:07:37.855396+0000","last_fullsized":"2024-05-10T14:07:37.855396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.855137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:59.761135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548900+0000","last_change":"2024-05-10T14:04:06.299506+0000","last_active":"2024-05-10T14:07:11.548900+0000","last_peered":"2024-05-10T14:07:11.548900+0000","last_clean":"2024-05-10T14:07:11.548900+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:11.548900+0000","last_undegraded":"2024-05-10T14:07:11.548900+0000","last_fullsized":"2024-05-10T14:07:11.548900+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075176+0000","last_change":"2024-05-10T14:02:30.632577+0000","last_active":"2024-05-10T14:07:12.075176+0000","last_peered":"2024-05-10T14:07:12.075176+0000","last_clean":"2024-05-10T14:07:12.075176+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:12.075176+0000","last_undegraded":"2024-05-10T14:07:12.075176+0000","last_fullsized":"2024-05-10T14:07:12.075176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082832+0000","last_change":"2024-05-10T14:06:56.376144+0000","last_active":"2024-05-10T14:07:12.082832+0000","last_peered":"2024-05-10T14:07:12.082832+0000","last_clean":"2024-05-10T14:07:12.082832+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:12.082832+0000","last_undegraded":"2024-05-10T14:07:12.082832+0000","last_fullsized":"2024-05-10T14:07:12.082832+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:23.557564+0000","last_clean_scrub_stamp":"2024-05-10T14:02:23.557564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.737833+0000","last_change":"2024-05-10T14:07:40.737891+0000","last_active":"2024-05-10T14:07:40.737833+0000","last_peered":"2024-05-10T14:07:40.737833+0000","last_clean":"2024-05-10T14:07:40.737833+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:40.737833+0000","last_undegraded":"2024-05-10T14:07:40.737833+0000","last_fullsized":"2024-05-10T14:07:40.737833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.737577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:52.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"151'36","reported_seq":89,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.147958+0000","last_change":"2024-05-10T14:07:25.148049+0000","last_active":"2024-05-10T14:07:25.147958+0000","last_peered":"2024-05-10T14:07:25.147958+0000","last_clean":"2024-05-10T14:07:25.147958+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:25.147958+0000","last_undegraded":"2024-05-10T14:07:25.147958+0000","last_fullsized":"2024-05-10T14:07:25.147958+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'36","last_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_deep_scrub":"151'36","last_deep_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.147756+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:46.500080+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548831+0000","last_change":"2024-05-10T14:02:38.721824+0000","last_active":"2024-05-10T14:07:11.548831+0000","last_peered":"2024-05-10T14:07:11.548831+0000","last_clean":"2024-05-10T14:07:11.548831+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:11.548831+0000","last_undegraded":"2024-05-10T14:07:11.548831+0000","last_fullsized":"2024-05-10T14:07:11.548831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":200,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.077020+0000","last_change":"2024-05-10T14:06:56.451361+0000","last_active":"2024-05-10T14:07:12.077020+0000","last_peered":"2024-05-10T14:07:12.077020+0000","last_clean":"2024-05-10T14:07:12.077020+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:12.077020+0000","last_undegraded":"2024-05-10T14:07:12.077020+0000","last_fullsized":"2024-05-10T14:07:12.077020+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"151'2","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.003773+0000","last_change":"2024-05-10T14:07:21.003800+0000","last_active":"2024-05-10T14:07:21.003773+0000","last_peered":"2024-05-10T14:07:21.003773+0000","last_clean":"2024-05-10T14:07:21.003773+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:21.003773+0000","last_undegraded":"2024-05-10T14:07:21.003773+0000","last_fullsized":"2024-05-10T14:07:21.003773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.003698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:46:49.956112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.709014+0000","last_change":"2024-05-10T14:07:34.709073+0000","last_active":"2024-05-10T14:07:34.709014+0000","last_peered":"2024-05-10T14:07:34.709014+0000","last_clean":"2024-05-10T14:07:34.709014+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:34.709014+0000","last_undegraded":"2024-05-10T14:07:34.709014+0000","last_fullsized":"2024-05-10T14:07:34.709014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.708821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:40.383875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'1","reported_seq":286,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.172318+0000","last_change":"2024-05-10T14:06:56.436460+0000","last_active":"2024-05-10T14:07:12.172318+0000","last_peered":"2024-05-10T14:07:12.172318+0000","last_clean":"2024-05-10T14:07:12.172318+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:12.172318+0000","last_undegraded":"2024-05-10T14:07:12.172318+0000","last_fullsized":"2024-05-10T14:07:12.172318+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:15.160213+0000","last_change":"2024-05-10T14:04:06.305995+0000","last_active":"2024-05-10T14:07:15.160213+0000","last_peered":"2024-05-10T14:07:15.160213+0000","last_clean":"2024-05-10T14:07:15.160213+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:15.160213+0000","last_undegraded":"2024-05-10T14:07:15.160213+0000","last_fullsized":"2024-05-10T14:07:15.160213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.761588+0000","last_change":"2024-05-10T14:07:32.761686+0000","last_active":"2024-05-10T14:07:32.761588+0000","last_peered":"2024-05-10T14:07:32.761588+0000","last_clean":"2024-05-10T14:07:32.761588+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:32.761588+0000","last_undegraded":"2024-05-10T14:07:32.761588+0000","last_fullsized":"2024-05-10T14:07:32.761588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.761359+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:57.278911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.759852+0000","last_change":"2024-05-10T14:07:41.759908+0000","last_active":"2024-05-10T14:07:41.759852+0000","last_peered":"2024-05-10T14:07:41.759852+0000","last_clean":"2024-05-10T14:07:41.759852+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:41.759852+0000","last_undegraded":"2024-05-10T14:07:41.759852+0000","last_fullsized":"2024-05-10T14:07:41.759852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.759647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:02:59.566098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.711976+0000","last_change":"2024-05-10T14:07:29.712034+0000","last_active":"2024-05-10T14:07:29.711976+0000","last_peered":"2024-05-10T14:07:29.711976+0000","last_clean":"2024-05-10T14:07:29.711976+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:29.711976+0000","last_undegraded":"2024-05-10T14:07:29.711976+0000","last_fullsized":"2024-05-10T14:07:29.711976+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.711766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:24.784387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.370765+0000","last_change":"2024-05-10T14:07:27.370827+0000","last_active":"2024-05-10T14:07:27.370765+0000","last_peered":"2024-05-10T14:07:27.370765+0000","last_clean":"2024-05-10T14:07:27.370765+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:27.370765+0000","last_undegraded":"2024-05-10T14:07:27.370765+0000","last_fullsized":"2024-05-10T14:07:27.370765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.370559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:25:48.876276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.239346+0000","last_change":"2024-05-10T14:07:37.239403+0000","last_active":"2024-05-10T14:07:37.239346+0000","last_peered":"2024-05-10T14:07:37.239346+0000","last_clean":"2024-05-10T14:07:37.239346+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:37.239346+0000","last_undegraded":"2024-05-10T14:07:37.239346+0000","last_fullsized":"2024-05-10T14:07:37.239346+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.239146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:31:00.357237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.761971+0000","last_change":"2024-05-10T14:07:36.762032+0000","last_active":"2024-05-10T14:07:36.761971+0000","last_peered":"2024-05-10T14:07:36.761971+0000","last_clean":"2024-05-10T14:07:36.761971+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:36.761971+0000","last_undegraded":"2024-05-10T14:07:36.761971+0000","last_fullsized":"2024-05-10T14:07:36.761971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.761768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:02.440802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"151'8","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.014343+0000","last_change":"2024-05-10T14:07:23.014483+0000","last_active":"2024-05-10T14:07:23.014343+0000","last_peered":"2024-05-10T14:07:23.014343+0000","last_clean":"2024-05-10T14:07:23.014343+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:23.014343+0000","last_undegraded":"2024-05-10T14:07:23.014343+0000","last_fullsized":"2024-05-10T14:07:23.014343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'8","last_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_deep_scrub":"151'8","last_deep_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.014096+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:20.042315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.229385+0000","last_change":"2024-05-10T14:07:34.229441+0000","last_active":"2024-05-10T14:07:34.229385+0000","last_peered":"2024-05-10T14:07:34.229385+0000","last_clean":"2024-05-10T14:07:34.229385+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:34.229385+0000","last_undegraded":"2024-05-10T14:07:34.229385+0000","last_fullsized":"2024-05-10T14:07:34.229385+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.229194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:59.791093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.943622+0000","last_change":"2024-05-10T14:07:41.943622+0000","last_active":"2024-05-10T14:07:41.943622+0000","last_peered":"2024-05-10T14:07:41.943622+0000","last_clean":"2024-05-10T14:07:41.943622+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:41.943622+0000","last_undegraded":"2024-05-10T14:07:41.943622+0000","last_fullsized":"2024-05-10T14:07:41.943622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.943342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:15.631218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"151'2","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.946053+0000","last_change":"2024-05-10T14:07:41.946117+0000","last_active":"2024-05-10T14:07:41.946053+0000","last_peered":"2024-05-10T14:07:41.946053+0000","last_clean":"2024-05-10T14:07:41.946053+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:41.946053+0000","last_undegraded":"2024-05-10T14:07:41.946053+0000","last_fullsized":"2024-05-10T14:07:41.946053+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.945868+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:20.769723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.612477+0000","last_change":"2024-05-10T14:07:25.612530+0000","last_active":"2024-05-10T14:07:25.612477+0000","last_peered":"2024-05-10T14:07:25.612477+0000","last_clean":"2024-05-10T14:07:25.612477+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:25.612477+0000","last_undegraded":"2024-05-10T14:07:25.612477+0000","last_fullsized":"2024-05-10T14:07:25.612477+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.612253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:06:34.416095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.255540+0000","last_change":"2024-05-10T14:07:33.255596+0000","last_active":"2024-05-10T14:07:33.255540+0000","last_peered":"2024-05-10T14:07:33.255540+0000","last_clean":"2024-05-10T14:07:33.255540+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:33.255540+0000","last_undegraded":"2024-05-10T14:07:33.255540+0000","last_fullsized":"2024-05-10T14:07:33.255540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.255282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:33.490379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.770161+0000","last_change":"2024-05-10T14:07:31.770235+0000","last_active":"2024-05-10T14:07:31.770161+0000","last_peered":"2024-05-10T14:07:31.770161+0000","last_clean":"2024-05-10T14:07:31.770161+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:31.770161+0000","last_undegraded":"2024-05-10T14:07:31.770161+0000","last_fullsized":"2024-05-10T14:07:31.770161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.769945+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:55:59.259278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.438072+0000","last_change":"2024-05-10T14:07:24.438125+0000","last_active":"2024-05-10T14:07:24.438072+0000","last_peered":"2024-05-10T14:07:24.438072+0000","last_clean":"2024-05-10T14:07:24.438072+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:24.438072+0000","last_undegraded":"2024-05-10T14:07:24.438072+0000","last_fullsized":"2024-05-10T14:07:24.438072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.437873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:18:07.966698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076714+0000","last_change":"2024-05-10T14:06:56.381527+0000","last_active":"2024-05-10T14:07:12.076714+0000","last_peered":"2024-05-10T14:07:12.076714+0000","last_clean":"2024-05-10T14:07:12.076714+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:12.076714+0000","last_undegraded":"2024-05-10T14:07:12.076714+0000","last_fullsized":"2024-05-10T14:07:12.076714+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.721110+0000","last_change":"2024-05-10T14:07:23.721130+0000","last_active":"2024-05-10T14:07:23.721110+0000","last_peered":"2024-05-10T14:07:23.721110+0000","last_clean":"2024-05-10T14:07:23.721110+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:23.721110+0000","last_undegraded":"2024-05-10T14:07:23.721110+0000","last_fullsized":"2024-05-10T14:07:23.721110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.721037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:50.333501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.020307+0000","last_change":"2024-05-10T14:07:22.020307+0000","last_active":"2024-05-10T14:07:22.020307+0000","last_peered":"2024-05-10T14:07:22.020307+0000","last_clean":"2024-05-10T14:07:22.020307+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:22.020307+0000","last_undegraded":"2024-05-10T14:07:22.020307+0000","last_fullsized":"2024-05-10T14:07:22.020307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.020202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:27.695256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.323006+0000","last_change":"2024-05-10T14:07:28.323062+0000","last_active":"2024-05-10T14:07:28.323006+0000","last_peered":"2024-05-10T14:07:28.323006+0000","last_clean":"2024-05-10T14:07:28.323006+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:28.323006+0000","last_undegraded":"2024-05-10T14:07:28.323006+0000","last_fullsized":"2024-05-10T14:07:28.323006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.322800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:38.102769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"151'13","reported_seq":54,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.583460+0000","last_change":"2024-05-10T14:06:56.467788+0000","last_active":"2024-05-10T14:07:17.583460+0000","last_peered":"2024-05-10T14:07:17.583460+0000","last_clean":"2024-05-10T14:07:17.583460+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:17.583460+0000","last_undegraded":"2024-05-10T14:07:17.583460+0000","last_fullsized":"2024-05-10T14:07:17.583460+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757341+0000","last_change":"2024-05-10T14:06:56.370543+0000","last_active":"2024-05-10T14:07:20.757341+0000","last_peered":"2024-05-10T14:07:20.757341+0000","last_clean":"2024-05-10T14:07:20.757341+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:20.757341+0000","last_undegraded":"2024-05-10T14:07:20.757341+0000","last_fullsized":"2024-05-10T14:07:20.757341+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082493+0000","last_change":"2024-05-10T14:04:06.320840+0000","last_active":"2024-05-10T14:07:12.082493+0000","last_peered":"2024-05-10T14:07:12.082493+0000","last_clean":"2024-05-10T14:07:12.082493+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:12.082493+0000","last_undegraded":"2024-05-10T14:07:12.082493+0000","last_fullsized":"2024-05-10T14:07:12.082493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167248+0000","last_change":"2024-05-10T14:02:30.643022+0000","last_active":"2024-05-10T14:07:22.167248+0000","last_peered":"2024-05-10T14:07:22.167248+0000","last_clean":"2024-05-10T14:07:22.167248+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:22.167248+0000","last_undegraded":"2024-05-10T14:07:22.167248+0000","last_fullsized":"2024-05-10T14:07:22.167248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074754+0000","last_change":"2024-05-10T14:06:56.372706+0000","last_active":"2024-05-10T14:07:12.074754+0000","last_peered":"2024-05-10T14:07:12.074754+0000","last_clean":"2024-05-10T14:07:12.074754+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:12.074754+0000","last_undegraded":"2024-05-10T14:07:12.074754+0000","last_fullsized":"2024-05-10T14:07:12.074754+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"151'20","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.230673+0000","last_change":"2024-05-10T14:04:06.328271+0000","last_active":"2024-05-10T14:07:21.230673+0000","last_peered":"2024-05-10T14:07:21.230673+0000","last_clean":"2024-05-10T14:07:21.230673+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:21.230673+0000","last_undegraded":"2024-05-10T14:07:21.230673+0000","last_fullsized":"2024-05-10T14:07:21.230673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076660+0000","last_change":"2024-05-10T14:04:06.312043+0000","last_active":"2024-05-10T14:07:12.076660+0000","last_peered":"2024-05-10T14:07:12.076660+0000","last_clean":"2024-05-10T14:07:12.076660+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:12.076660+0000","last_undegraded":"2024-05-10T14:07:12.076660+0000","last_fullsized":"2024-05-10T14:07:12.076660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.690736+0000","last_change":"2024-05-10T14:07:27.690800+0000","last_active":"2024-05-10T14:07:27.690736+0000","last_peered":"2024-05-10T14:07:27.690736+0000","last_clean":"2024-05-10T14:07:27.690736+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:27.690736+0000","last_undegraded":"2024-05-10T14:07:27.690736+0000","last_fullsized":"2024-05-10T14:07:27.690736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.690535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:27.925633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074908+0000","last_change":"2024-05-10T14:06:56.372339+0000","last_active":"2024-05-10T14:07:12.074908+0000","last_peered":"2024-05-10T14:07:12.074908+0000","last_clean":"2024-05-10T14:07:12.074908+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:12.074908+0000","last_undegraded":"2024-05-10T14:07:12.074908+0000","last_fullsized":"2024-05-10T14:07:12.074908+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.161101+0000","last_change":"2024-05-10T14:02:30.641785+0000","last_active":"2024-05-10T14:07:20.161101+0000","last_peered":"2024-05-10T14:07:20.161101+0000","last_clean":"2024-05-10T14:07:20.161101+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:20.161101+0000","last_undegraded":"2024-05-10T14:07:20.161101+0000","last_fullsized":"2024-05-10T14:07:20.161101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.337729+0000","last_change":"2024-05-10T14:07:30.337788+0000","last_active":"2024-05-10T14:07:30.337729+0000","last_peered":"2024-05-10T14:07:30.337729+0000","last_clean":"2024-05-10T14:07:30.337729+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:30.337729+0000","last_undegraded":"2024-05-10T14:07:30.337729+0000","last_fullsized":"2024-05-10T14:07:30.337729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.337517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:27.544286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"151'25","reported_seq":74,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.120169+0000","last_change":"2024-05-10T14:07:24.120261+0000","last_active":"2024-05-10T14:07:24.120169+0000","last_peered":"2024-05-10T14:07:24.120169+0000","last_clean":"2024-05-10T14:07:24.120169+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:24.120169+0000","last_undegraded":"2024-05-10T14:07:24.120169+0000","last_fullsized":"2024-05-10T14:07:24.120169+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.119966+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:19.091644+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.313330+0000","last_change":"2024-05-10T14:07:22.313330+0000","last_active":"2024-05-10T14:07:22.313330+0000","last_peered":"2024-05-10T14:07:22.313330+0000","last_clean":"2024-05-10T14:07:22.313330+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:22.313330+0000","last_undegraded":"2024-05-10T14:07:22.313330+0000","last_fullsized":"2024-05-10T14:07:22.313330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.313230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.934216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.170892+0000","last_change":"2024-05-10T14:06:56.377814+0000","last_active":"2024-05-10T14:07:22.170892+0000","last_peered":"2024-05-10T14:07:22.170892+0000","last_clean":"2024-05-10T14:07:22.170892+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:22.170892+0000","last_undegraded":"2024-05-10T14:07:22.170892+0000","last_fullsized":"2024-05-10T14:07:22.170892+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167438+0000","last_change":"2024-05-10T14:02:32.684955+0000","last_active":"2024-05-10T14:07:22.167438+0000","last_peered":"2024-05-10T14:07:22.167438+0000","last_clean":"2024-05-10T14:07:22.167438+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:22.167438+0000","last_undegraded":"2024-05-10T14:07:22.167438+0000","last_fullsized":"2024-05-10T14:07:22.167438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.911515+0000","last_change":"2024-05-10T14:07:37.911659+0000","last_active":"2024-05-10T14:07:37.911515+0000","last_peered":"2024-05-10T14:07:37.911515+0000","last_clean":"2024-05-10T14:07:37.911515+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:37.911515+0000","last_undegraded":"2024-05-10T14:07:37.911515+0000","last_fullsized":"2024-05-10T14:07:37.911515+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.911259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:19.020325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.685681+0000","last_change":"2024-05-10T14:07:33.685681+0000","last_active":"2024-05-10T14:07:33.685681+0000","last_peered":"2024-05-10T14:07:33.685681+0000","last_clean":"2024-05-10T14:07:33.685681+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:33.685681+0000","last_undegraded":"2024-05-10T14:07:33.685681+0000","last_fullsized":"2024-05-10T14:07:33.685681+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.685427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:49.104767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.748857+0000","last_change":"2024-05-10T14:07:35.748938+0000","last_active":"2024-05-10T14:07:35.748857+0000","last_peered":"2024-05-10T14:07:35.748857+0000","last_clean":"2024-05-10T14:07:35.748857+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:35.748857+0000","last_undegraded":"2024-05-10T14:07:35.748857+0000","last_fullsized":"2024-05-10T14:07:35.748857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.748668+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:43.158045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.357623+0000","last_change":"2024-05-10T14:07:24.357756+0000","last_active":"2024-05-10T14:07:24.357623+0000","last_peered":"2024-05-10T14:07:24.357623+0000","last_clean":"2024-05-10T14:07:24.357623+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:24.357623+0000","last_undegraded":"2024-05-10T14:07:24.357623+0000","last_fullsized":"2024-05-10T14:07:24.357623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.357369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:06.230763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076962+0000","last_change":"2024-05-10T14:06:56.384272+0000","last_active":"2024-05-10T14:07:12.076962+0000","last_peered":"2024-05-10T14:07:12.076962+0000","last_clean":"2024-05-10T14:07:12.076962+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:12.076962+0000","last_undegraded":"2024-05-10T14:07:12.076962+0000","last_fullsized":"2024-05-10T14:07:12.076962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.905735+0000","last_change":"2024-05-10T14:07:33.905800+0000","last_active":"2024-05-10T14:07:33.905735+0000","last_peered":"2024-05-10T14:07:33.905735+0000","last_clean":"2024-05-10T14:07:33.905735+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:33.905735+0000","last_undegraded":"2024-05-10T14:07:33.905735+0000","last_fullsized":"2024-05-10T14:07:33.905735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.905512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:23.202136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.756724+0000","last_change":"2024-05-10T14:02:30.639822+0000","last_active":"2024-05-10T14:07:20.756724+0000","last_peered":"2024-05-10T14:07:20.756724+0000","last_clean":"2024-05-10T14:07:20.756724+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:20.756724+0000","last_undegraded":"2024-05-10T14:07:20.756724+0000","last_fullsized":"2024-05-10T14:07:20.756724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.308065+0000","last_change":"2024-05-10T14:07:23.308065+0000","last_active":"2024-05-10T14:07:23.308065+0000","last_peered":"2024-05-10T14:07:23.308065+0000","last_clean":"2024-05-10T14:07:23.308065+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:23.308065+0000","last_undegraded":"2024-05-10T14:07:23.308065+0000","last_fullsized":"2024-05-10T14:07:23.308065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.307952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:33.043262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.550453+0000","last_change":"2024-05-10T14:02:36.760506+0000","last_active":"2024-05-10T14:07:11.550453+0000","last_peered":"2024-05-10T14:07:11.550453+0000","last_clean":"2024-05-10T14:07:11.550453+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:11.550453+0000","last_undegraded":"2024-05-10T14:07:11.550453+0000","last_fullsized":"2024-05-10T14:07:11.550453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"151'18","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.357918+0000","last_change":"2024-05-10T14:07:26.357993+0000","last_active":"2024-05-10T14:07:26.357918+0000","last_peered":"2024-05-10T14:07:26.357918+0000","last_clean":"2024-05-10T14:07:26.357918+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:26.357918+0000","last_undegraded":"2024-05-10T14:07:26.357918+0000","last_fullsized":"2024-05-10T14:07:26.357918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.357703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:44.029068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.155101+0000","last_change":"2024-05-10T14:07:26.155160+0000","last_active":"2024-05-10T14:07:26.155101+0000","last_peered":"2024-05-10T14:07:26.155101+0000","last_clean":"2024-05-10T14:07:26.155101+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:26.155101+0000","last_undegraded":"2024-05-10T14:07:26.155101+0000","last_fullsized":"2024-05-10T14:07:26.155101+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.154906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:47:49.825316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.637138+0000","last_change":"2024-05-10T14:02:32.673396+0000","last_active":"2024-05-10T14:07:22.637138+0000","last_peered":"2024-05-10T14:07:22.637138+0000","last_clean":"2024-05-10T14:07:22.637138+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:22.637138+0000","last_undegraded":"2024-05-10T14:07:22.637138+0000","last_fullsized":"2024-05-10T14:07:22.637138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.590161+0000","last_change":"2024-05-10T14:07:28.590216+0000","last_active":"2024-05-10T14:07:28.590161+0000","last_peered":"2024-05-10T14:07:28.590161+0000","last_clean":"2024-05-10T14:07:28.590161+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:28.590161+0000","last_undegraded":"2024-05-10T14:07:28.590161+0000","last_fullsized":"2024-05-10T14:07:28.590161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.589947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:04:13.568622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.080352+0000","last_change":"2024-05-10T14:06:56.349592+0000","last_active":"2024-05-10T14:07:12.080352+0000","last_peered":"2024-05-10T14:07:12.080352+0000","last_clean":"2024-05-10T14:07:12.080352+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:12.080352+0000","last_undegraded":"2024-05-10T14:07:12.080352+0000","last_fullsized":"2024-05-10T14:07:12.080352+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:33.645807+0000","last_clean_scrub_stamp":"2024-05-10T14:02:33.645807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"151'19","reported_seq":222,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:17.521513+0000","last_change":"2024-05-10T14:04:06.303957+0000","last_active":"2024-05-10T14:07:17.521513+0000","last_peered":"2024-05-10T14:07:17.521513+0000","last_clean":"2024-05-10T14:07:17.521513+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:17.521513+0000","last_undegraded":"2024-05-10T14:07:17.521513+0000","last_fullsized":"2024-05-10T14:07:17.521513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.934930+0000","last_change":"2024-05-10T14:07:29.934930+0000","last_active":"2024-05-10T14:07:29.934930+0000","last_peered":"2024-05-10T14:07:29.934930+0000","last_clean":"2024-05-10T14:07:29.934930+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:29.934930+0000","last_undegraded":"2024-05-10T14:07:29.934930+0000","last_fullsized":"2024-05-10T14:07:29.934930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.934670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.345933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.083962+0000","last_change":"2024-05-10T14:06:56.359585+0000","last_active":"2024-05-10T14:07:12.083962+0000","last_peered":"2024-05-10T14:07:12.083962+0000","last_clean":"2024-05-10T14:07:12.083962+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:12.083962+0000","last_undegraded":"2024-05-10T14:07:12.083962+0000","last_fullsized":"2024-05-10T14:07:12.083962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.637069+0000","last_change":"2024-05-10T14:02:32.676488+0000","last_active":"2024-05-10T14:07:22.637069+0000","last_peered":"2024-05-10T14:07:22.637069+0000","last_clean":"2024-05-10T14:07:22.637069+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:22.637069+0000","last_undegraded":"2024-05-10T14:07:22.637069+0000","last_fullsized":"2024-05-10T14:07:22.637069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076486+0000","last_change":"2024-05-10T14:04:06.309215+0000","last_active":"2024-05-10T14:07:12.076486+0000","last_peered":"2024-05-10T14:07:12.076486+0000","last_clean":"2024-05-10T14:07:12.076486+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:12.076486+0000","last_undegraded":"2024-05-10T14:07:12.076486+0000","last_fullsized":"2024-05-10T14:07:12.076486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.580771+0000","last_change":"2024-05-10T14:07:27.580831+0000","last_active":"2024-05-10T14:07:27.580771+0000","last_peered":"2024-05-10T14:07:27.580771+0000","last_clean":"2024-05-10T14:07:27.580771+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:27.580771+0000","last_undegraded":"2024-05-10T14:07:27.580771+0000","last_fullsized":"2024-05-10T14:07:27.580771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.580569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:31.176260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"151'16","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.920255+0000","last_change":"2024-05-10T14:07:30.920335+0000","last_active":"2024-05-10T14:07:30.920255+0000","last_peered":"2024-05-10T14:07:30.920255+0000","last_clean":"2024-05-10T14:07:30.920255+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:30.920255+0000","last_undegraded":"2024-05-10T14:07:30.920255+0000","last_fullsized":"2024-05-10T14:07:30.920255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'16","last_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_deep_scrub":"151'16","last_deep_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.920046+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:31.155143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.576463+0000","last_change":"2024-05-10T14:06:56.376840+0000","last_active":"2024-05-10T14:07:23.576463+0000","last_peered":"2024-05-10T14:07:23.576463+0000","last_clean":"2024-05-10T14:07:23.576463+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:23.576463+0000","last_undegraded":"2024-05-10T14:07:23.576463+0000","last_fullsized":"2024-05-10T14:07:23.576463+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:37.670720+0000","last_clean_scrub_stamp":"2024-05-10T14:02:37.670720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.673929+0000","last_change":"2024-05-10T14:07:28.673929+0000","last_active":"2024-05-10T14:07:28.673929+0000","last_peered":"2024-05-10T14:07:28.673929+0000","last_clean":"2024-05-10T14:07:28.673929+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:28.673929+0000","last_undegraded":"2024-05-10T14:07:28.673929+0000","last_fullsized":"2024-05-10T14:07:28.673929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.673633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:54.235533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167479+0000","last_change":"2024-05-10T14:02:32.664699+0000","last_active":"2024-05-10T14:07:22.167479+0000","last_peered":"2024-05-10T14:07:22.167479+0000","last_clean":"2024-05-10T14:07:22.167479+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:22.167479+0000","last_undegraded":"2024-05-10T14:07:22.167479+0000","last_fullsized":"2024-05-10T14:07:22.167479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'1","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.552219+0000","last_change":"2024-05-10T14:02:30.651498+0000","last_active":"2024-05-10T14:07:11.552219+0000","last_peered":"2024-05-10T14:07:11.552219+0000","last_clean":"2024-05-10T14:07:11.552219+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:11.552219+0000","last_undegraded":"2024-05-10T14:07:11.552219+0000","last_fullsized":"2024-05-10T14:07:11.552219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.676906+0000","last_change":"2024-05-10T14:07:35.676964+0000","last_active":"2024-05-10T14:07:35.676906+0000","last_peered":"2024-05-10T14:07:35.676906+0000","last_clean":"2024-05-10T14:07:35.676906+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:35.676906+0000","last_undegraded":"2024-05-10T14:07:35.676906+0000","last_fullsized":"2024-05-10T14:07:35.676906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.676718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:32.704938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"151'9","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167893+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:22.167893+0000","last_peered":"2024-05-10T14:07:22.167893+0000","last_clean":"2024-05-10T14:07:22.167893+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:22.167893+0000","last_undegraded":"2024-05-10T14:07:22.167893+0000","last_fullsized":"2024-05-10T14:07:22.167893+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.607383+0000","last_change":"2024-05-10T14:07:24.607383+0000","last_active":"2024-05-10T14:07:24.607383+0000","last_peered":"2024-05-10T14:07:24.607383+0000","last_clean":"2024-05-10T14:07:24.607383+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:24.607383+0000","last_undegraded":"2024-05-10T14:07:24.607383+0000","last_fullsized":"2024-05-10T14:07:24.607383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.607117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:43.526323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.096405+0000","last_change":"2024-05-10T14:07:41.096459+0000","last_active":"2024-05-10T14:07:41.096405+0000","last_peered":"2024-05-10T14:07:41.096405+0000","last_clean":"2024-05-10T14:07:41.096405+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:41.096405+0000","last_undegraded":"2024-05-10T14:07:41.096405+0000","last_fullsized":"2024-05-10T14:07:41.096405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.096206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:23.589611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.636395+0000","last_change":"2024-05-10T14:07:38.636490+0000","last_active":"2024-05-10T14:07:38.636395+0000","last_peered":"2024-05-10T14:07:38.636395+0000","last_clean":"2024-05-10T14:07:38.636395+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:38.636395+0000","last_undegraded":"2024-05-10T14:07:38.636395+0000","last_fullsized":"2024-05-10T14:07:38.636395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.636149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:24.139548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.968095+0000","last_change":"2024-05-10T14:07:25.968201+0000","last_active":"2024-05-10T14:07:25.968095+0000","last_peered":"2024-05-10T14:07:25.968095+0000","last_clean":"2024-05-10T14:07:25.968095+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:25.968095+0000","last_undegraded":"2024-05-10T14:07:25.968095+0000","last_fullsized":"2024-05-10T14:07:25.968095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.967836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:06.239366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"151'2","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.462243+0000","last_change":"2024-05-10T14:07:34.462313+0000","last_active":"2024-05-10T14:07:34.462243+0000","last_peered":"2024-05-10T14:07:34.462243+0000","last_clean":"2024-05-10T14:07:34.462243+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:34.462243+0000","last_undegraded":"2024-05-10T14:07:34.462243+0000","last_fullsized":"2024-05-10T14:07:34.462243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.462056+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:20.507444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"151'13","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.637856+0000","last_change":"2024-05-10T14:04:06.321841+0000","last_active":"2024-05-10T14:07:22.637856+0000","last_peered":"2024-05-10T14:07:22.637856+0000","last_clean":"2024-05-10T14:07:22.637856+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:22.637856+0000","last_undegraded":"2024-05-10T14:07:22.637856+0000","last_fullsized":"2024-05-10T14:07:22.637856+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.895329+0000","last_change":"2024-05-10T14:07:33.895329+0000","last_active":"2024-05-10T14:07:33.895329+0000","last_peered":"2024-05-10T14:07:33.895329+0000","last_clean":"2024-05-10T14:07:33.895329+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:33.895329+0000","last_undegraded":"2024-05-10T14:07:33.895329+0000","last_fullsized":"2024-05-10T14:07:33.895329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.894965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:22.254901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":246,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.174200+0000","last_change":"2024-05-10T14:02:40.726855+0000","last_active":"2024-05-10T14:07:22.174200+0000","last_peered":"2024-05-10T14:07:22.174200+0000","last_clean":"2024-05-10T14:07:22.174200+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:22.174200+0000","last_undegraded":"2024-05-10T14:07:22.174200+0000","last_fullsized":"2024-05-10T14:07:22.174200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:39.683235+0000","last_clean_scrub_stamp":"2024-05-10T14:02:39.683235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"151'2","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.393384+0000","last_change":"2024-05-10T14:07:29.393455+0000","last_active":"2024-05-10T14:07:29.393384+0000","last_peered":"2024-05-10T14:07:29.393384+0000","last_clean":"2024-05-10T14:07:29.393384+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:29.393384+0000","last_undegraded":"2024-05-10T14:07:29.393384+0000","last_fullsized":"2024-05-10T14:07:29.393384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.393159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:00.930447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.340471+0000","last_change":"2024-05-10T14:07:36.340528+0000","last_active":"2024-05-10T14:07:36.340471+0000","last_peered":"2024-05-10T14:07:36.340471+0000","last_clean":"2024-05-10T14:07:36.340471+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:36.340471+0000","last_undegraded":"2024-05-10T14:07:36.340471+0000","last_fullsized":"2024-05-10T14:07:36.340471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.340267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:14.747404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.411067+0000","last_change":"2024-05-10T14:07:33.411126+0000","last_active":"2024-05-10T14:07:33.411067+0000","last_peered":"2024-05-10T14:07:33.411067+0000","last_clean":"2024-05-10T14:07:33.411067+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:33.411067+0000","last_undegraded":"2024-05-10T14:07:33.411067+0000","last_fullsized":"2024-05-10T14:07:33.411067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.410857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:50.448699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.015430+0000","last_change":"2024-05-10T14:07:26.015489+0000","last_active":"2024-05-10T14:07:26.015430+0000","last_peered":"2024-05-10T14:07:26.015430+0000","last_clean":"2024-05-10T14:07:26.015430+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:26.015430+0000","last_undegraded":"2024-05-10T14:07:26.015430+0000","last_fullsized":"2024-05-10T14:07:26.015430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.015233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:52.736449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.076716+0000","last_change":"2024-05-10T14:06:56.384641+0000","last_active":"2024-05-10T14:07:12.076716+0000","last_peered":"2024-05-10T14:07:12.076716+0000","last_clean":"2024-05-10T14:07:12.076716+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:12.076716+0000","last_undegraded":"2024-05-10T14:07:12.076716+0000","last_fullsized":"2024-05-10T14:07:12.076716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075002+0000","last_change":"2024-05-10T14:04:06.305666+0000","last_active":"2024-05-10T14:07:12.075002+0000","last_peered":"2024-05-10T14:07:12.075002+0000","last_clean":"2024-05-10T14:07:12.075002+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:12.075002+0000","last_undegraded":"2024-05-10T14:07:12.075002+0000","last_fullsized":"2024-05-10T14:07:12.075002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.073657+0000","last_change":"2024-05-10T14:06:56.383753+0000","last_active":"2024-05-10T14:07:12.073657+0000","last_peered":"2024-05-10T14:07:12.073657+0000","last_clean":"2024-05-10T14:07:12.073657+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:12.073657+0000","last_undegraded":"2024-05-10T14:07:12.073657+0000","last_fullsized":"2024-05-10T14:07:12.073657+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.974978+0000","last_change":"2024-05-10T14:07:24.975077+0000","last_active":"2024-05-10T14:07:24.974978+0000","last_peered":"2024-05-10T14:07:24.974978+0000","last_clean":"2024-05-10T14:07:24.974978+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:24.974978+0000","last_undegraded":"2024-05-10T14:07:24.974978+0000","last_fullsized":"2024-05-10T14:07:24.974978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.974724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:57.874035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554136+0000","last_change":"2024-05-10T14:06:56.374564+0000","last_active":"2024-05-10T14:07:11.554136+0000","last_peered":"2024-05-10T14:07:11.554136+0000","last_clean":"2024-05-10T14:07:11.554136+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:11.554136+0000","last_undegraded":"2024-05-10T14:07:11.554136+0000","last_fullsized":"2024-05-10T14:07:11.554136+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.703198+0000","last_change":"2024-05-10T14:07:25.703260+0000","last_active":"2024-05-10T14:07:25.703198+0000","last_peered":"2024-05-10T14:07:25.703198+0000","last_clean":"2024-05-10T14:07:25.703198+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:25.703198+0000","last_undegraded":"2024-05-10T14:07:25.703198+0000","last_fullsized":"2024-05-10T14:07:25.703198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.703009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:49.335815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.654654+0000","last_change":"2024-05-10T14:07:28.654715+0000","last_active":"2024-05-10T14:07:28.654654+0000","last_peered":"2024-05-10T14:07:28.654654+0000","last_clean":"2024-05-10T14:07:28.654654+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:28.654654+0000","last_undegraded":"2024-05-10T14:07:28.654654+0000","last_fullsized":"2024-05-10T14:07:28.654654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.654459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:03.589053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.075157+0000","last_change":"2024-05-10T14:02:30.643325+0000","last_active":"2024-05-10T14:07:12.075157+0000","last_peered":"2024-05-10T14:07:12.075157+0000","last_clean":"2024-05-10T14:07:12.075157+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:12.075157+0000","last_undegraded":"2024-05-10T14:07:12.075157+0000","last_fullsized":"2024-05-10T14:07:12.075157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548860+0000","last_change":"2024-05-10T14:02:32.690225+0000","last_active":"2024-05-10T14:07:11.548860+0000","last_peered":"2024-05-10T14:07:11.548860+0000","last_clean":"2024-05-10T14:07:11.548860+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:11.548860+0000","last_undegraded":"2024-05-10T14:07:11.548860+0000","last_fullsized":"2024-05-10T14:07:11.548860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.081812+0000","last_change":"2024-05-10T14:06:56.375231+0000","last_active":"2024-05-10T14:07:12.081812+0000","last_peered":"2024-05-10T14:07:12.081812+0000","last_clean":"2024-05-10T14:07:12.081812+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:12.081812+0000","last_undegraded":"2024-05-10T14:07:12.081812+0000","last_fullsized":"2024-05-10T14:07:12.081812+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.388125+0000","last_change":"2024-05-10T14:07:37.388183+0000","last_active":"2024-05-10T14:07:37.388125+0000","last_peered":"2024-05-10T14:07:37.388125+0000","last_clean":"2024-05-10T14:07:37.388125+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:37.388125+0000","last_undegraded":"2024-05-10T14:07:37.388125+0000","last_fullsized":"2024-05-10T14:07:37.388125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.387927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:51.637579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.554587+0000","last_change":"2024-05-10T14:02:30.628619+0000","last_active":"2024-05-10T14:07:11.554587+0000","last_peered":"2024-05-10T14:07:11.554587+0000","last_clean":"2024-05-10T14:07:11.554587+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:11.554587+0000","last_undegraded":"2024-05-10T14:07:11.554587+0000","last_fullsized":"2024-05-10T14:07:11.554587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.174633+0000","last_change":"2024-05-10T14:02:32.677553+0000","last_active":"2024-05-10T14:07:12.174633+0000","last_peered":"2024-05-10T14:07:12.174633+0000","last_clean":"2024-05-10T14:07:12.174633+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:12.174633+0000","last_undegraded":"2024-05-10T14:07:12.174633+0000","last_fullsized":"2024-05-10T14:07:12.174633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.596591+0000","last_change":"2024-05-10T14:07:38.596644+0000","last_active":"2024-05-10T14:07:38.596591+0000","last_peered":"2024-05-10T14:07:38.596591+0000","last_clean":"2024-05-10T14:07:38.596591+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:38.596591+0000","last_undegraded":"2024-05-10T14:07:38.596591+0000","last_fullsized":"2024-05-10T14:07:38.596591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.596387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:03.750556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.172381+0000","last_change":"2024-05-10T14:02:32.674658+0000","last_active":"2024-05-10T14:07:12.172381+0000","last_peered":"2024-05-10T14:07:12.172381+0000","last_clean":"2024-05-10T14:07:12.172381+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:12.172381+0000","last_undegraded":"2024-05-10T14:07:12.172381+0000","last_fullsized":"2024-05-10T14:07:12.172381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.549226+0000","last_change":"2024-05-10T14:02:30.638085+0000","last_active":"2024-05-10T14:07:11.549226+0000","last_peered":"2024-05-10T14:07:11.549226+0000","last_clean":"2024-05-10T14:07:11.549226+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:11.549226+0000","last_undegraded":"2024-05-10T14:07:11.549226+0000","last_fullsized":"2024-05-10T14:07:11.549226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.946505+0000","last_change":"2024-05-10T14:07:32.946590+0000","last_active":"2024-05-10T14:07:32.946505+0000","last_peered":"2024-05-10T14:07:32.946505+0000","last_clean":"2024-05-10T14:07:32.946505+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:32.946505+0000","last_undegraded":"2024-05-10T14:07:32.946505+0000","last_fullsized":"2024-05-10T14:07:32.946505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.946291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:09.668951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"81'1","reported_seq":231,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.696107+0000","last_change":"2024-05-10T14:06:56.474732+0000","last_active":"2024-05-10T14:07:21.696107+0000","last_peered":"2024-05-10T14:07:21.696107+0000","last_clean":"2024-05-10T14:07:21.696107+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:21.696107+0000","last_undegraded":"2024-05-10T14:07:21.696107+0000","last_fullsized":"2024-05-10T14:07:21.696107+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.551344+0000","last_change":"2024-05-10T14:02:32.677203+0000","last_active":"2024-05-10T14:07:11.551344+0000","last_peered":"2024-05-10T14:07:11.551344+0000","last_clean":"2024-05-10T14:07:11.551344+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:11.551344+0000","last_undegraded":"2024-05-10T14:07:11.551344+0000","last_fullsized":"2024-05-10T14:07:11.551344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074394+0000","last_change":"2024-05-10T14:06:56.370154+0000","last_active":"2024-05-10T14:07:12.074394+0000","last_peered":"2024-05-10T14:07:12.074394+0000","last_clean":"2024-05-10T14:07:12.074394+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:12.074394+0000","last_undegraded":"2024-05-10T14:07:12.074394+0000","last_fullsized":"2024-05-10T14:07:12.074394+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.082378+0000","last_change":"2024-05-10T14:06:56.348683+0000","last_active":"2024-05-10T14:07:12.082378+0000","last_peered":"2024-05-10T14:07:12.082378+0000","last_clean":"2024-05-10T14:07:12.082378+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:12.082378+0000","last_undegraded":"2024-05-10T14:07:12.082378+0000","last_fullsized":"2024-05-10T14:07:12.082378+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.336946+0000","last_change":"2024-05-10T14:07:33.337101+0000","last_active":"2024-05-10T14:07:33.336946+0000","last_peered":"2024-05-10T14:07:33.336946+0000","last_clean":"2024-05-10T14:07:33.336946+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:33.336946+0000","last_undegraded":"2024-05-10T14:07:33.336946+0000","last_fullsized":"2024-05-10T14:07:33.336946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.336663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:52.255869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.896333+0000","last_change":"2024-05-10T14:07:36.896395+0000","last_active":"2024-05-10T14:07:36.896333+0000","last_peered":"2024-05-10T14:07:36.896333+0000","last_clean":"2024-05-10T14:07:36.896333+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:36.896333+0000","last_undegraded":"2024-05-10T14:07:36.896333+0000","last_fullsized":"2024-05-10T14:07:36.896333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.896107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:33.864403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.222300+0000","last_change":"2024-05-10T14:07:31.222361+0000","last_active":"2024-05-10T14:07:31.222300+0000","last_peered":"2024-05-10T14:07:31.222300+0000","last_clean":"2024-05-10T14:07:31.222300+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:31.222300+0000","last_undegraded":"2024-05-10T14:07:31.222300+0000","last_fullsized":"2024-05-10T14:07:31.222300+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.222075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:34.716445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:11.548793+0000","last_change":"2024-05-10T14:02:32.685871+0000","last_active":"2024-05-10T14:07:11.548793+0000","last_peered":"2024-05-10T14:07:11.548793+0000","last_clean":"2024-05-10T14:07:11.548793+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:11.548793+0000","last_undegraded":"2024-05-10T14:07:11.548793+0000","last_fullsized":"2024-05-10T14:07:11.548793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.981090+0000","last_change":"2024-05-10T14:07:28.981147+0000","last_active":"2024-05-10T14:07:28.981090+0000","last_peered":"2024-05-10T14:07:28.981090+0000","last_clean":"2024-05-10T14:07:28.981090+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:28.981090+0000","last_undegraded":"2024-05-10T14:07:28.981090+0000","last_fullsized":"2024-05-10T14:07:28.981090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.980896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:10.026254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.192046+0000","last_change":"2024-05-10T14:07:38.192104+0000","last_active":"2024-05-10T14:07:38.192046+0000","last_peered":"2024-05-10T14:07:38.192046+0000","last_clean":"2024-05-10T14:07:38.192046+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:38.192046+0000","last_undegraded":"2024-05-10T14:07:38.192046+0000","last_fullsized":"2024-05-10T14:07:38.192046+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.191843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:27.198510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.079661+0000","last_change":"2024-05-10T14:06:56.384258+0000","last_active":"2024-05-10T14:07:12.079661+0000","last_peered":"2024-05-10T14:07:12.079661+0000","last_clean":"2024-05-10T14:07:12.079661+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:12.079661+0000","last_undegraded":"2024-05-10T14:07:12.079661+0000","last_fullsized":"2024-05-10T14:07:12.079661+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":177,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.074359+0000","last_change":"2024-05-10T14:04:06.299672+0000","last_active":"2024-05-10T14:07:12.074359+0000","last_peered":"2024-05-10T14:07:12.074359+0000","last_clean":"2024-05-10T14:07:12.074359+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:12.074359+0000","last_undegraded":"2024-05-10T14:07:12.074359+0000","last_fullsized":"2024-05-10T14:07:12.074359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:20.757090+0000","last_change":"2024-05-10T14:02:32.679958+0000","last_active":"2024-05-10T14:07:20.757090+0000","last_peered":"2024-05-10T14:07:20.757090+0000","last_clean":"2024-05-10T14:07:20.757090+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:20.757090+0000","last_undegraded":"2024-05-10T14:07:20.757090+0000","last_fullsized":"2024-05-10T14:07:20.757090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:31.625806+0000","last_clean_scrub_stamp":"2024-05-10T14:02:31.625806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:12.072931+0000","last_change":"2024-05-10T14:02:30.639456+0000","last_active":"2024-05-10T14:07:12.072931+0000","last_peered":"2024-05-10T14:07:12.072931+0000","last_clean":"2024-05-10T14:07:12.072931+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:12.072931+0000","last_undegraded":"2024-05-10T14:07:12.072931+0000","last_fullsized":"2024-05-10T14:07:12.072931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:29.600572+0000","last_clean_scrub_stamp":"2024-05-10T14:02:29.600572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"151'2","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.576292+0000","last_change":"2024-05-10T14:07:26.576360+0000","last_active":"2024-05-10T14:07:26.576292+0000","last_peered":"2024-05-10T14:07:26.576292+0000","last_clean":"2024-05-10T14:07:26.576292+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:26.576292+0000","last_undegraded":"2024-05-10T14:07:26.576292+0000","last_fullsized":"2024-05-10T14:07:26.576292+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.576073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:06.688838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":887,"num_read_kb":646,"num_write":483,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":621,"ondisk_log_size":621,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39720,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332120,"statfs":{"total":96636764160,"available":96596090880,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710765,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33536,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338304,"statfs":{"total":96636764160,"available":96602423296,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41244,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330596,"statfs":{"total":96636764160,"available":96594530304,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39168,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332672,"statfs":{"total":96636764160,"available":96596656128,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37724,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334116,"statfs":{"total":96636764160,"available":96598134784,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37148,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334692,"statfs":{"total":96636764160,"available":96598724608,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:07:44.921 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.922 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.922 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.922 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.922 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.922 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.923 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.923 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.923 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.923 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.923 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.924 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.925 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.926 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.926 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.926 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.926 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.926 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.927 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.928 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.928 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.928 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.928 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.928 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T14:02:18.520766+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=18, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.929 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.930 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.930 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.930 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.930 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.930 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.931 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.931 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.931 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.931 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.931 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.932 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.932 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.932 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.932 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.932 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-10T14:02:23.557564+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=23, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.933 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.933 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.933 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.933 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.933 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.934 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.935 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-10T14:02:33.645807+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=33, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.936 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-10T14:02:37.670720+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=37, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.937 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.938 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.938 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-10T14:02:39.683235+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=39, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.938 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.939 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.940 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.941 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-10T14:02:31.625806+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=31, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.942 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T14:02:29.600572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:07:44.942 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T14:08:04.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:08:05.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:08:05.314 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:08:05.327 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-05-10T14:08:04.243495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1042,"num_read_kb":785,"num_write":639,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302664,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672056,"statfs":{"total":773094113280,"available":772784185344,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.237641+0000","last_change":"2024-05-10T14:07:32.237708+0000","last_active":"2024-05-10T14:07:32.237641+0000","last_peered":"2024-05-10T14:07:32.237641+0000","last_clean":"2024-05-10T14:07:32.237641+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:32.237641+0000","last_undegraded":"2024-05-10T14:07:32.237641+0000","last_fullsized":"2024-05-10T14:07:32.237641+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.237436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:27.467926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.602388+0000","last_change":"2024-05-10T14:07:32.602442+0000","last_active":"2024-05-10T14:07:32.602388+0000","last_peered":"2024-05-10T14:07:32.602388+0000","last_clean":"2024-05-10T14:07:32.602388+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:32.602388+0000","last_undegraded":"2024-05-10T14:07:32.602388+0000","last_fullsized":"2024-05-10T14:07:32.602388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.602188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:02.195947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.416102+0000","last_change":"2024-05-10T14:07:38.416269+0000","last_active":"2024-05-10T14:07:38.416102+0000","last_peered":"2024-05-10T14:07:38.416102+0000","last_clean":"2024-05-10T14:07:38.416102+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:38.416102+0000","last_undegraded":"2024-05-10T14:07:38.416102+0000","last_fullsized":"2024-05-10T14:07:38.416102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.415868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:46.847601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.226377+0000","last_change":"2024-05-10T14:07:35.226431+0000","last_active":"2024-05-10T14:07:35.226377+0000","last_peered":"2024-05-10T14:07:35.226377+0000","last_clean":"2024-05-10T14:07:35.226377+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:35.226377+0000","last_undegraded":"2024-05-10T14:07:35.226377+0000","last_fullsized":"2024-05-10T14:07:35.226377+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.226183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:23.586119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.883204+0000","last_change":"2024-05-10T14:07:44.883257+0000","last_active":"2024-05-10T14:07:44.883204+0000","last_peered":"2024-05-10T14:07:44.883204+0000","last_clean":"2024-05-10T14:07:44.883204+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:44.883204+0000","last_undegraded":"2024-05-10T14:07:44.883204+0000","last_fullsized":"2024-05-10T14:07:44.883204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.883028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.883028+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.883028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:22.038754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.665549+0000","last_change":"2024-05-10T14:07:27.665549+0000","last_active":"2024-05-10T14:07:27.665549+0000","last_peered":"2024-05-10T14:07:27.665549+0000","last_clean":"2024-05-10T14:07:27.665549+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:27.665549+0000","last_undegraded":"2024-05-10T14:07:27.665549+0000","last_fullsized":"2024-05-10T14:07:27.665549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.665294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:00.718867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.577036+0000","last_change":"2024-05-10T14:07:42.577161+0000","last_active":"2024-05-10T14:07:42.577036+0000","last_peered":"2024-05-10T14:07:42.577036+0000","last_clean":"2024-05-10T14:07:42.577036+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:42.577036+0000","last_undegraded":"2024-05-10T14:07:42.577036+0000","last_fullsized":"2024-05-10T14:07:42.577036+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.576785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.576785+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.576785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:38.678526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.814072+0000","last_change":"2024-05-10T14:07:48.814135+0000","last_active":"2024-05-10T14:07:48.814072+0000","last_peered":"2024-05-10T14:07:48.814072+0000","last_clean":"2024-05-10T14:07:48.814072+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:48.814072+0000","last_undegraded":"2024-05-10T14:07:48.814072+0000","last_fullsized":"2024-05-10T14:07:48.814072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.813866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.813866+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.813866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:27.772040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.267702+0000","last_change":"2024-05-10T14:07:30.267764+0000","last_active":"2024-05-10T14:07:30.267702+0000","last_peered":"2024-05-10T14:07:30.267702+0000","last_clean":"2024-05-10T14:07:30.267702+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:30.267702+0000","last_undegraded":"2024-05-10T14:07:30.267702+0000","last_fullsized":"2024-05-10T14:07:30.267702+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.267501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:53.900308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.371220+0000","last_change":"2024-05-10T14:07:38.371368+0000","last_active":"2024-05-10T14:07:38.371220+0000","last_peered":"2024-05-10T14:07:38.371220+0000","last_clean":"2024-05-10T14:07:38.371220+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:38.371220+0000","last_undegraded":"2024-05-10T14:07:38.371220+0000","last_fullsized":"2024-05-10T14:07:38.371220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.370951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:36.149428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.606354+0000","last_change":"2024-05-10T14:07:41.606412+0000","last_active":"2024-05-10T14:07:41.606354+0000","last_peered":"2024-05-10T14:07:41.606354+0000","last_clean":"2024-05-10T14:07:41.606354+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:41.606354+0000","last_undegraded":"2024-05-10T14:07:41.606354+0000","last_fullsized":"2024-05-10T14:07:41.606354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.606150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.606150+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.606150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:39.467629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.634740+0000","last_change":"2024-05-10T14:07:30.634849+0000","last_active":"2024-05-10T14:07:30.634740+0000","last_peered":"2024-05-10T14:07:30.634740+0000","last_clean":"2024-05-10T14:07:30.634740+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:30.634740+0000","last_undegraded":"2024-05-10T14:07:30.634740+0000","last_fullsized":"2024-05-10T14:07:30.634740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.634509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:32.832602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.062368+0000","last_change":"2024-05-10T14:07:48.062423+0000","last_active":"2024-05-10T14:07:48.062368+0000","last_peered":"2024-05-10T14:07:48.062368+0000","last_clean":"2024-05-10T14:07:48.062368+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:48.062368+0000","last_undegraded":"2024-05-10T14:07:48.062368+0000","last_fullsized":"2024-05-10T14:07:48.062368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.062170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.062170+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.062170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:00.941221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.632741+0000","last_change":"2024-05-10T14:07:24.632859+0000","last_active":"2024-05-10T14:07:24.632741+0000","last_peered":"2024-05-10T14:07:24.632741+0000","last_clean":"2024-05-10T14:07:24.632741+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:24.632741+0000","last_undegraded":"2024-05-10T14:07:24.632741+0000","last_fullsized":"2024-05-10T14:07:24.632741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.632488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:19.285245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.716664+0000","last_change":"2024-05-10T14:07:22.716664+0000","last_active":"2024-05-10T14:07:22.716664+0000","last_peered":"2024-05-10T14:07:22.716664+0000","last_clean":"2024-05-10T14:07:22.716664+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:22.716664+0000","last_undegraded":"2024-05-10T14:07:22.716664+0000","last_fullsized":"2024-05-10T14:07:22.716664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.716512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:08.219910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.936216+0000","last_change":"2024-05-10T14:07:31.936276+0000","last_active":"2024-05-10T14:07:31.936216+0000","last_peered":"2024-05-10T14:07:31.936216+0000","last_clean":"2024-05-10T14:07:31.936216+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:31.936216+0000","last_undegraded":"2024-05-10T14:07:31.936216+0000","last_fullsized":"2024-05-10T14:07:31.936216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.936022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:58.355521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.661027+0000","last_change":"2024-05-10T14:07:36.661124+0000","last_active":"2024-05-10T14:07:36.661027+0000","last_peered":"2024-05-10T14:07:36.661027+0000","last_clean":"2024-05-10T14:07:36.661027+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:36.661027+0000","last_undegraded":"2024-05-10T14:07:36.661027+0000","last_fullsized":"2024-05-10T14:07:36.661027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:58.013075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.104577+0000","last_change":"2024-05-10T14:07:42.104635+0000","last_active":"2024-05-10T14:07:42.104577+0000","last_peered":"2024-05-10T14:07:42.104577+0000","last_clean":"2024-05-10T14:07:42.104577+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:42.104577+0000","last_undegraded":"2024-05-10T14:07:42.104577+0000","last_fullsized":"2024-05-10T14:07:42.104577+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.104368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:16.126208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"151'2","reported_seq":50,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.051449+0000","last_change":"2024-05-10T14:07:55.051535+0000","last_active":"2024-05-10T14:07:55.051449+0000","last_peered":"2024-05-10T14:07:55.051449+0000","last_clean":"2024-05-10T14:07:55.051449+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:55.051449+0000","last_undegraded":"2024-05-10T14:07:55.051449+0000","last_fullsized":"2024-05-10T14:07:55.051449+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:55.051235+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:55.051235+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.051235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:41.640703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.449415+0000","last_change":"2024-05-10T14:07:41.449514+0000","last_active":"2024-05-10T14:07:41.449415+0000","last_peered":"2024-05-10T14:07:41.449415+0000","last_clean":"2024-05-10T14:07:41.449415+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:41.449415+0000","last_undegraded":"2024-05-10T14:07:41.449415+0000","last_fullsized":"2024-05-10T14:07:41.449415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.449090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:15:30.448952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.611226+0000","last_change":"2024-05-10T14:07:37.611279+0000","last_active":"2024-05-10T14:07:37.611226+0000","last_peered":"2024-05-10T14:07:37.611226+0000","last_clean":"2024-05-10T14:07:37.611226+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:37.611226+0000","last_undegraded":"2024-05-10T14:07:37.611226+0000","last_fullsized":"2024-05-10T14:07:37.611226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.611035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:58.598206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.486398+0000","last_change":"2024-05-10T14:07:44.486522+0000","last_active":"2024-05-10T14:07:44.486398+0000","last_peered":"2024-05-10T14:07:44.486398+0000","last_clean":"2024-05-10T14:07:44.486398+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:44.486398+0000","last_undegraded":"2024-05-10T14:07:44.486398+0000","last_fullsized":"2024-05-10T14:07:44.486398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.486110+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:41.514329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.998725+0000","last_change":"2024-05-10T14:07:29.998792+0000","last_active":"2024-05-10T14:07:29.998725+0000","last_peered":"2024-05-10T14:07:29.998725+0000","last_clean":"2024-05-10T14:07:29.998725+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:29.998725+0000","last_undegraded":"2024-05-10T14:07:29.998725+0000","last_fullsized":"2024-05-10T14:07:29.998725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.998522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:47.669886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.760550+0000","last_change":"2024-05-10T14:07:45.760615+0000","last_active":"2024-05-10T14:07:45.760550+0000","last_peered":"2024-05-10T14:07:45.760550+0000","last_clean":"2024-05-10T14:07:45.760550+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:45.760550+0000","last_undegraded":"2024-05-10T14:07:45.760550+0000","last_fullsized":"2024-05-10T14:07:45.760550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.760311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.760311+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.760311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:40.832931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.961826+0000","last_change":"2024-05-10T14:07:30.961888+0000","last_active":"2024-05-10T14:07:30.961826+0000","last_peered":"2024-05-10T14:07:30.961826+0000","last_clean":"2024-05-10T14:07:30.961826+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:30.961826+0000","last_undegraded":"2024-05-10T14:07:30.961826+0000","last_fullsized":"2024-05-10T14:07:30.961826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.961576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:58:37.950718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.608572+0000","last_change":"2024-05-10T14:07:52.608639+0000","last_active":"2024-05-10T14:07:52.608572+0000","last_peered":"2024-05-10T14:07:52.608572+0000","last_clean":"2024-05-10T14:07:52.608572+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:52.608572+0000","last_undegraded":"2024-05-10T14:07:52.608572+0000","last_fullsized":"2024-05-10T14:07:52.608572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.608368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.608368+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.608368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:30:43.289580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.692789+0000","last_change":"2024-05-10T14:07:32.692849+0000","last_active":"2024-05-10T14:07:32.692789+0000","last_peered":"2024-05-10T14:07:32.692789+0000","last_clean":"2024-05-10T14:07:32.692789+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:32.692789+0000","last_undegraded":"2024-05-10T14:07:32.692789+0000","last_fullsized":"2024-05-10T14:07:32.692789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.692565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:52:59.551145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.797227+0000","last_change":"2024-05-10T14:07:47.797294+0000","last_active":"2024-05-10T14:07:47.797227+0000","last_peered":"2024-05-10T14:07:47.797227+0000","last_clean":"2024-05-10T14:07:47.797227+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:47.797227+0000","last_undegraded":"2024-05-10T14:07:47.797227+0000","last_fullsized":"2024-05-10T14:07:47.797227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.796955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.796955+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.796955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:11.167947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.644834+0000","last_change":"2024-05-10T14:07:25.644834+0000","last_active":"2024-05-10T14:07:25.644834+0000","last_peered":"2024-05-10T14:07:25.644834+0000","last_clean":"2024-05-10T14:07:25.644834+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:25.644834+0000","last_undegraded":"2024-05-10T14:07:25.644834+0000","last_fullsized":"2024-05-10T14:07:25.644834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.644578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:23.828908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.952456+0000","last_change":"2024-05-10T14:07:38.952514+0000","last_active":"2024-05-10T14:07:38.952456+0000","last_peered":"2024-05-10T14:07:38.952456+0000","last_clean":"2024-05-10T14:07:38.952456+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:38.952456+0000","last_undegraded":"2024-05-10T14:07:38.952456+0000","last_fullsized":"2024-05-10T14:07:38.952456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.952232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:17.359369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.069780+0000","last_change":"2024-05-10T14:07:46.069842+0000","last_active":"2024-05-10T14:07:46.069780+0000","last_peered":"2024-05-10T14:07:46.069780+0000","last_clean":"2024-05-10T14:07:46.069780+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:46.069780+0000","last_undegraded":"2024-05-10T14:07:46.069780+0000","last_fullsized":"2024-05-10T14:07:46.069780+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.069579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.069579+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.069579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:23.225305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.606269+0000","last_change":"2024-05-10T14:07:29.606325+0000","last_active":"2024-05-10T14:07:29.606269+0000","last_peered":"2024-05-10T14:07:29.606269+0000","last_clean":"2024-05-10T14:07:29.606269+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:29.606269+0000","last_undegraded":"2024-05-10T14:07:29.606269+0000","last_fullsized":"2024-05-10T14:07:29.606269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.606068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:24.603115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"151'17","reported_seq":318,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.944161+0000","last_change":"2024-05-10T14:07:58.944272+0000","last_active":"2024-05-10T14:07:58.944161+0000","last_peered":"2024-05-10T14:07:58.944161+0000","last_clean":"2024-05-10T14:07:58.944161+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:58.944161+0000","last_undegraded":"2024-05-10T14:07:58.944161+0000","last_fullsized":"2024-05-10T14:07:58.944161+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:58.943969+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:58.943969+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.943969+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:06.995656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.144113+0000","last_change":"2024-05-10T14:07:40.144171+0000","last_active":"2024-05-10T14:07:40.144113+0000","last_peered":"2024-05-10T14:07:40.144113+0000","last_clean":"2024-05-10T14:07:40.144113+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:40.144113+0000","last_undegraded":"2024-05-10T14:07:40.144113+0000","last_fullsized":"2024-05-10T14:07:40.144113+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.143924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:06.285310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"151'2","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.660750+0000","last_change":"2024-05-10T14:07:36.660899+0000","last_active":"2024-05-10T14:07:36.660750+0000","last_peered":"2024-05-10T14:07:36.660750+0000","last_clean":"2024-05-10T14:07:36.660750+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:36.660750+0000","last_undegraded":"2024-05-10T14:07:36.660750+0000","last_fullsized":"2024-05-10T14:07:36.660750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:47.156144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.588894+0000","last_change":"2024-05-10T14:07:57.588958+0000","last_active":"2024-05-10T14:07:57.588894+0000","last_peered":"2024-05-10T14:07:57.588894+0000","last_clean":"2024-05-10T14:07:57.588894+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:57.588894+0000","last_undegraded":"2024-05-10T14:07:57.588894+0000","last_fullsized":"2024-05-10T14:07:57.588894+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:57.588686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:57.588686+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.588686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:58.987456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":231,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.536342+0000","last_change":"2024-05-10T14:07:51.536342+0000","last_active":"2024-05-10T14:07:51.536342+0000","last_peered":"2024-05-10T14:07:51.536342+0000","last_clean":"2024-05-10T14:07:51.536342+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:51.536342+0000","last_undegraded":"2024-05-10T14:07:51.536342+0000","last_fullsized":"2024-05-10T14:07:51.536342+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.535910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.535910+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.535910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:39:38.365141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.607177+0000","last_change":"2024-05-10T14:07:56.607236+0000","last_active":"2024-05-10T14:07:56.607177+0000","last_peered":"2024-05-10T14:07:56.607177+0000","last_clean":"2024-05-10T14:07:56.607177+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:56.607177+0000","last_undegraded":"2024-05-10T14:07:56.607177+0000","last_fullsized":"2024-05-10T14:07:56.607177+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.606960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.606960+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.606960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:01.221896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"151'9","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.660022+0000","last_change":"2024-05-10T14:07:39.660111+0000","last_active":"2024-05-10T14:07:39.660022+0000","last_peered":"2024-05-10T14:07:39.660022+0000","last_clean":"2024-05-10T14:07:39.660022+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:39.660022+0000","last_undegraded":"2024-05-10T14:07:39.660022+0000","last_fullsized":"2024-05-10T14:07:39.660022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'9","last_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_deep_scrub":"151'9","last_deep_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.659812+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:39.197461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.630260+0000","last_change":"2024-05-10T14:07:23.630260+0000","last_active":"2024-05-10T14:07:23.630260+0000","last_peered":"2024-05-10T14:07:23.630260+0000","last_clean":"2024-05-10T14:07:23.630260+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:23.630260+0000","last_undegraded":"2024-05-10T14:07:23.630260+0000","last_fullsized":"2024-05-10T14:07:23.630260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.630010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:01.557663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.898720+0000","last_change":"2024-05-10T14:07:39.898720+0000","last_active":"2024-05-10T14:07:39.898720+0000","last_peered":"2024-05-10T14:07:39.898720+0000","last_clean":"2024-05-10T14:07:39.898720+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:39.898720+0000","last_undegraded":"2024-05-10T14:07:39.898720+0000","last_fullsized":"2024-05-10T14:07:39.898720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.898472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:05.577507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.748022+0000","last_change":"2024-05-10T14:07:50.748079+0000","last_active":"2024-05-10T14:07:50.748022+0000","last_peered":"2024-05-10T14:07:50.748022+0000","last_clean":"2024-05-10T14:07:50.748022+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:50.748022+0000","last_undegraded":"2024-05-10T14:07:50.748022+0000","last_fullsized":"2024-05-10T14:07:50.748022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.747827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.747827+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.747827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:34.205205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.110843+0000","last_change":"2024-05-10T14:07:49.110906+0000","last_active":"2024-05-10T14:07:49.110843+0000","last_peered":"2024-05-10T14:07:49.110843+0000","last_clean":"2024-05-10T14:07:49.110843+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:49.110843+0000","last_undegraded":"2024-05-10T14:07:49.110843+0000","last_fullsized":"2024-05-10T14:07:49.110843+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.110609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.110609+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.110609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:34.033793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.745852+0000","last_change":"2024-05-10T14:07:38.745908+0000","last_active":"2024-05-10T14:07:38.745852+0000","last_peered":"2024-05-10T14:07:38.745852+0000","last_clean":"2024-05-10T14:07:38.745852+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:38.745852+0000","last_undegraded":"2024-05-10T14:07:38.745852+0000","last_fullsized":"2024-05-10T14:07:38.745852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.745597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:12.433474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"151'15","reported_seq":278,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.990369+0000","last_change":"2024-05-10T14:07:22.990427+0000","last_active":"2024-05-10T14:07:22.990369+0000","last_peered":"2024-05-10T14:07:22.990369+0000","last_clean":"2024-05-10T14:07:22.990369+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:22.990369+0000","last_undegraded":"2024-05-10T14:07:22.990369+0000","last_fullsized":"2024-05-10T14:07:22.990369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.990219+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:57.666673+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"151'19","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.021918+0000","last_change":"2024-05-10T14:07:58.021987+0000","last_active":"2024-05-10T14:07:58.021918+0000","last_peered":"2024-05-10T14:07:58.021918+0000","last_clean":"2024-05-10T14:07:58.021918+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:58.021918+0000","last_undegraded":"2024-05-10T14:07:58.021918+0000","last_fullsized":"2024-05-10T14:07:58.021918+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:58.021702+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:58.021702+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.021702+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:40.193859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.886042+0000","last_change":"2024-05-10T14:07:54.886102+0000","last_active":"2024-05-10T14:07:54.886042+0000","last_peered":"2024-05-10T14:07:54.886042+0000","last_clean":"2024-05-10T14:07:54.886042+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:54.886042+0000","last_undegraded":"2024-05-10T14:07:54.886042+0000","last_fullsized":"2024-05-10T14:07:54.886042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.885836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.885836+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.885836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:28.573712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:08:00.639256+0000","last_change":"2024-05-10T14:08:00.639311+0000","last_active":"2024-05-10T14:08:00.639256+0000","last_peered":"2024-05-10T14:08:00.639256+0000","last_clean":"2024-05-10T14:08:00.639256+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:08:00.639256+0000","last_undegraded":"2024-05-10T14:08:00.639256+0000","last_fullsized":"2024-05-10T14:08:00.639256+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:08:00.639052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:08:00.639052+0000","last_clean_scrub_stamp":"2024-05-10T14:08:00.639052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:27.056850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.369943+0000","last_change":"2024-05-10T14:07:35.370001+0000","last_active":"2024-05-10T14:07:35.369943+0000","last_peered":"2024-05-10T14:07:35.369943+0000","last_clean":"2024-05-10T14:07:35.369943+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:35.369943+0000","last_undegraded":"2024-05-10T14:07:35.369943+0000","last_fullsized":"2024-05-10T14:07:35.369943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.369718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:16.478783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.698257+0000","last_change":"2024-05-10T14:07:46.698318+0000","last_active":"2024-05-10T14:07:46.698257+0000","last_peered":"2024-05-10T14:07:46.698257+0000","last_clean":"2024-05-10T14:07:46.698257+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:46.698257+0000","last_undegraded":"2024-05-10T14:07:46.698257+0000","last_fullsized":"2024-05-10T14:07:46.698257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.698054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.698054+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.698054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:52:22.310482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"151'17","reported_seq":66,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.066097+0000","last_change":"2024-05-10T14:07:56.066247+0000","last_active":"2024-05-10T14:07:56.066097+0000","last_peered":"2024-05-10T14:07:56.066097+0000","last_clean":"2024-05-10T14:07:56.066097+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:56.066097+0000","last_undegraded":"2024-05-10T14:07:56.066097+0000","last_fullsized":"2024-05-10T14:07:56.066097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:56.065789+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:56.065789+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.065789+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:34.531816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"151'18","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.745533+0000","last_change":"2024-05-10T14:07:37.745595+0000","last_active":"2024-05-10T14:07:37.745533+0000","last_peered":"2024-05-10T14:07:37.745533+0000","last_clean":"2024-05-10T14:07:37.745533+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:37.745533+0000","last_undegraded":"2024-05-10T14:07:37.745533+0000","last_fullsized":"2024-05-10T14:07:37.745533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.745330+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:29.621889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.580021+0000","last_change":"2024-05-10T14:07:53.580159+0000","last_active":"2024-05-10T14:07:53.580021+0000","last_peered":"2024-05-10T14:07:53.580021+0000","last_clean":"2024-05-10T14:07:53.580021+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:53.580021+0000","last_undegraded":"2024-05-10T14:07:53.580021+0000","last_fullsized":"2024-05-10T14:07:53.580021+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.579756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.579756+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.579756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:55:11.132034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.050086+0000","last_change":"2024-05-10T14:07:45.050191+0000","last_active":"2024-05-10T14:07:45.050086+0000","last_peered":"2024-05-10T14:07:45.050086+0000","last_clean":"2024-05-10T14:07:45.050086+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:45.050086+0000","last_undegraded":"2024-05-10T14:07:45.050086+0000","last_fullsized":"2024-05-10T14:07:45.050086+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.049852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.049852+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.049852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:56.783544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.260202+0000","last_change":"2024-05-10T14:07:36.260256+0000","last_active":"2024-05-10T14:07:36.260202+0000","last_peered":"2024-05-10T14:07:36.260202+0000","last_clean":"2024-05-10T14:07:36.260202+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:36.260202+0000","last_undegraded":"2024-05-10T14:07:36.260202+0000","last_fullsized":"2024-05-10T14:07:36.260202+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.259997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:03.749329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"151'31","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.656642+0000","last_change":"2024-05-10T14:07:35.656737+0000","last_active":"2024-05-10T14:07:35.656642+0000","last_peered":"2024-05-10T14:07:35.656642+0000","last_clean":"2024-05-10T14:07:35.656642+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:35.656642+0000","last_undegraded":"2024-05-10T14:07:35.656642+0000","last_fullsized":"2024-05-10T14:07:35.656642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'31","last_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_deep_scrub":"151'31","last_deep_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.656449+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.334700+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.453831+0000","last_change":"2024-05-10T14:07:48.453894+0000","last_active":"2024-05-10T14:07:48.453831+0000","last_peered":"2024-05-10T14:07:48.453831+0000","last_clean":"2024-05-10T14:07:48.453831+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:48.453831+0000","last_undegraded":"2024-05-10T14:07:48.453831+0000","last_fullsized":"2024-05-10T14:07:48.453831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.453557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.453557+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.453557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:20:16.859380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.692534+0000","last_change":"2024-05-10T14:07:34.692594+0000","last_active":"2024-05-10T14:07:34.692534+0000","last_peered":"2024-05-10T14:07:34.692534+0000","last_clean":"2024-05-10T14:07:34.692534+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:34.692534+0000","last_undegraded":"2024-05-10T14:07:34.692534+0000","last_fullsized":"2024-05-10T14:07:34.692534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.692340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:57.318053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"151'2","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.684764+0000","last_change":"2024-05-10T14:07:29.684838+0000","last_active":"2024-05-10T14:07:29.684764+0000","last_peered":"2024-05-10T14:07:29.684764+0000","last_clean":"2024-05-10T14:07:29.684764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:29.684764+0000","last_undegraded":"2024-05-10T14:07:29.684764+0000","last_fullsized":"2024-05-10T14:07:29.684764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.684552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:27.463030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.060152+0000","last_change":"2024-05-10T14:07:47.060262+0000","last_active":"2024-05-10T14:07:47.060152+0000","last_peered":"2024-05-10T14:07:47.060152+0000","last_clean":"2024-05-10T14:07:47.060152+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:47.060152+0000","last_undegraded":"2024-05-10T14:07:47.060152+0000","last_fullsized":"2024-05-10T14:07:47.060152+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.059876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.059876+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.059876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:55.496465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.008143+0000","last_change":"2024-05-10T14:07:27.008196+0000","last_active":"2024-05-10T14:07:27.008143+0000","last_peered":"2024-05-10T14:07:27.008143+0000","last_clean":"2024-05-10T14:07:27.008143+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:27.008143+0000","last_undegraded":"2024-05-10T14:07:27.008143+0000","last_fullsized":"2024-05-10T14:07:27.008143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.007961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:57.782722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"151'17","reported_seq":321,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:08:01.672054+0000","last_change":"2024-05-10T14:08:01.672145+0000","last_active":"2024-05-10T14:08:01.672054+0000","last_peered":"2024-05-10T14:08:01.672054+0000","last_clean":"2024-05-10T14:08:01.672054+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:08:01.672054+0000","last_undegraded":"2024-05-10T14:08:01.672054+0000","last_fullsized":"2024-05-10T14:08:01.672054+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:08:01.671825+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:08:01.671825+0000","last_clean_scrub_stamp":"2024-05-10T14:08:01.671825+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:46:48.003798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.697086+0000","last_change":"2024-05-10T14:07:43.697151+0000","last_active":"2024-05-10T14:07:43.697086+0000","last_peered":"2024-05-10T14:07:43.697086+0000","last_clean":"2024-05-10T14:07:43.697086+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:43.697086+0000","last_undegraded":"2024-05-10T14:07:43.697086+0000","last_fullsized":"2024-05-10T14:07:43.697086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.696865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.696865+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.696865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:44.553934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.304635+0000","last_change":"2024-05-10T14:07:31.304690+0000","last_active":"2024-05-10T14:07:31.304635+0000","last_peered":"2024-05-10T14:07:31.304635+0000","last_clean":"2024-05-10T14:07:31.304635+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:31.304635+0000","last_undegraded":"2024-05-10T14:07:31.304635+0000","last_fullsized":"2024-05-10T14:07:31.304635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.304411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:20.601035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.412919+0000","last_change":"2024-05-10T14:07:39.412982+0000","last_active":"2024-05-10T14:07:39.412919+0000","last_peered":"2024-05-10T14:07:39.412919+0000","last_clean":"2024-05-10T14:07:39.412919+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:39.412919+0000","last_undegraded":"2024-05-10T14:07:39.412919+0000","last_fullsized":"2024-05-10T14:07:39.412919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.412716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:18.236570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.088750+0000","last_change":"2024-05-10T14:07:51.088806+0000","last_active":"2024-05-10T14:07:51.088750+0000","last_peered":"2024-05-10T14:07:51.088750+0000","last_clean":"2024-05-10T14:07:51.088750+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:51.088750+0000","last_undegraded":"2024-05-10T14:07:51.088750+0000","last_fullsized":"2024-05-10T14:07:51.088750+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.088500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.088500+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.088500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:52:43.952432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.976781+0000","last_change":"2024-05-10T14:07:24.976835+0000","last_active":"2024-05-10T14:07:24.976781+0000","last_peered":"2024-05-10T14:07:24.976781+0000","last_clean":"2024-05-10T14:07:24.976781+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:24.976781+0000","last_undegraded":"2024-05-10T14:07:24.976781+0000","last_fullsized":"2024-05-10T14:07:24.976781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.976605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:44.117604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"151'26","reported_seq":75,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.125769+0000","last_change":"2024-05-10T14:07:52.125939+0000","last_active":"2024-05-10T14:07:52.125769+0000","last_peered":"2024-05-10T14:07:52.125769+0000","last_clean":"2024-05-10T14:07:52.125769+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:52.125769+0000","last_undegraded":"2024-05-10T14:07:52.125769+0000","last_fullsized":"2024-05-10T14:07:52.125769+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'26","last_scrub_stamp":"2024-05-10T14:07:52.125551+0000","last_deep_scrub":"151'26","last_deep_scrub_stamp":"2024-05-10T14:07:52.125551+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.125551+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:35.582929+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.893802+0000","last_change":"2024-05-10T14:07:31.893901+0000","last_active":"2024-05-10T14:07:31.893802+0000","last_peered":"2024-05-10T14:07:31.893802+0000","last_clean":"2024-05-10T14:07:31.893802+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:31.893802+0000","last_undegraded":"2024-05-10T14:07:31.893802+0000","last_fullsized":"2024-05-10T14:07:31.893802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.893557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:57.455457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.769929+0000","last_change":"2024-05-10T14:07:51.769987+0000","last_active":"2024-05-10T14:07:51.769929+0000","last_peered":"2024-05-10T14:07:51.769929+0000","last_clean":"2024-05-10T14:07:51.769929+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:51.769929+0000","last_undegraded":"2024-05-10T14:07:51.769929+0000","last_fullsized":"2024-05-10T14:07:51.769929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.769737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.769737+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.769737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:55.865801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.877121+0000","last_change":"2024-05-10T14:07:38.877175+0000","last_active":"2024-05-10T14:07:38.877121+0000","last_peered":"2024-05-10T14:07:38.877121+0000","last_clean":"2024-05-10T14:07:38.877121+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:38.877121+0000","last_undegraded":"2024-05-10T14:07:38.877121+0000","last_fullsized":"2024-05-10T14:07:38.877121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.876927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:05.018313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.608350+0000","last_change":"2024-05-10T14:07:50.608405+0000","last_active":"2024-05-10T14:07:50.608350+0000","last_peered":"2024-05-10T14:07:50.608350+0000","last_clean":"2024-05-10T14:07:50.608350+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:50.608350+0000","last_undegraded":"2024-05-10T14:07:50.608350+0000","last_fullsized":"2024-05-10T14:07:50.608350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.608118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.608118+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.608118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:01.972747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.916316+0000","last_change":"2024-05-10T14:07:34.916435+0000","last_active":"2024-05-10T14:07:34.916316+0000","last_peered":"2024-05-10T14:07:34.916316+0000","last_clean":"2024-05-10T14:07:34.916316+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:34.916316+0000","last_undegraded":"2024-05-10T14:07:34.916316+0000","last_fullsized":"2024-05-10T14:07:34.916316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.916072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:12.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"151'25","reported_seq":338,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.954958+0000","last_change":"2024-05-10T14:07:57.955067+0000","last_active":"2024-05-10T14:07:57.954958+0000","last_peered":"2024-05-10T14:07:57.954958+0000","last_clean":"2024-05-10T14:07:57.954958+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:57.954958+0000","last_undegraded":"2024-05-10T14:07:57.954958+0000","last_fullsized":"2024-05-10T14:07:57.954958+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:57.954750+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:57.954750+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.954750+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:00.369633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.933155+0000","last_change":"2024-05-10T14:07:39.933209+0000","last_active":"2024-05-10T14:07:39.933155+0000","last_peered":"2024-05-10T14:07:39.933155+0000","last_clean":"2024-05-10T14:07:39.933155+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:39.933155+0000","last_undegraded":"2024-05-10T14:07:39.933155+0000","last_fullsized":"2024-05-10T14:07:39.933155+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.932969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:54.182620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.342562+0000","last_change":"2024-05-10T14:07:26.342755+0000","last_active":"2024-05-10T14:07:26.342562+0000","last_peered":"2024-05-10T14:07:26.342562+0000","last_clean":"2024-05-10T14:07:26.342562+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:26.342562+0000","last_undegraded":"2024-05-10T14:07:26.342562+0000","last_fullsized":"2024-05-10T14:07:26.342562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.342326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:08.559071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"151'2","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.846904+0000","last_change":"2024-05-10T14:07:48.846975+0000","last_active":"2024-05-10T14:07:48.846904+0000","last_peered":"2024-05-10T14:07:48.846904+0000","last_clean":"2024-05-10T14:07:48.846904+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:48.846904+0000","last_undegraded":"2024-05-10T14:07:48.846904+0000","last_fullsized":"2024-05-10T14:07:48.846904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:48.846708+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:48.846708+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.846708+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:13.364260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.610935+0000","last_change":"2024-05-10T14:07:50.611052+0000","last_active":"2024-05-10T14:07:50.610935+0000","last_peered":"2024-05-10T14:07:50.610935+0000","last_clean":"2024-05-10T14:07:50.610935+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:50.610935+0000","last_undegraded":"2024-05-10T14:07:50.610935+0000","last_fullsized":"2024-05-10T14:07:50.610935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.610701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.610701+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.610701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:21.912735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.974047+0000","last_change":"2024-05-10T14:07:40.974106+0000","last_active":"2024-05-10T14:07:40.974047+0000","last_peered":"2024-05-10T14:07:40.974047+0000","last_clean":"2024-05-10T14:07:40.974047+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:40.974047+0000","last_undegraded":"2024-05-10T14:07:40.974047+0000","last_fullsized":"2024-05-10T14:07:40.974047+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.973826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:38.752303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"151'19","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.645048+0000","last_change":"2024-05-10T14:07:37.645212+0000","last_active":"2024-05-10T14:07:37.645048+0000","last_peered":"2024-05-10T14:07:37.645048+0000","last_clean":"2024-05-10T14:07:37.645048+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:37.645048+0000","last_undegraded":"2024-05-10T14:07:37.645048+0000","last_fullsized":"2024-05-10T14:07:37.645048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.644835+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:01.315245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.919490+0000","last_change":"2024-05-10T14:07:35.919556+0000","last_active":"2024-05-10T14:07:35.919490+0000","last_peered":"2024-05-10T14:07:35.919490+0000","last_clean":"2024-05-10T14:07:35.919490+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:35.919490+0000","last_undegraded":"2024-05-10T14:07:35.919490+0000","last_fullsized":"2024-05-10T14:07:35.919490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.919293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:00.436845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.706055+0000","last_change":"2024-05-10T14:07:24.706107+0000","last_active":"2024-05-10T14:07:24.706055+0000","last_peered":"2024-05-10T14:07:24.706055+0000","last_clean":"2024-05-10T14:07:24.706055+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:24.706055+0000","last_undegraded":"2024-05-10T14:07:24.706055+0000","last_fullsized":"2024-05-10T14:07:24.706055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.705845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:02.650652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.664306+0000","last_change":"2024-05-10T14:07:40.664371+0000","last_active":"2024-05-10T14:07:40.664306+0000","last_peered":"2024-05-10T14:07:40.664306+0000","last_clean":"2024-05-10T14:07:40.664306+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:40.664306+0000","last_undegraded":"2024-05-10T14:07:40.664306+0000","last_fullsized":"2024-05-10T14:07:40.664306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.664108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:18.608914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.338530+0000","last_change":"2024-05-10T14:07:34.338590+0000","last_active":"2024-05-10T14:07:34.338530+0000","last_peered":"2024-05-10T14:07:34.338530+0000","last_clean":"2024-05-10T14:07:34.338530+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:34.338530+0000","last_undegraded":"2024-05-10T14:07:34.338530+0000","last_fullsized":"2024-05-10T14:07:34.338530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.338336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:32.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.317337+0000","last_change":"2024-05-10T14:07:25.317396+0000","last_active":"2024-05-10T14:07:25.317337+0000","last_peered":"2024-05-10T14:07:25.317337+0000","last_clean":"2024-05-10T14:07:25.317337+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:25.317337+0000","last_undegraded":"2024-05-10T14:07:25.317337+0000","last_fullsized":"2024-05-10T14:07:25.317337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.317133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:28.900454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"151'25","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.946829+0000","last_change":"2024-05-10T14:07:21.946892+0000","last_active":"2024-05-10T14:07:21.946829+0000","last_peered":"2024-05-10T14:07:21.946829+0000","last_clean":"2024-05-10T14:07:21.946829+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:21.946829+0000","last_undegraded":"2024-05-10T14:07:21.946829+0000","last_fullsized":"2024-05-10T14:07:21.946829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.946746+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:50.542836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"151'20","reported_seq":308,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.930093+0000","last_change":"2024-05-10T14:07:35.930173+0000","last_active":"2024-05-10T14:07:35.930093+0000","last_peered":"2024-05-10T14:07:35.930093+0000","last_clean":"2024-05-10T14:07:35.930093+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:35.930093+0000","last_undegraded":"2024-05-10T14:07:35.930093+0000","last_fullsized":"2024-05-10T14:07:35.930093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.929856+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:54.849062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.354694+0000","last_change":"2024-05-10T14:07:28.354817+0000","last_active":"2024-05-10T14:07:28.354694+0000","last_peered":"2024-05-10T14:07:28.354694+0000","last_clean":"2024-05-10T14:07:28.354694+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:28.354694+0000","last_undegraded":"2024-05-10T14:07:28.354694+0000","last_fullsized":"2024-05-10T14:07:28.354694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.354451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:03.998380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.831409+0000","last_change":"2024-05-10T14:07:47.831465+0000","last_active":"2024-05-10T14:07:47.831409+0000","last_peered":"2024-05-10T14:07:47.831409+0000","last_clean":"2024-05-10T14:07:47.831409+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:47.831409+0000","last_undegraded":"2024-05-10T14:07:47.831409+0000","last_fullsized":"2024-05-10T14:07:47.831409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.831207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.831207+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.831207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:15.320539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.672334+0000","last_change":"2024-05-10T14:07:43.672390+0000","last_active":"2024-05-10T14:07:43.672334+0000","last_peered":"2024-05-10T14:07:43.672334+0000","last_clean":"2024-05-10T14:07:43.672334+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:43.672334+0000","last_undegraded":"2024-05-10T14:07:43.672334+0000","last_fullsized":"2024-05-10T14:07:43.672334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.672144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.672144+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.672144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:38.902633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"151'6","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.567781+0000","last_change":"2024-05-10T14:07:39.567863+0000","last_active":"2024-05-10T14:07:39.567781+0000","last_peered":"2024-05-10T14:07:39.567781+0000","last_clean":"2024-05-10T14:07:39.567781+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:39.567781+0000","last_undegraded":"2024-05-10T14:07:39.567781+0000","last_fullsized":"2024-05-10T14:07:39.567781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'6","last_scrub_stamp":"2024-05-10T14:07:39.567574+0000","last_deep_scrub":"151'6","last_deep_scrub_stamp":"2024-05-10T14:07:39.567574+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.567574+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:16.910729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"151'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.722747+0000","last_change":"2024-05-10T14:07:33.722826+0000","last_active":"2024-05-10T14:07:33.722747+0000","last_peered":"2024-05-10T14:07:33.722747+0000","last_clean":"2024-05-10T14:07:33.722747+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:33.722747+0000","last_undegraded":"2024-05-10T14:07:33.722747+0000","last_fullsized":"2024-05-10T14:07:33.722747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.722526+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:19.592401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.335820+0000","last_change":"2024-05-10T14:07:27.335885+0000","last_active":"2024-05-10T14:07:27.335820+0000","last_peered":"2024-05-10T14:07:27.335820+0000","last_clean":"2024-05-10T14:07:27.335820+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:27.335820+0000","last_undegraded":"2024-05-10T14:07:27.335820+0000","last_fullsized":"2024-05-10T14:07:27.335820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.335623+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:05.493216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.934152+0000","last_change":"2024-05-10T14:07:53.934210+0000","last_active":"2024-05-10T14:07:53.934152+0000","last_peered":"2024-05-10T14:07:53.934152+0000","last_clean":"2024-05-10T14:07:53.934152+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:53.934152+0000","last_undegraded":"2024-05-10T14:07:53.934152+0000","last_fullsized":"2024-05-10T14:07:53.934152+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.933945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.933945+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.933945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:45.810505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.450250+0000","last_change":"2024-05-10T14:07:35.450375+0000","last_active":"2024-05-10T14:07:35.450250+0000","last_peered":"2024-05-10T14:07:35.450250+0000","last_clean":"2024-05-10T14:07:35.450250+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:35.450250+0000","last_undegraded":"2024-05-10T14:07:35.450250+0000","last_fullsized":"2024-05-10T14:07:35.450250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.450011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:37:23.168333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.564984+0000","last_change":"2024-05-10T14:07:51.565036+0000","last_active":"2024-05-10T14:07:51.564984+0000","last_peered":"2024-05-10T14:07:51.564984+0000","last_clean":"2024-05-10T14:07:51.564984+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:51.564984+0000","last_undegraded":"2024-05-10T14:07:51.564984+0000","last_fullsized":"2024-05-10T14:07:51.564984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.564801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.564801+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.564801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:28:25.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.810817+0000","last_change":"2024-05-10T14:07:56.810879+0000","last_active":"2024-05-10T14:07:56.810817+0000","last_peered":"2024-05-10T14:07:56.810817+0000","last_clean":"2024-05-10T14:07:56.810817+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:56.810817+0000","last_undegraded":"2024-05-10T14:07:56.810817+0000","last_fullsized":"2024-05-10T14:07:56.810817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.810597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.810597+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.810597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:51:08.544290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"151'28","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.661172+0000","last_change":"2024-05-10T14:07:31.661259+0000","last_active":"2024-05-10T14:07:31.661172+0000","last_peered":"2024-05-10T14:07:31.661172+0000","last_clean":"2024-05-10T14:07:31.661172+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:31.661172+0000","last_undegraded":"2024-05-10T14:07:31.661172+0000","last_fullsized":"2024-05-10T14:07:31.661172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'28","last_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_deep_scrub":"151'28","last_deep_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.660968+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:32.223591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.354327+0000","last_change":"2024-05-10T14:07:29.354383+0000","last_active":"2024-05-10T14:07:29.354327+0000","last_peered":"2024-05-10T14:07:29.354327+0000","last_clean":"2024-05-10T14:07:29.354327+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:29.354327+0000","last_undegraded":"2024-05-10T14:07:29.354327+0000","last_fullsized":"2024-05-10T14:07:29.354327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.354128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.564422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.426156+0000","last_change":"2024-05-10T14:07:46.426212+0000","last_active":"2024-05-10T14:07:46.426156+0000","last_peered":"2024-05-10T14:07:46.426156+0000","last_clean":"2024-05-10T14:07:46.426156+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:46.426156+0000","last_undegraded":"2024-05-10T14:07:46.426156+0000","last_fullsized":"2024-05-10T14:07:46.426156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.425956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.425956+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.425956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:49.430953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.420075+0000","last_change":"2024-05-10T14:07:40.420215+0000","last_active":"2024-05-10T14:07:40.420075+0000","last_peered":"2024-05-10T14:07:40.420075+0000","last_clean":"2024-05-10T14:07:40.420075+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:40.420075+0000","last_undegraded":"2024-05-10T14:07:40.420075+0000","last_fullsized":"2024-05-10T14:07:40.420075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.419823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:00.289279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"151'74","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.098604+0000","last_change":"2024-05-10T14:07:54.098685+0000","last_active":"2024-05-10T14:07:54.098604+0000","last_peered":"2024-05-10T14:07:54.098604+0000","last_clean":"2024-05-10T14:07:54.098604+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:54.098604+0000","last_undegraded":"2024-05-10T14:07:54.098604+0000","last_fullsized":"2024-05-10T14:07:54.098604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'74","last_scrub_stamp":"2024-05-10T14:07:54.098410+0000","last_deep_scrub":"151'74","last_deep_scrub_stamp":"2024-05-10T14:07:54.098410+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.098410+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.973583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.604769+0000","last_change":"2024-05-10T14:07:51.604827+0000","last_active":"2024-05-10T14:07:51.604769+0000","last_peered":"2024-05-10T14:07:51.604769+0000","last_clean":"2024-05-10T14:07:51.604769+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:51.604769+0000","last_undegraded":"2024-05-10T14:07:51.604769+0000","last_fullsized":"2024-05-10T14:07:51.604769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.604565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.604565+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.604565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:35.651242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.674040+0000","last_change":"2024-05-10T14:07:26.674096+0000","last_active":"2024-05-10T14:07:26.674040+0000","last_peered":"2024-05-10T14:07:26.674040+0000","last_clean":"2024-05-10T14:07:26.674040+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:26.674040+0000","last_undegraded":"2024-05-10T14:07:26.674040+0000","last_fullsized":"2024-05-10T14:07:26.674040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.673817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:48.085080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.218116+0000","last_change":"2024-05-10T14:07:28.218179+0000","last_active":"2024-05-10T14:07:28.218116+0000","last_peered":"2024-05-10T14:07:28.218116+0000","last_clean":"2024-05-10T14:07:28.218116+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:28.218116+0000","last_undegraded":"2024-05-10T14:07:28.218116+0000","last_fullsized":"2024-05-10T14:07:28.218116+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.217921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:27.755571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"151'30","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.662228+0000","last_change":"2024-05-10T14:07:49.662313+0000","last_active":"2024-05-10T14:07:49.662228+0000","last_peered":"2024-05-10T14:07:49.662228+0000","last_clean":"2024-05-10T14:07:49.662228+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:49.662228+0000","last_undegraded":"2024-05-10T14:07:49.662228+0000","last_fullsized":"2024-05-10T14:07:49.662228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'30","last_scrub_stamp":"2024-05-10T14:07:49.662034+0000","last_deep_scrub":"151'30","last_deep_scrub_stamp":"2024-05-10T14:07:49.662034+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.662034+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:16.733530+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.866738+0000","last_change":"2024-05-10T14:07:54.866796+0000","last_active":"2024-05-10T14:07:54.866738+0000","last_peered":"2024-05-10T14:07:54.866738+0000","last_clean":"2024-05-10T14:07:54.866738+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:54.866738+0000","last_undegraded":"2024-05-10T14:07:54.866738+0000","last_fullsized":"2024-05-10T14:07:54.866738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.866534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.866534+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.866534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:33.332561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.446434+0000","last_change":"2024-05-10T14:07:42.446496+0000","last_active":"2024-05-10T14:07:42.446434+0000","last_peered":"2024-05-10T14:07:42.446434+0000","last_clean":"2024-05-10T14:07:42.446434+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:42.446434+0000","last_undegraded":"2024-05-10T14:07:42.446434+0000","last_fullsized":"2024-05-10T14:07:42.446434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.446233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.446233+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.446233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:11.398647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.907821+0000","last_change":"2024-05-10T14:07:40.907880+0000","last_active":"2024-05-10T14:07:40.907821+0000","last_peered":"2024-05-10T14:07:40.907821+0000","last_clean":"2024-05-10T14:07:40.907821+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:40.907821+0000","last_undegraded":"2024-05-10T14:07:40.907821+0000","last_fullsized":"2024-05-10T14:07:40.907821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.907593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:32.784152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.156415+0000","last_change":"2024-05-10T14:07:39.156550+0000","last_active":"2024-05-10T14:07:39.156415+0000","last_peered":"2024-05-10T14:07:39.156415+0000","last_clean":"2024-05-10T14:07:39.156415+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:39.156415+0000","last_undegraded":"2024-05-10T14:07:39.156415+0000","last_fullsized":"2024-05-10T14:07:39.156415+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.156160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:25.026036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.835015+0000","last_change":"2024-05-10T14:07:45.835072+0000","last_active":"2024-05-10T14:07:45.835015+0000","last_peered":"2024-05-10T14:07:45.835015+0000","last_clean":"2024-05-10T14:07:45.835015+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:45.835015+0000","last_undegraded":"2024-05-10T14:07:45.835015+0000","last_fullsized":"2024-05-10T14:07:45.835015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.834813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.834813+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.834813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:42.398082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.649059+0000","last_change":"2024-05-10T14:07:33.649117+0000","last_active":"2024-05-10T14:07:33.649059+0000","last_peered":"2024-05-10T14:07:33.649059+0000","last_clean":"2024-05-10T14:07:33.649059+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:33.649059+0000","last_undegraded":"2024-05-10T14:07:33.649059+0000","last_fullsized":"2024-05-10T14:07:33.649059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.648851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:47:20.655715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"151'54","reported_seq":376,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.482240+0000","last_change":"2024-05-10T14:07:45.482402+0000","last_active":"2024-05-10T14:07:45.482240+0000","last_peered":"2024-05-10T14:07:45.482240+0000","last_clean":"2024-05-10T14:07:45.482240+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:45.482240+0000","last_undegraded":"2024-05-10T14:07:45.482240+0000","last_fullsized":"2024-05-10T14:07:45.482240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'54","last_scrub_stamp":"2024-05-10T14:07:45.482000+0000","last_deep_scrub":"151'54","last_deep_scrub_stamp":"2024-05-10T14:07:45.482000+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.482000+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:00.526626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.168061+0000","last_change":"2024-05-10T14:07:27.168120+0000","last_active":"2024-05-10T14:07:27.168061+0000","last_peered":"2024-05-10T14:07:27.168061+0000","last_clean":"2024-05-10T14:07:27.168061+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:27.168061+0000","last_undegraded":"2024-05-10T14:07:27.168061+0000","last_fullsized":"2024-05-10T14:07:27.168061+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.167863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:12.671261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.413966+0000","last_change":"2024-05-10T14:07:30.414024+0000","last_active":"2024-05-10T14:07:30.413966+0000","last_peered":"2024-05-10T14:07:30.413966+0000","last_clean":"2024-05-10T14:07:30.413966+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:30.413966+0000","last_undegraded":"2024-05-10T14:07:30.413966+0000","last_fullsized":"2024-05-10T14:07:30.413966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.413749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:18:42.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.461634+0000","last_change":"2024-05-10T14:07:47.461809+0000","last_active":"2024-05-10T14:07:47.461634+0000","last_peered":"2024-05-10T14:07:47.461634+0000","last_clean":"2024-05-10T14:07:47.461634+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:47.461634+0000","last_undegraded":"2024-05-10T14:07:47.461634+0000","last_fullsized":"2024-05-10T14:07:47.461634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:47.461398+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:47.461398+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.461398+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:39:47.174687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.995125+0000","last_change":"2024-05-10T14:07:27.995186+0000","last_active":"2024-05-10T14:07:27.995125+0000","last_peered":"2024-05-10T14:07:27.995125+0000","last_clean":"2024-05-10T14:07:27.995125+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:27.995125+0000","last_undegraded":"2024-05-10T14:07:27.995125+0000","last_fullsized":"2024-05-10T14:07:27.995125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.994931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:05:35.411465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.403230+0000","last_change":"2024-05-10T14:07:40.403346+0000","last_active":"2024-05-10T14:07:40.403230+0000","last_peered":"2024-05-10T14:07:40.403230+0000","last_clean":"2024-05-10T14:07:40.403230+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:40.403230+0000","last_undegraded":"2024-05-10T14:07:40.403230+0000","last_fullsized":"2024-05-10T14:07:40.403230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.402962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.402962+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.402962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:07:35.504448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"151'2","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.891325+0000","last_change":"2024-05-10T14:07:36.891389+0000","last_active":"2024-05-10T14:07:36.891325+0000","last_peered":"2024-05-10T14:07:36.891325+0000","last_clean":"2024-05-10T14:07:36.891325+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:36.891325+0000","last_undegraded":"2024-05-10T14:07:36.891325+0000","last_fullsized":"2024-05-10T14:07:36.891325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.891129+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.075459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"151'24","reported_seq":71,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.040863+0000","last_change":"2024-05-10T14:07:57.041028+0000","last_active":"2024-05-10T14:07:57.040863+0000","last_peered":"2024-05-10T14:07:57.040863+0000","last_clean":"2024-05-10T14:07:57.040863+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:57.040863+0000","last_undegraded":"2024-05-10T14:07:57.040863+0000","last_fullsized":"2024-05-10T14:07:57.040863+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'24","last_scrub_stamp":"2024-05-10T14:07:57.040642+0000","last_deep_scrub":"151'24","last_deep_scrub_stamp":"2024-05-10T14:07:57.040642+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.040642+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:51.016015+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.909436+0000","last_change":"2024-05-10T14:07:27.909553+0000","last_active":"2024-05-10T14:07:27.909436+0000","last_peered":"2024-05-10T14:07:27.909436+0000","last_clean":"2024-05-10T14:07:27.909436+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:27.909436+0000","last_undegraded":"2024-05-10T14:07:27.909436+0000","last_fullsized":"2024-05-10T14:07:27.909436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.909206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:05.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.604312+0000","last_change":"2024-05-10T14:07:55.604372+0000","last_active":"2024-05-10T14:07:55.604312+0000","last_peered":"2024-05-10T14:07:55.604312+0000","last_clean":"2024-05-10T14:07:55.604312+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:55.604312+0000","last_undegraded":"2024-05-10T14:07:55.604312+0000","last_fullsized":"2024-05-10T14:07:55.604312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.604105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.604105+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.604105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:09:15.825419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.424760+0000","last_change":"2024-05-10T14:07:31.424818+0000","last_active":"2024-05-10T14:07:31.424760+0000","last_peered":"2024-05-10T14:07:31.424760+0000","last_clean":"2024-05-10T14:07:31.424760+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:31.424760+0000","last_undegraded":"2024-05-10T14:07:31.424760+0000","last_fullsized":"2024-05-10T14:07:31.424760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.424555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:12:55.196458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.612806+0000","last_change":"2024-05-10T14:07:44.612871+0000","last_active":"2024-05-10T14:07:44.612806+0000","last_peered":"2024-05-10T14:07:44.612806+0000","last_clean":"2024-05-10T14:07:44.612806+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:44.612806+0000","last_undegraded":"2024-05-10T14:07:44.612806+0000","last_fullsized":"2024-05-10T14:07:44.612806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.612591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.612591+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.612591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:38.766288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.716065+0000","last_change":"2024-05-10T14:07:44.716127+0000","last_active":"2024-05-10T14:07:44.716065+0000","last_peered":"2024-05-10T14:07:44.716065+0000","last_clean":"2024-05-10T14:07:44.716065+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:44.716065+0000","last_undegraded":"2024-05-10T14:07:44.716065+0000","last_fullsized":"2024-05-10T14:07:44.716065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.715846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.715846+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.715846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:44.950944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.918113+0000","last_change":"2024-05-10T14:07:34.918174+0000","last_active":"2024-05-10T14:07:34.918113+0000","last_peered":"2024-05-10T14:07:34.918113+0000","last_clean":"2024-05-10T14:07:34.918113+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:34.918113+0000","last_undegraded":"2024-05-10T14:07:34.918113+0000","last_fullsized":"2024-05-10T14:07:34.918113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.917893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:03:28.952902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"151'18","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.749529+0000","last_change":"2024-05-10T14:07:34.749626+0000","last_active":"2024-05-10T14:07:34.749529+0000","last_peered":"2024-05-10T14:07:34.749529+0000","last_clean":"2024-05-10T14:07:34.749529+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:34.749529+0000","last_undegraded":"2024-05-10T14:07:34.749529+0000","last_fullsized":"2024-05-10T14:07:34.749529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.749322+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:55.388007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.396463+0000","last_change":"2024-05-10T14:07:25.396519+0000","last_active":"2024-05-10T14:07:25.396463+0000","last_peered":"2024-05-10T14:07:25.396463+0000","last_clean":"2024-05-10T14:07:25.396463+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:25.396463+0000","last_undegraded":"2024-05-10T14:07:25.396463+0000","last_fullsized":"2024-05-10T14:07:25.396463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.396270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:23.766029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.635601+0000","last_change":"2024-05-10T14:07:30.635716+0000","last_active":"2024-05-10T14:07:30.635601+0000","last_peered":"2024-05-10T14:07:30.635601+0000","last_clean":"2024-05-10T14:07:30.635601+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:30.635601+0000","last_undegraded":"2024-05-10T14:07:30.635601+0000","last_fullsized":"2024-05-10T14:07:30.635601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.635307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:42.884913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.390727+0000","last_change":"2024-05-10T14:07:32.390796+0000","last_active":"2024-05-10T14:07:32.390727+0000","last_peered":"2024-05-10T14:07:32.390727+0000","last_clean":"2024-05-10T14:07:32.390727+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:32.390727+0000","last_undegraded":"2024-05-10T14:07:32.390727+0000","last_fullsized":"2024-05-10T14:07:32.390727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.390537+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:21.254841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.952262+0000","last_change":"2024-05-10T14:07:23.952311+0000","last_active":"2024-05-10T14:07:23.952262+0000","last_peered":"2024-05-10T14:07:23.952262+0000","last_clean":"2024-05-10T14:07:23.952262+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:23.952262+0000","last_undegraded":"2024-05-10T14:07:23.952262+0000","last_fullsized":"2024-05-10T14:07:23.952262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.952085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:24.299018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.430535+0000","last_change":"2024-05-10T14:07:37.430591+0000","last_active":"2024-05-10T14:07:37.430535+0000","last_peered":"2024-05-10T14:07:37.430535+0000","last_clean":"2024-05-10T14:07:37.430535+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:37.430535+0000","last_undegraded":"2024-05-10T14:07:37.430535+0000","last_fullsized":"2024-05-10T14:07:37.430535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.430330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:37.578731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.942595+0000","last_change":"2024-05-10T14:07:32.942666+0000","last_active":"2024-05-10T14:07:32.942595+0000","last_peered":"2024-05-10T14:07:32.942595+0000","last_clean":"2024-05-10T14:07:32.942595+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:32.942595+0000","last_undegraded":"2024-05-10T14:07:32.942595+0000","last_fullsized":"2024-05-10T14:07:32.942595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.942400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:28.015020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"151'32","reported_seq":314,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.948039+0000","last_change":"2024-05-10T14:07:28.948130+0000","last_active":"2024-05-10T14:07:28.948039+0000","last_peered":"2024-05-10T14:07:28.948039+0000","last_clean":"2024-05-10T14:07:28.948039+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:28.948039+0000","last_undegraded":"2024-05-10T14:07:28.948039+0000","last_fullsized":"2024-05-10T14:07:28.948039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'32","last_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_deep_scrub":"151'32","last_deep_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.947807+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:52.580613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.681099+0000","last_change":"2024-05-10T14:07:26.681166+0000","last_active":"2024-05-10T14:07:26.681099+0000","last_peered":"2024-05-10T14:07:26.681099+0000","last_clean":"2024-05-10T14:07:26.681099+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:26.681099+0000","last_undegraded":"2024-05-10T14:07:26.681099+0000","last_fullsized":"2024-05-10T14:07:26.681099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.680864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:07.789929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.956250+0000","last_change":"2024-05-10T14:07:26.956314+0000","last_active":"2024-05-10T14:07:26.956250+0000","last_peered":"2024-05-10T14:07:26.956250+0000","last_clean":"2024-05-10T14:07:26.956250+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:26.956250+0000","last_undegraded":"2024-05-10T14:07:26.956250+0000","last_fullsized":"2024-05-10T14:07:26.956250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.956051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:53.568515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"151'4","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.975303+0000","last_change":"2024-05-10T14:07:23.975376+0000","last_active":"2024-05-10T14:07:23.975303+0000","last_peered":"2024-05-10T14:07:23.975303+0000","last_clean":"2024-05-10T14:07:23.975303+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:23.975303+0000","last_undegraded":"2024-05-10T14:07:23.975303+0000","last_fullsized":"2024-05-10T14:07:23.975303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.975105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:18:57.825330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.373385+0000","last_change":"2024-05-10T14:07:39.373441+0000","last_active":"2024-05-10T14:07:39.373385+0000","last_peered":"2024-05-10T14:07:39.373385+0000","last_clean":"2024-05-10T14:07:39.373385+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:39.373385+0000","last_undegraded":"2024-05-10T14:07:39.373385+0000","last_fullsized":"2024-05-10T14:07:39.373385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.373188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:55.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.232810+0000","last_change":"2024-05-10T14:07:29.232870+0000","last_active":"2024-05-10T14:07:29.232810+0000","last_peered":"2024-05-10T14:07:29.232810+0000","last_clean":"2024-05-10T14:07:29.232810+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:29.232810+0000","last_undegraded":"2024-05-10T14:07:29.232810+0000","last_fullsized":"2024-05-10T14:07:29.232810+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.232614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:07.177421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.339054+0000","last_change":"2024-05-10T14:07:32.339109+0000","last_active":"2024-05-10T14:07:32.339054+0000","last_peered":"2024-05-10T14:07:32.339054+0000","last_clean":"2024-05-10T14:07:32.339054+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:32.339054+0000","last_undegraded":"2024-05-10T14:07:32.339054+0000","last_fullsized":"2024-05-10T14:07:32.339054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.338865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:10.266519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"151'21","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.310389+0000","last_change":"2024-05-10T14:07:21.310444+0000","last_active":"2024-05-10T14:07:21.310389+0000","last_peered":"2024-05-10T14:07:21.310389+0000","last_clean":"2024-05-10T14:07:21.310389+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:21.310389+0000","last_undegraded":"2024-05-10T14:07:21.310389+0000","last_fullsized":"2024-05-10T14:07:21.310389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'21","last_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_deep_scrub":"151'21","last_deep_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.310310+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:56.364173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"151'20","reported_seq":206,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.590707+0000","last_change":"2024-05-10T14:07:23.590832+0000","last_active":"2024-05-10T14:07:23.590707+0000","last_peered":"2024-05-10T14:07:23.590707+0000","last_clean":"2024-05-10T14:07:23.590707+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:23.590707+0000","last_undegraded":"2024-05-10T14:07:23.590707+0000","last_fullsized":"2024-05-10T14:07:23.590707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.590396+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:50.454066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.722849+0000","last_change":"2024-05-10T14:07:30.723007+0000","last_active":"2024-05-10T14:07:30.722849+0000","last_peered":"2024-05-10T14:07:30.722849+0000","last_clean":"2024-05-10T14:07:30.722849+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:30.722849+0000","last_undegraded":"2024-05-10T14:07:30.722849+0000","last_fullsized":"2024-05-10T14:07:30.722849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.722607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:19.082543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.623607+0000","last_change":"2024-05-10T14:07:58.623662+0000","last_active":"2024-05-10T14:07:58.623607+0000","last_peered":"2024-05-10T14:07:58.623607+0000","last_clean":"2024-05-10T14:07:58.623607+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:58.623607+0000","last_undegraded":"2024-05-10T14:07:58.623607+0000","last_fullsized":"2024-05-10T14:07:58.623607+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:58.623403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:58.623403+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.623403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:27.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:59.625878+0000","last_change":"2024-05-10T14:07:59.625946+0000","last_active":"2024-05-10T14:07:59.625878+0000","last_peered":"2024-05-10T14:07:59.625878+0000","last_clean":"2024-05-10T14:07:59.625878+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:59.625878+0000","last_undegraded":"2024-05-10T14:07:59.625878+0000","last_fullsized":"2024-05-10T14:07:59.625878+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:59.625650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:59.625650+0000","last_clean_scrub_stamp":"2024-05-10T14:07:59.625650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:55.176487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.463795+0000","last_change":"2024-05-10T14:07:36.463852+0000","last_active":"2024-05-10T14:07:36.463795+0000","last_peered":"2024-05-10T14:07:36.463795+0000","last_clean":"2024-05-10T14:07:36.463795+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:36.463795+0000","last_undegraded":"2024-05-10T14:07:36.463795+0000","last_fullsized":"2024-05-10T14:07:36.463795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.463569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:35:46.544710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.676778+0000","last_change":"2024-05-10T14:07:31.676842+0000","last_active":"2024-05-10T14:07:31.676778+0000","last_peered":"2024-05-10T14:07:31.676778+0000","last_clean":"2024-05-10T14:07:31.676778+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:31.676778+0000","last_undegraded":"2024-05-10T14:07:31.676778+0000","last_fullsized":"2024-05-10T14:07:31.676778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.676593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:51.546049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.657801+0000","last_change":"2024-05-10T14:07:41.657876+0000","last_active":"2024-05-10T14:07:41.657801+0000","last_peered":"2024-05-10T14:07:41.657801+0000","last_clean":"2024-05-10T14:07:41.657801+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:41.657801+0000","last_undegraded":"2024-05-10T14:07:41.657801+0000","last_fullsized":"2024-05-10T14:07:41.657801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.657598+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:05.290405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"151'18","reported_seq":298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.728833+0000","last_change":"2024-05-10T14:07:39.728896+0000","last_active":"2024-05-10T14:07:39.728833+0000","last_peered":"2024-05-10T14:07:39.728833+0000","last_clean":"2024-05-10T14:07:39.728833+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:39.728833+0000","last_undegraded":"2024-05-10T14:07:39.728833+0000","last_fullsized":"2024-05-10T14:07:39.728833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.728603+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:16.910850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.855396+0000","last_change":"2024-05-10T14:07:37.855543+0000","last_active":"2024-05-10T14:07:37.855396+0000","last_peered":"2024-05-10T14:07:37.855396+0000","last_clean":"2024-05-10T14:07:37.855396+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:37.855396+0000","last_undegraded":"2024-05-10T14:07:37.855396+0000","last_fullsized":"2024-05-10T14:07:37.855396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.855137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:59.761135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.859817+0000","last_change":"2024-05-10T14:07:55.859933+0000","last_active":"2024-05-10T14:07:55.859817+0000","last_peered":"2024-05-10T14:07:55.859817+0000","last_clean":"2024-05-10T14:07:55.859817+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:55.859817+0000","last_undegraded":"2024-05-10T14:07:55.859817+0000","last_fullsized":"2024-05-10T14:07:55.859817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.859516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.859516+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.859516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:33.041762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.905970+0000","last_change":"2024-05-10T14:07:43.906031+0000","last_active":"2024-05-10T14:07:43.905970+0000","last_peered":"2024-05-10T14:07:43.905970+0000","last_clean":"2024-05-10T14:07:43.905970+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:43.905970+0000","last_undegraded":"2024-05-10T14:07:43.905970+0000","last_fullsized":"2024-05-10T14:07:43.905970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.905765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.905765+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.905765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:55.639457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.474917+0000","last_change":"2024-05-10T14:07:46.474969+0000","last_active":"2024-05-10T14:07:46.474917+0000","last_peered":"2024-05-10T14:07:46.474917+0000","last_clean":"2024-05-10T14:07:46.474917+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:46.474917+0000","last_undegraded":"2024-05-10T14:07:46.474917+0000","last_fullsized":"2024-05-10T14:07:46.474917+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.474718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.474718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.474718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:19.374029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.737833+0000","last_change":"2024-05-10T14:07:40.737891+0000","last_active":"2024-05-10T14:07:40.737833+0000","last_peered":"2024-05-10T14:07:40.737833+0000","last_clean":"2024-05-10T14:07:40.737833+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:40.737833+0000","last_undegraded":"2024-05-10T14:07:40.737833+0000","last_fullsized":"2024-05-10T14:07:40.737833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.737577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:52.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"151'36","reported_seq":89,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.147958+0000","last_change":"2024-05-10T14:07:25.148049+0000","last_active":"2024-05-10T14:07:25.147958+0000","last_peered":"2024-05-10T14:07:25.147958+0000","last_clean":"2024-05-10T14:07:25.147958+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:25.147958+0000","last_undegraded":"2024-05-10T14:07:25.147958+0000","last_fullsized":"2024-05-10T14:07:25.147958+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'36","last_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_deep_scrub":"151'36","last_deep_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.147756+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:46.500080+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.648209+0000","last_change":"2024-05-10T14:07:45.648267+0000","last_active":"2024-05-10T14:07:45.648209+0000","last_peered":"2024-05-10T14:07:45.648209+0000","last_clean":"2024-05-10T14:07:45.648209+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:45.648209+0000","last_undegraded":"2024-05-10T14:07:45.648209+0000","last_fullsized":"2024-05-10T14:07:45.648209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.648006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.648006+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.648006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:24.606180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"151'4","reported_seq":209,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.544085+0000","last_change":"2024-05-10T14:07:58.544153+0000","last_active":"2024-05-10T14:07:58.544085+0000","last_peered":"2024-05-10T14:07:58.544085+0000","last_clean":"2024-05-10T14:07:58.544085+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:58.544085+0000","last_undegraded":"2024-05-10T14:07:58.544085+0000","last_fullsized":"2024-05-10T14:07:58.544085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2024-05-10T14:07:58.543846+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2024-05-10T14:07:58.543846+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.543846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:20.543892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"151'2","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.003773+0000","last_change":"2024-05-10T14:07:21.003800+0000","last_active":"2024-05-10T14:07:21.003773+0000","last_peered":"2024-05-10T14:07:21.003773+0000","last_clean":"2024-05-10T14:07:21.003773+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:21.003773+0000","last_undegraded":"2024-05-10T14:07:21.003773+0000","last_fullsized":"2024-05-10T14:07:21.003773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.003698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:46:49.956112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.709014+0000","last_change":"2024-05-10T14:07:34.709073+0000","last_active":"2024-05-10T14:07:34.709014+0000","last_peered":"2024-05-10T14:07:34.709014+0000","last_clean":"2024-05-10T14:07:34.709014+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:34.709014+0000","last_undegraded":"2024-05-10T14:07:34.709014+0000","last_fullsized":"2024-05-10T14:07:34.709014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.708821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:40.383875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"151'2","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.780949+0000","last_change":"2024-05-10T14:07:58.781021+0000","last_active":"2024-05-10T14:07:58.780949+0000","last_peered":"2024-05-10T14:07:58.780949+0000","last_clean":"2024-05-10T14:07:58.780949+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:58.780949+0000","last_undegraded":"2024-05-10T14:07:58.780949+0000","last_fullsized":"2024-05-10T14:07:58.780949+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:58.780721+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:58.780721+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.780721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:55.343990+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.503900+0000","last_change":"2024-05-10T14:07:44.503958+0000","last_active":"2024-05-10T14:07:44.503900+0000","last_peered":"2024-05-10T14:07:44.503900+0000","last_clean":"2024-05-10T14:07:44.503900+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:44.503900+0000","last_undegraded":"2024-05-10T14:07:44.503900+0000","last_fullsized":"2024-05-10T14:07:44.503900+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.503708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.503708+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.503708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:31.221399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.761588+0000","last_change":"2024-05-10T14:07:32.761686+0000","last_active":"2024-05-10T14:07:32.761588+0000","last_peered":"2024-05-10T14:07:32.761588+0000","last_clean":"2024-05-10T14:07:32.761588+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:32.761588+0000","last_undegraded":"2024-05-10T14:07:32.761588+0000","last_fullsized":"2024-05-10T14:07:32.761588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.761359+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:57.278911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.759852+0000","last_change":"2024-05-10T14:07:41.759908+0000","last_active":"2024-05-10T14:07:41.759852+0000","last_peered":"2024-05-10T14:07:41.759852+0000","last_clean":"2024-05-10T14:07:41.759852+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:41.759852+0000","last_undegraded":"2024-05-10T14:07:41.759852+0000","last_fullsized":"2024-05-10T14:07:41.759852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.759647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:02:59.566098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.711976+0000","last_change":"2024-05-10T14:07:29.712034+0000","last_active":"2024-05-10T14:07:29.711976+0000","last_peered":"2024-05-10T14:07:29.711976+0000","last_clean":"2024-05-10T14:07:29.711976+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:29.711976+0000","last_undegraded":"2024-05-10T14:07:29.711976+0000","last_fullsized":"2024-05-10T14:07:29.711976+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.711766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:24.784387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.370765+0000","last_change":"2024-05-10T14:07:27.370827+0000","last_active":"2024-05-10T14:07:27.370765+0000","last_peered":"2024-05-10T14:07:27.370765+0000","last_clean":"2024-05-10T14:07:27.370765+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:27.370765+0000","last_undegraded":"2024-05-10T14:07:27.370765+0000","last_fullsized":"2024-05-10T14:07:27.370765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.370559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:25:48.876276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.239346+0000","last_change":"2024-05-10T14:07:37.239403+0000","last_active":"2024-05-10T14:07:37.239346+0000","last_peered":"2024-05-10T14:07:37.239346+0000","last_clean":"2024-05-10T14:07:37.239346+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:37.239346+0000","last_undegraded":"2024-05-10T14:07:37.239346+0000","last_fullsized":"2024-05-10T14:07:37.239346+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.239146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:31:00.357237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.761971+0000","last_change":"2024-05-10T14:07:36.762032+0000","last_active":"2024-05-10T14:07:36.761971+0000","last_peered":"2024-05-10T14:07:36.761971+0000","last_clean":"2024-05-10T14:07:36.761971+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:36.761971+0000","last_undegraded":"2024-05-10T14:07:36.761971+0000","last_fullsized":"2024-05-10T14:07:36.761971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.761768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:02.440802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"151'8","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.014343+0000","last_change":"2024-05-10T14:07:23.014483+0000","last_active":"2024-05-10T14:07:23.014343+0000","last_peered":"2024-05-10T14:07:23.014343+0000","last_clean":"2024-05-10T14:07:23.014343+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:23.014343+0000","last_undegraded":"2024-05-10T14:07:23.014343+0000","last_fullsized":"2024-05-10T14:07:23.014343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'8","last_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_deep_scrub":"151'8","last_deep_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.014096+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:20.042315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.229385+0000","last_change":"2024-05-10T14:07:34.229441+0000","last_active":"2024-05-10T14:07:34.229385+0000","last_peered":"2024-05-10T14:07:34.229385+0000","last_clean":"2024-05-10T14:07:34.229385+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:34.229385+0000","last_undegraded":"2024-05-10T14:07:34.229385+0000","last_fullsized":"2024-05-10T14:07:34.229385+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.229194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:59.791093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.943622+0000","last_change":"2024-05-10T14:07:41.943622+0000","last_active":"2024-05-10T14:07:41.943622+0000","last_peered":"2024-05-10T14:07:41.943622+0000","last_clean":"2024-05-10T14:07:41.943622+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:41.943622+0000","last_undegraded":"2024-05-10T14:07:41.943622+0000","last_fullsized":"2024-05-10T14:07:41.943622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.943342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:15.631218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"151'2","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.946117+0000","last_change":"2024-05-10T14:07:41.946117+0000","last_active":"2024-05-10T14:07:41.946117+0000","last_peered":"2024-05-10T14:07:41.946117+0000","last_clean":"2024-05-10T14:07:41.946117+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:41.946117+0000","last_undegraded":"2024-05-10T14:07:41.946117+0000","last_fullsized":"2024-05-10T14:07:41.946117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.945868+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:20.769723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.612477+0000","last_change":"2024-05-10T14:07:25.612530+0000","last_active":"2024-05-10T14:07:25.612477+0000","last_peered":"2024-05-10T14:07:25.612477+0000","last_clean":"2024-05-10T14:07:25.612477+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:25.612477+0000","last_undegraded":"2024-05-10T14:07:25.612477+0000","last_fullsized":"2024-05-10T14:07:25.612477+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.612253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:06:34.416095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.255540+0000","last_change":"2024-05-10T14:07:33.255596+0000","last_active":"2024-05-10T14:07:33.255540+0000","last_peered":"2024-05-10T14:07:33.255540+0000","last_clean":"2024-05-10T14:07:33.255540+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:33.255540+0000","last_undegraded":"2024-05-10T14:07:33.255540+0000","last_fullsized":"2024-05-10T14:07:33.255540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.255282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:33.490379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.770161+0000","last_change":"2024-05-10T14:07:31.770235+0000","last_active":"2024-05-10T14:07:31.770161+0000","last_peered":"2024-05-10T14:07:31.770161+0000","last_clean":"2024-05-10T14:07:31.770161+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:31.770161+0000","last_undegraded":"2024-05-10T14:07:31.770161+0000","last_fullsized":"2024-05-10T14:07:31.770161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.769945+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:55:59.259278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.438072+0000","last_change":"2024-05-10T14:07:24.438125+0000","last_active":"2024-05-10T14:07:24.438072+0000","last_peered":"2024-05-10T14:07:24.438072+0000","last_clean":"2024-05-10T14:07:24.438072+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:24.438072+0000","last_undegraded":"2024-05-10T14:07:24.438072+0000","last_fullsized":"2024-05-10T14:07:24.438072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.437873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:18:07.966698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.581497+0000","last_change":"2024-05-10T14:07:52.581561+0000","last_active":"2024-05-10T14:07:52.581497+0000","last_peered":"2024-05-10T14:07:52.581497+0000","last_clean":"2024-05-10T14:07:52.581497+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:52.581497+0000","last_undegraded":"2024-05-10T14:07:52.581497+0000","last_fullsized":"2024-05-10T14:07:52.581497+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.581292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.581292+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.581292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:29.194725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.721110+0000","last_change":"2024-05-10T14:07:23.721130+0000","last_active":"2024-05-10T14:07:23.721110+0000","last_peered":"2024-05-10T14:07:23.721110+0000","last_clean":"2024-05-10T14:07:23.721110+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:23.721110+0000","last_undegraded":"2024-05-10T14:07:23.721110+0000","last_fullsized":"2024-05-10T14:07:23.721110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.721037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:50.333501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.020307+0000","last_change":"2024-05-10T14:07:22.020307+0000","last_active":"2024-05-10T14:07:22.020307+0000","last_peered":"2024-05-10T14:07:22.020307+0000","last_clean":"2024-05-10T14:07:22.020307+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:22.020307+0000","last_undegraded":"2024-05-10T14:07:22.020307+0000","last_fullsized":"2024-05-10T14:07:22.020307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.020202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:27.695256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.323006+0000","last_change":"2024-05-10T14:07:28.323062+0000","last_active":"2024-05-10T14:07:28.323006+0000","last_peered":"2024-05-10T14:07:28.323006+0000","last_clean":"2024-05-10T14:07:28.323006+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:28.323006+0000","last_undegraded":"2024-05-10T14:07:28.323006+0000","last_fullsized":"2024-05-10T14:07:28.323006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.322800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:38.102769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"151'17","reported_seq":66,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.095947+0000","last_change":"2024-05-10T14:07:53.096026+0000","last_active":"2024-05-10T14:07:53.095947+0000","last_peered":"2024-05-10T14:07:53.095947+0000","last_clean":"2024-05-10T14:07:53.095947+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:53.095947+0000","last_undegraded":"2024-05-10T14:07:53.095947+0000","last_fullsized":"2024-05-10T14:07:53.095947+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:53.095759+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:53.095759+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.095759+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:42.966597+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.837489+0000","last_change":"2024-05-10T14:07:53.837548+0000","last_active":"2024-05-10T14:07:53.837489+0000","last_peered":"2024-05-10T14:07:53.837489+0000","last_clean":"2024-05-10T14:07:53.837489+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:53.837489+0000","last_undegraded":"2024-05-10T14:07:53.837489+0000","last_fullsized":"2024-05-10T14:07:53.837489+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.837235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.837235+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.837235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:24.391423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.443950+0000","last_change":"2024-05-10T14:07:43.444010+0000","last_active":"2024-05-10T14:07:43.443950+0000","last_peered":"2024-05-10T14:07:43.443950+0000","last_clean":"2024-05-10T14:07:43.443950+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:43.443950+0000","last_undegraded":"2024-05-10T14:07:43.443950+0000","last_fullsized":"2024-05-10T14:07:43.443950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.443742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.443742+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.443742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:49.118796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.619589+0000","last_change":"2024-05-10T14:07:49.619649+0000","last_active":"2024-05-10T14:07:49.619589+0000","last_peered":"2024-05-10T14:07:49.619589+0000","last_clean":"2024-05-10T14:07:49.619589+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:49.619589+0000","last_undegraded":"2024-05-10T14:07:49.619589+0000","last_fullsized":"2024-05-10T14:07:49.619589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.619373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.619373+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.619373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:36.208841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.913606+0000","last_change":"2024-05-10T14:07:56.913683+0000","last_active":"2024-05-10T14:07:56.913606+0000","last_peered":"2024-05-10T14:07:56.913606+0000","last_clean":"2024-05-10T14:07:56.913606+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:56.913606+0000","last_undegraded":"2024-05-10T14:07:56.913606+0000","last_fullsized":"2024-05-10T14:07:56.913606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.913399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.913399+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.913399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:39.085556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"151'25","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.461773+0000","last_change":"2024-05-10T14:07:49.461864+0000","last_active":"2024-05-10T14:07:49.461773+0000","last_peered":"2024-05-10T14:07:49.461773+0000","last_clean":"2024-05-10T14:07:49.461773+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:49.461773+0000","last_undegraded":"2024-05-10T14:07:49.461773+0000","last_fullsized":"2024-05-10T14:07:49.461773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:49.461543+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:49.461543+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.461543+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:31:03.370077+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.569731+0000","last_change":"2024-05-10T14:07:40.569790+0000","last_active":"2024-05-10T14:07:40.569731+0000","last_peered":"2024-05-10T14:07:40.569731+0000","last_clean":"2024-05-10T14:07:40.569731+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:40.569731+0000","last_undegraded":"2024-05-10T14:07:40.569731+0000","last_fullsized":"2024-05-10T14:07:40.569731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.569536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.569536+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.569536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:00.743525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.690736+0000","last_change":"2024-05-10T14:07:27.690800+0000","last_active":"2024-05-10T14:07:27.690736+0000","last_peered":"2024-05-10T14:07:27.690736+0000","last_clean":"2024-05-10T14:07:27.690736+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:27.690736+0000","last_undegraded":"2024-05-10T14:07:27.690736+0000","last_fullsized":"2024-05-10T14:07:27.690736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.690535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:27.925633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":278,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.904800+0000","last_change":"2024-05-10T14:07:55.904860+0000","last_active":"2024-05-10T14:07:55.904800+0000","last_peered":"2024-05-10T14:07:55.904800+0000","last_clean":"2024-05-10T14:07:55.904800+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:55.904800+0000","last_undegraded":"2024-05-10T14:07:55.904800+0000","last_fullsized":"2024-05-10T14:07:55.904800+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.904595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.904595+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.904595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:00.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.436569+0000","last_change":"2024-05-10T14:07:42.436630+0000","last_active":"2024-05-10T14:07:42.436569+0000","last_peered":"2024-05-10T14:07:42.436569+0000","last_clean":"2024-05-10T14:07:42.436569+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:42.436569+0000","last_undegraded":"2024-05-10T14:07:42.436569+0000","last_fullsized":"2024-05-10T14:07:42.436569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.436354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.436354+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.436354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:27:36.961316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.337729+0000","last_change":"2024-05-10T14:07:30.337788+0000","last_active":"2024-05-10T14:07:30.337729+0000","last_peered":"2024-05-10T14:07:30.337729+0000","last_clean":"2024-05-10T14:07:30.337729+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:30.337729+0000","last_undegraded":"2024-05-10T14:07:30.337729+0000","last_fullsized":"2024-05-10T14:07:30.337729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.337517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:27.544286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"151'25","reported_seq":74,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.120169+0000","last_change":"2024-05-10T14:07:24.120261+0000","last_active":"2024-05-10T14:07:24.120169+0000","last_peered":"2024-05-10T14:07:24.120169+0000","last_clean":"2024-05-10T14:07:24.120169+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:24.120169+0000","last_undegraded":"2024-05-10T14:07:24.120169+0000","last_fullsized":"2024-05-10T14:07:24.120169+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.119966+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:19.091644+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.313330+0000","last_change":"2024-05-10T14:07:22.313330+0000","last_active":"2024-05-10T14:07:22.313330+0000","last_peered":"2024-05-10T14:07:22.313330+0000","last_clean":"2024-05-10T14:07:22.313330+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:22.313330+0000","last_undegraded":"2024-05-10T14:07:22.313330+0000","last_fullsized":"2024-05-10T14:07:22.313330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.313230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.934216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.536735+0000","last_change":"2024-05-10T14:07:48.536790+0000","last_active":"2024-05-10T14:07:48.536735+0000","last_peered":"2024-05-10T14:07:48.536735+0000","last_clean":"2024-05-10T14:07:48.536735+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:48.536735+0000","last_undegraded":"2024-05-10T14:07:48.536735+0000","last_fullsized":"2024-05-10T14:07:48.536735+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.536510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.536510+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.536510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:48.074159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.633501+0000","last_change":"2024-05-10T14:07:46.633555+0000","last_active":"2024-05-10T14:07:46.633501+0000","last_peered":"2024-05-10T14:07:46.633501+0000","last_clean":"2024-05-10T14:07:46.633501+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:46.633501+0000","last_undegraded":"2024-05-10T14:07:46.633501+0000","last_fullsized":"2024-05-10T14:07:46.633501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.633304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.633304+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.633304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:41:14.598165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.911515+0000","last_change":"2024-05-10T14:07:37.911659+0000","last_active":"2024-05-10T14:07:37.911515+0000","last_peered":"2024-05-10T14:07:37.911515+0000","last_clean":"2024-05-10T14:07:37.911515+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:37.911515+0000","last_undegraded":"2024-05-10T14:07:37.911515+0000","last_fullsized":"2024-05-10T14:07:37.911515+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.911259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:19.020325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.685681+0000","last_change":"2024-05-10T14:07:33.685681+0000","last_active":"2024-05-10T14:07:33.685681+0000","last_peered":"2024-05-10T14:07:33.685681+0000","last_clean":"2024-05-10T14:07:33.685681+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:33.685681+0000","last_undegraded":"2024-05-10T14:07:33.685681+0000","last_fullsized":"2024-05-10T14:07:33.685681+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.685427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:49.104767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.748857+0000","last_change":"2024-05-10T14:07:35.748938+0000","last_active":"2024-05-10T14:07:35.748857+0000","last_peered":"2024-05-10T14:07:35.748857+0000","last_clean":"2024-05-10T14:07:35.748857+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:35.748857+0000","last_undegraded":"2024-05-10T14:07:35.748857+0000","last_fullsized":"2024-05-10T14:07:35.748857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.748668+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:43.158045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.357623+0000","last_change":"2024-05-10T14:07:24.357756+0000","last_active":"2024-05-10T14:07:24.357623+0000","last_peered":"2024-05-10T14:07:24.357623+0000","last_clean":"2024-05-10T14:07:24.357623+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:24.357623+0000","last_undegraded":"2024-05-10T14:07:24.357623+0000","last_fullsized":"2024-05-10T14:07:24.357623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.357369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:06.230763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.594199+0000","last_change":"2024-05-10T14:07:55.594350+0000","last_active":"2024-05-10T14:07:55.594199+0000","last_peered":"2024-05-10T14:07:55.594199+0000","last_clean":"2024-05-10T14:07:55.594199+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:55.594199+0000","last_undegraded":"2024-05-10T14:07:55.594199+0000","last_fullsized":"2024-05-10T14:07:55.594199+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.593978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.593978+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.593978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:54:28.225035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.905735+0000","last_change":"2024-05-10T14:07:33.905800+0000","last_active":"2024-05-10T14:07:33.905735+0000","last_peered":"2024-05-10T14:07:33.905735+0000","last_clean":"2024-05-10T14:07:33.905735+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:33.905735+0000","last_undegraded":"2024-05-10T14:07:33.905735+0000","last_fullsized":"2024-05-10T14:07:33.905735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.905512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:23.202136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.823161+0000","last_change":"2024-05-10T14:07:46.823298+0000","last_active":"2024-05-10T14:07:46.823161+0000","last_peered":"2024-05-10T14:07:46.823161+0000","last_clean":"2024-05-10T14:07:46.823161+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:46.823161+0000","last_undegraded":"2024-05-10T14:07:46.823161+0000","last_fullsized":"2024-05-10T14:07:46.823161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.822924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.822924+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.822924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:47.679993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.308065+0000","last_change":"2024-05-10T14:07:23.308065+0000","last_active":"2024-05-10T14:07:23.308065+0000","last_peered":"2024-05-10T14:07:23.308065+0000","last_clean":"2024-05-10T14:07:23.308065+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:23.308065+0000","last_undegraded":"2024-05-10T14:07:23.308065+0000","last_fullsized":"2024-05-10T14:07:23.308065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.307952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:33.043262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.908990+0000","last_change":"2024-05-10T14:07:51.909094+0000","last_active":"2024-05-10T14:07:51.908990+0000","last_peered":"2024-05-10T14:07:51.908990+0000","last_clean":"2024-05-10T14:07:51.908990+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:51.908990+0000","last_undegraded":"2024-05-10T14:07:51.908990+0000","last_fullsized":"2024-05-10T14:07:51.908990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:51.908765+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:51.908765+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.908765+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.318141+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"151'18","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.357918+0000","last_change":"2024-05-10T14:07:26.357993+0000","last_active":"2024-05-10T14:07:26.357918+0000","last_peered":"2024-05-10T14:07:26.357918+0000","last_clean":"2024-05-10T14:07:26.357918+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:26.357918+0000","last_undegraded":"2024-05-10T14:07:26.357918+0000","last_fullsized":"2024-05-10T14:07:26.357918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.357703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:44.029068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.155101+0000","last_change":"2024-05-10T14:07:26.155160+0000","last_active":"2024-05-10T14:07:26.155101+0000","last_peered":"2024-05-10T14:07:26.155101+0000","last_clean":"2024-05-10T14:07:26.155101+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:26.155101+0000","last_undegraded":"2024-05-10T14:07:26.155101+0000","last_fullsized":"2024-05-10T14:07:26.155101+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.154906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:47:49.825316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.804267+0000","last_change":"2024-05-10T14:07:46.804325+0000","last_active":"2024-05-10T14:07:46.804267+0000","last_peered":"2024-05-10T14:07:46.804267+0000","last_clean":"2024-05-10T14:07:46.804267+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:46.804267+0000","last_undegraded":"2024-05-10T14:07:46.804267+0000","last_fullsized":"2024-05-10T14:07:46.804267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.804069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.804069+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.804069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:35.164005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.590161+0000","last_change":"2024-05-10T14:07:28.590216+0000","last_active":"2024-05-10T14:07:28.590161+0000","last_peered":"2024-05-10T14:07:28.590161+0000","last_clean":"2024-05-10T14:07:28.590161+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:28.590161+0000","last_undegraded":"2024-05-10T14:07:28.590161+0000","last_fullsized":"2024-05-10T14:07:28.590161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.589947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:04:13.568622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.053296+0000","last_change":"2024-05-10T14:07:44.053402+0000","last_active":"2024-05-10T14:07:44.053296+0000","last_peered":"2024-05-10T14:07:44.053296+0000","last_clean":"2024-05-10T14:07:44.053296+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:44.053296+0000","last_undegraded":"2024-05-10T14:07:44.053296+0000","last_fullsized":"2024-05-10T14:07:44.053296+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.053068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.053068+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.053068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:00.556250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"151'25","reported_seq":236,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.675524+0000","last_change":"2024-05-10T14:07:45.675691+0000","last_active":"2024-05-10T14:07:45.675524+0000","last_peered":"2024-05-10T14:07:45.675524+0000","last_clean":"2024-05-10T14:07:45.675524+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:45.675524+0000","last_undegraded":"2024-05-10T14:07:45.675524+0000","last_fullsized":"2024-05-10T14:07:45.675524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:45.675181+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:45.675181+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.675181+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:35.010311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.934930+0000","last_change":"2024-05-10T14:07:29.934930+0000","last_active":"2024-05-10T14:07:29.934930+0000","last_peered":"2024-05-10T14:07:29.934930+0000","last_clean":"2024-05-10T14:07:29.934930+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:29.934930+0000","last_undegraded":"2024-05-10T14:07:29.934930+0000","last_fullsized":"2024-05-10T14:07:29.934930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.934670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.345933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.071225+0000","last_change":"2024-05-10T14:07:50.071285+0000","last_active":"2024-05-10T14:07:50.071225+0000","last_peered":"2024-05-10T14:07:50.071225+0000","last_clean":"2024-05-10T14:07:50.071225+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:50.071225+0000","last_undegraded":"2024-05-10T14:07:50.071225+0000","last_fullsized":"2024-05-10T14:07:50.071225+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.071027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.071027+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.071027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:29.029200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.891505+0000","last_change":"2024-05-10T14:07:50.891569+0000","last_active":"2024-05-10T14:07:50.891505+0000","last_peered":"2024-05-10T14:07:50.891505+0000","last_clean":"2024-05-10T14:07:50.891505+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:50.891505+0000","last_undegraded":"2024-05-10T14:07:50.891505+0000","last_fullsized":"2024-05-10T14:07:50.891505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.891282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.891282+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.891282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:11.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.697852+0000","last_change":"2024-05-10T14:07:48.697912+0000","last_active":"2024-05-10T14:07:48.697852+0000","last_peered":"2024-05-10T14:07:48.697852+0000","last_clean":"2024-05-10T14:07:48.697852+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:48.697852+0000","last_undegraded":"2024-05-10T14:07:48.697852+0000","last_fullsized":"2024-05-10T14:07:48.697852+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.697663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.697663+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.697663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:22.871090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.580771+0000","last_change":"2024-05-10T14:07:27.580831+0000","last_active":"2024-05-10T14:07:27.580771+0000","last_peered":"2024-05-10T14:07:27.580771+0000","last_clean":"2024-05-10T14:07:27.580771+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:27.580771+0000","last_undegraded":"2024-05-10T14:07:27.580771+0000","last_fullsized":"2024-05-10T14:07:27.580771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.580569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:31.176260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"151'16","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.920255+0000","last_change":"2024-05-10T14:07:30.920335+0000","last_active":"2024-05-10T14:07:30.920255+0000","last_peered":"2024-05-10T14:07:30.920255+0000","last_clean":"2024-05-10T14:07:30.920255+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:30.920255+0000","last_undegraded":"2024-05-10T14:07:30.920255+0000","last_fullsized":"2024-05-10T14:07:30.920255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'16","last_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_deep_scrub":"151'16","last_deep_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.920046+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:31.155143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.491933+0000","last_change":"2024-05-10T14:07:47.492059+0000","last_active":"2024-05-10T14:07:47.491933+0000","last_peered":"2024-05-10T14:07:47.491933+0000","last_clean":"2024-05-10T14:07:47.491933+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:47.491933+0000","last_undegraded":"2024-05-10T14:07:47.491933+0000","last_fullsized":"2024-05-10T14:07:47.491933+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.491675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.491675+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.491675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:32.995073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.673929+0000","last_change":"2024-05-10T14:07:28.673929+0000","last_active":"2024-05-10T14:07:28.673929+0000","last_peered":"2024-05-10T14:07:28.673929+0000","last_clean":"2024-05-10T14:07:28.673929+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:28.673929+0000","last_undegraded":"2024-05-10T14:07:28.673929+0000","last_fullsized":"2024-05-10T14:07:28.673929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.673633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:54.235533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.619959+0000","last_change":"2024-05-10T14:07:54.620019+0000","last_active":"2024-05-10T14:07:54.619959+0000","last_peered":"2024-05-10T14:07:54.619959+0000","last_clean":"2024-05-10T14:07:54.619959+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:54.619959+0000","last_undegraded":"2024-05-10T14:07:54.619959+0000","last_fullsized":"2024-05-10T14:07:54.619959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.619722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.619722+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.619722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:19.666589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.636959+0000","last_change":"2024-05-10T14:07:53.637029+0000","last_active":"2024-05-10T14:07:53.636959+0000","last_peered":"2024-05-10T14:07:53.636959+0000","last_clean":"2024-05-10T14:07:53.636959+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:53.636959+0000","last_undegraded":"2024-05-10T14:07:53.636959+0000","last_fullsized":"2024-05-10T14:07:53.636959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:53.636766+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:53.636766+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.636766+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:24.532748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.676906+0000","last_change":"2024-05-10T14:07:35.676964+0000","last_active":"2024-05-10T14:07:35.676906+0000","last_peered":"2024-05-10T14:07:35.676906+0000","last_clean":"2024-05-10T14:07:35.676906+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:35.676906+0000","last_undegraded":"2024-05-10T14:07:35.676906+0000","last_fullsized":"2024-05-10T14:07:35.676906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.676718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:32.704938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"151'9","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.167893+0000","last_change":"2024-05-10T14:06:56.480397+0000","last_active":"2024-05-10T14:07:22.167893+0000","last_peered":"2024-05-10T14:07:22.167893+0000","last_clean":"2024-05-10T14:07:22.167893+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:22.167893+0000","last_undegraded":"2024-05-10T14:07:22.167893+0000","last_fullsized":"2024-05-10T14:07:22.167893+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:02:35.664094+0000","last_clean_scrub_stamp":"2024-05-10T14:02:35.664094+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.607383+0000","last_change":"2024-05-10T14:07:24.607383+0000","last_active":"2024-05-10T14:07:24.607383+0000","last_peered":"2024-05-10T14:07:24.607383+0000","last_clean":"2024-05-10T14:07:24.607383+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:24.607383+0000","last_undegraded":"2024-05-10T14:07:24.607383+0000","last_fullsized":"2024-05-10T14:07:24.607383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.607117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:43.526323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.096405+0000","last_change":"2024-05-10T14:07:41.096459+0000","last_active":"2024-05-10T14:07:41.096405+0000","last_peered":"2024-05-10T14:07:41.096405+0000","last_clean":"2024-05-10T14:07:41.096405+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:41.096405+0000","last_undegraded":"2024-05-10T14:07:41.096405+0000","last_fullsized":"2024-05-10T14:07:41.096405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.096206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:23.589611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.636395+0000","last_change":"2024-05-10T14:07:38.636490+0000","last_active":"2024-05-10T14:07:38.636395+0000","last_peered":"2024-05-10T14:07:38.636395+0000","last_clean":"2024-05-10T14:07:38.636395+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:38.636395+0000","last_undegraded":"2024-05-10T14:07:38.636395+0000","last_fullsized":"2024-05-10T14:07:38.636395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.636149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:24.139548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.968095+0000","last_change":"2024-05-10T14:07:25.968201+0000","last_active":"2024-05-10T14:07:25.968095+0000","last_peered":"2024-05-10T14:07:25.968095+0000","last_clean":"2024-05-10T14:07:25.968095+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:25.968095+0000","last_undegraded":"2024-05-10T14:07:25.968095+0000","last_fullsized":"2024-05-10T14:07:25.968095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.967836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:06.239366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"151'2","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.462243+0000","last_change":"2024-05-10T14:07:34.462313+0000","last_active":"2024-05-10T14:07:34.462243+0000","last_peered":"2024-05-10T14:07:34.462243+0000","last_clean":"2024-05-10T14:07:34.462243+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:34.462243+0000","last_undegraded":"2024-05-10T14:07:34.462243+0000","last_fullsized":"2024-05-10T14:07:34.462243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.462056+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:20.507444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"151'17","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.788450+0000","last_change":"2024-05-10T14:07:57.788535+0000","last_active":"2024-05-10T14:07:57.788450+0000","last_peered":"2024-05-10T14:07:57.788450+0000","last_clean":"2024-05-10T14:07:57.788450+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:57.788450+0000","last_undegraded":"2024-05-10T14:07:57.788450+0000","last_fullsized":"2024-05-10T14:07:57.788450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:57.788223+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:57.788223+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.788223+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:34.943950+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.895329+0000","last_change":"2024-05-10T14:07:33.895329+0000","last_active":"2024-05-10T14:07:33.895329+0000","last_peered":"2024-05-10T14:07:33.895329+0000","last_clean":"2024-05-10T14:07:33.895329+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:33.895329+0000","last_undegraded":"2024-05-10T14:07:33.895329+0000","last_fullsized":"2024-05-10T14:07:33.895329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.894965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:22.254901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.938387+0000","last_change":"2024-05-10T14:07:52.938446+0000","last_active":"2024-05-10T14:07:52.938387+0000","last_peered":"2024-05-10T14:07:52.938387+0000","last_clean":"2024-05-10T14:07:52.938387+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:52.938387+0000","last_undegraded":"2024-05-10T14:07:52.938387+0000","last_fullsized":"2024-05-10T14:07:52.938387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.938193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.938193+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.938193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:18.617227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"151'2","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.393384+0000","last_change":"2024-05-10T14:07:29.393455+0000","last_active":"2024-05-10T14:07:29.393384+0000","last_peered":"2024-05-10T14:07:29.393384+0000","last_clean":"2024-05-10T14:07:29.393384+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:29.393384+0000","last_undegraded":"2024-05-10T14:07:29.393384+0000","last_fullsized":"2024-05-10T14:07:29.393384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.393159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:00.930447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.340471+0000","last_change":"2024-05-10T14:07:36.340528+0000","last_active":"2024-05-10T14:07:36.340471+0000","last_peered":"2024-05-10T14:07:36.340471+0000","last_clean":"2024-05-10T14:07:36.340471+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:36.340471+0000","last_undegraded":"2024-05-10T14:07:36.340471+0000","last_fullsized":"2024-05-10T14:07:36.340471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.340267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:14.747404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.411067+0000","last_change":"2024-05-10T14:07:33.411126+0000","last_active":"2024-05-10T14:07:33.411067+0000","last_peered":"2024-05-10T14:07:33.411067+0000","last_clean":"2024-05-10T14:07:33.411067+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:33.411067+0000","last_undegraded":"2024-05-10T14:07:33.411067+0000","last_fullsized":"2024-05-10T14:07:33.411067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.410857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:50.448699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.015430+0000","last_change":"2024-05-10T14:07:26.015489+0000","last_active":"2024-05-10T14:07:26.015430+0000","last_peered":"2024-05-10T14:07:26.015430+0000","last_clean":"2024-05-10T14:07:26.015430+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:26.015430+0000","last_undegraded":"2024-05-10T14:07:26.015430+0000","last_fullsized":"2024-05-10T14:07:26.015430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.015233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:52.736449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.607194+0000","last_change":"2024-05-10T14:07:56.607255+0000","last_active":"2024-05-10T14:07:56.607194+0000","last_peered":"2024-05-10T14:07:56.607194+0000","last_clean":"2024-05-10T14:07:56.607194+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:56.607194+0000","last_undegraded":"2024-05-10T14:07:56.607194+0000","last_fullsized":"2024-05-10T14:07:56.607194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.606933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.606933+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.606933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:03.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.677347+0000","last_change":"2024-05-10T14:07:47.677408+0000","last_active":"2024-05-10T14:07:47.677347+0000","last_peered":"2024-05-10T14:07:47.677347+0000","last_clean":"2024-05-10T14:07:47.677347+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:47.677347+0000","last_undegraded":"2024-05-10T14:07:47.677347+0000","last_fullsized":"2024-05-10T14:07:47.677347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.677146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.677146+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.677146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:11.354851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.488503+0000","last_change":"2024-05-10T14:07:50.488565+0000","last_active":"2024-05-10T14:07:50.488503+0000","last_peered":"2024-05-10T14:07:50.488503+0000","last_clean":"2024-05-10T14:07:50.488503+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:50.488503+0000","last_undegraded":"2024-05-10T14:07:50.488503+0000","last_fullsized":"2024-05-10T14:07:50.488503+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.488286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.488286+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.488286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:28:30.610434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.974978+0000","last_change":"2024-05-10T14:07:24.975077+0000","last_active":"2024-05-10T14:07:24.974978+0000","last_peered":"2024-05-10T14:07:24.974978+0000","last_clean":"2024-05-10T14:07:24.974978+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:24.974978+0000","last_undegraded":"2024-05-10T14:07:24.974978+0000","last_fullsized":"2024-05-10T14:07:24.974978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.974724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:57.874035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.656082+0000","last_change":"2024-05-10T14:07:57.656139+0000","last_active":"2024-05-10T14:07:57.656082+0000","last_peered":"2024-05-10T14:07:57.656082+0000","last_clean":"2024-05-10T14:07:57.656082+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:57.656082+0000","last_undegraded":"2024-05-10T14:07:57.656082+0000","last_fullsized":"2024-05-10T14:07:57.656082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:57.655844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:57.655844+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.655844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:47.193985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.703198+0000","last_change":"2024-05-10T14:07:25.703260+0000","last_active":"2024-05-10T14:07:25.703198+0000","last_peered":"2024-05-10T14:07:25.703198+0000","last_clean":"2024-05-10T14:07:25.703198+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:25.703198+0000","last_undegraded":"2024-05-10T14:07:25.703198+0000","last_fullsized":"2024-05-10T14:07:25.703198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.703009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:49.335815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.654654+0000","last_change":"2024-05-10T14:07:28.654715+0000","last_active":"2024-05-10T14:07:28.654654+0000","last_peered":"2024-05-10T14:07:28.654654+0000","last_clean":"2024-05-10T14:07:28.654654+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:28.654654+0000","last_undegraded":"2024-05-10T14:07:28.654654+0000","last_fullsized":"2024-05-10T14:07:28.654654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.654459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:03.589053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.485915+0000","last_change":"2024-05-10T14:07:43.485974+0000","last_active":"2024-05-10T14:07:43.485915+0000","last_peered":"2024-05-10T14:07:43.485915+0000","last_clean":"2024-05-10T14:07:43.485915+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:43.485915+0000","last_undegraded":"2024-05-10T14:07:43.485915+0000","last_fullsized":"2024-05-10T14:07:43.485915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.485705+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:08:06.431514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.734567+0000","last_change":"2024-05-10T14:07:42.734627+0000","last_active":"2024-05-10T14:07:42.734567+0000","last_peered":"2024-05-10T14:07:42.734567+0000","last_clean":"2024-05-10T14:07:42.734567+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:42.734567+0000","last_undegraded":"2024-05-10T14:07:42.734567+0000","last_fullsized":"2024-05-10T14:07:42.734567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.734296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.734296+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.734296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:39.297565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.462413+0000","last_change":"2024-05-10T14:07:45.462474+0000","last_active":"2024-05-10T14:07:45.462413+0000","last_peered":"2024-05-10T14:07:45.462413+0000","last_clean":"2024-05-10T14:07:45.462413+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:45.462413+0000","last_undegraded":"2024-05-10T14:07:45.462413+0000","last_fullsized":"2024-05-10T14:07:45.462413+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.462199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.462199+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.462199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:19:19.312424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.388125+0000","last_change":"2024-05-10T14:07:37.388183+0000","last_active":"2024-05-10T14:07:37.388125+0000","last_peered":"2024-05-10T14:07:37.388125+0000","last_clean":"2024-05-10T14:07:37.388125+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:37.388125+0000","last_undegraded":"2024-05-10T14:07:37.388125+0000","last_fullsized":"2024-05-10T14:07:37.388125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.387927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:51.637579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.589033+0000","last_change":"2024-05-10T14:07:47.589087+0000","last_active":"2024-05-10T14:07:47.589033+0000","last_peered":"2024-05-10T14:07:47.589033+0000","last_clean":"2024-05-10T14:07:47.589033+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:47.589033+0000","last_undegraded":"2024-05-10T14:07:47.589033+0000","last_fullsized":"2024-05-10T14:07:47.589033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.588837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.588837+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.588837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:26.322625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.770029+0000","last_change":"2024-05-10T14:07:49.770085+0000","last_active":"2024-05-10T14:07:49.770029+0000","last_peered":"2024-05-10T14:07:49.770029+0000","last_clean":"2024-05-10T14:07:49.770029+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:49.770029+0000","last_undegraded":"2024-05-10T14:07:49.770029+0000","last_fullsized":"2024-05-10T14:07:49.770029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.769797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.769797+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.769797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:52:42.633729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.596591+0000","last_change":"2024-05-10T14:07:38.596644+0000","last_active":"2024-05-10T14:07:38.596591+0000","last_peered":"2024-05-10T14:07:38.596591+0000","last_clean":"2024-05-10T14:07:38.596591+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:38.596591+0000","last_undegraded":"2024-05-10T14:07:38.596591+0000","last_fullsized":"2024-05-10T14:07:38.596591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.596387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:03.750556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.873497+0000","last_change":"2024-05-10T14:07:49.873626+0000","last_active":"2024-05-10T14:07:49.873497+0000","last_peered":"2024-05-10T14:07:49.873497+0000","last_clean":"2024-05-10T14:07:49.873497+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:49.873497+0000","last_undegraded":"2024-05-10T14:07:49.873497+0000","last_fullsized":"2024-05-10T14:07:49.873497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.873164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.873164+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.873164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:35.743040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.590282+0000","last_change":"2024-05-10T14:07:48.590342+0000","last_active":"2024-05-10T14:07:48.590282+0000","last_peered":"2024-05-10T14:07:48.590282+0000","last_clean":"2024-05-10T14:07:48.590282+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:48.590282+0000","last_undegraded":"2024-05-10T14:07:48.590282+0000","last_fullsized":"2024-05-10T14:07:48.590282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.590060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.590060+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.590060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:53.465233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.946505+0000","last_change":"2024-05-10T14:07:32.946590+0000","last_active":"2024-05-10T14:07:32.946505+0000","last_peered":"2024-05-10T14:07:32.946505+0000","last_clean":"2024-05-10T14:07:32.946505+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:32.946505+0000","last_undegraded":"2024-05-10T14:07:32.946505+0000","last_fullsized":"2024-05-10T14:07:32.946505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.946291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:09.668951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"151'2","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.974887+0000","last_change":"2024-05-10T14:07:42.974954+0000","last_active":"2024-05-10T14:07:42.974887+0000","last_peered":"2024-05-10T14:07:42.974887+0000","last_clean":"2024-05-10T14:07:42.974887+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:42.974887+0000","last_undegraded":"2024-05-10T14:07:42.974887+0000","last_fullsized":"2024-05-10T14:07:42.974887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:42.974698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:42.974698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.974698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:02.844155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.685592+0000","last_change":"2024-05-10T14:07:42.685658+0000","last_active":"2024-05-10T14:07:42.685592+0000","last_peered":"2024-05-10T14:07:42.685592+0000","last_clean":"2024-05-10T14:07:42.685592+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:42.685592+0000","last_undegraded":"2024-05-10T14:07:42.685592+0000","last_fullsized":"2024-05-10T14:07:42.685592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.685357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.685357+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.685357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:46.179728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.816097+0000","last_change":"2024-05-10T14:07:52.816153+0000","last_active":"2024-05-10T14:07:52.816097+0000","last_peered":"2024-05-10T14:07:52.816097+0000","last_clean":"2024-05-10T14:07:52.816097+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:52.816097+0000","last_undegraded":"2024-05-10T14:07:52.816097+0000","last_fullsized":"2024-05-10T14:07:52.816097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.815877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.815877+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.815877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:35:50.096071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.091026+0000","last_change":"2024-05-10T14:07:43.091086+0000","last_active":"2024-05-10T14:07:43.091026+0000","last_peered":"2024-05-10T14:07:43.091026+0000","last_clean":"2024-05-10T14:07:43.091026+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:43.091026+0000","last_undegraded":"2024-05-10T14:07:43.091026+0000","last_fullsized":"2024-05-10T14:07:43.091026+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.090798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.090798+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.090798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:16.778674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.336946+0000","last_change":"2024-05-10T14:07:33.337101+0000","last_active":"2024-05-10T14:07:33.336946+0000","last_peered":"2024-05-10T14:07:33.336946+0000","last_clean":"2024-05-10T14:07:33.336946+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:33.336946+0000","last_undegraded":"2024-05-10T14:07:33.336946+0000","last_fullsized":"2024-05-10T14:07:33.336946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.336663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:52.255869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.896333+0000","last_change":"2024-05-10T14:07:36.896395+0000","last_active":"2024-05-10T14:07:36.896333+0000","last_peered":"2024-05-10T14:07:36.896333+0000","last_clean":"2024-05-10T14:07:36.896333+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:36.896333+0000","last_undegraded":"2024-05-10T14:07:36.896333+0000","last_fullsized":"2024-05-10T14:07:36.896333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.896107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:33.864403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.222300+0000","last_change":"2024-05-10T14:07:31.222361+0000","last_active":"2024-05-10T14:07:31.222300+0000","last_peered":"2024-05-10T14:07:31.222300+0000","last_clean":"2024-05-10T14:07:31.222300+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:31.222300+0000","last_undegraded":"2024-05-10T14:07:31.222300+0000","last_fullsized":"2024-05-10T14:07:31.222300+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.222075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:34.716445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.650439+0000","last_change":"2024-05-10T14:07:44.650495+0000","last_active":"2024-05-10T14:07:44.650439+0000","last_peered":"2024-05-10T14:07:44.650439+0000","last_clean":"2024-05-10T14:07:44.650439+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:44.650439+0000","last_undegraded":"2024-05-10T14:07:44.650439+0000","last_fullsized":"2024-05-10T14:07:44.650439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.650240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.650240+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.650240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:08.021232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.981090+0000","last_change":"2024-05-10T14:07:28.981147+0000","last_active":"2024-05-10T14:07:28.981090+0000","last_peered":"2024-05-10T14:07:28.981090+0000","last_clean":"2024-05-10T14:07:28.981090+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:28.981090+0000","last_undegraded":"2024-05-10T14:07:28.981090+0000","last_fullsized":"2024-05-10T14:07:28.981090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.980896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:10.026254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.192046+0000","last_change":"2024-05-10T14:07:38.192104+0000","last_active":"2024-05-10T14:07:38.192046+0000","last_peered":"2024-05-10T14:07:38.192046+0000","last_clean":"2024-05-10T14:07:38.192046+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:38.192046+0000","last_undegraded":"2024-05-10T14:07:38.192046+0000","last_fullsized":"2024-05-10T14:07:38.192046+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.191843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:27.198510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.555277+0000","last_change":"2024-05-10T14:07:54.555386+0000","last_active":"2024-05-10T14:07:54.555277+0000","last_peered":"2024-05-10T14:07:54.555277+0000","last_clean":"2024-05-10T14:07:54.555277+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:54.555277+0000","last_undegraded":"2024-05-10T14:07:54.555277+0000","last_fullsized":"2024-05-10T14:07:54.555277+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.554972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.554972+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.554972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:07.913429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.573792+0000","last_change":"2024-05-10T14:07:43.573845+0000","last_active":"2024-05-10T14:07:43.573792+0000","last_peered":"2024-05-10T14:07:43.573792+0000","last_clean":"2024-05-10T14:07:43.573792+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:43.573792+0000","last_undegraded":"2024-05-10T14:07:43.573792+0000","last_fullsized":"2024-05-10T14:07:43.573792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.573599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.573599+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.573599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:43.723309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.909443+0000","last_change":"2024-05-10T14:07:42.909501+0000","last_active":"2024-05-10T14:07:42.909443+0000","last_peered":"2024-05-10T14:07:42.909443+0000","last_clean":"2024-05-10T14:07:42.909443+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:42.909443+0000","last_undegraded":"2024-05-10T14:07:42.909443+0000","last_fullsized":"2024-05-10T14:07:42.909443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.909207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.909207+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.909207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:20.091453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.428747+0000","last_change":"2024-05-10T14:07:41.428809+0000","last_active":"2024-05-10T14:07:41.428747+0000","last_peered":"2024-05-10T14:07:41.428747+0000","last_clean":"2024-05-10T14:07:41.428747+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:41.428747+0000","last_undegraded":"2024-05-10T14:07:41.428747+0000","last_fullsized":"2024-05-10T14:07:41.428747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.428540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.428540+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.428540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:12.173956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"151'2","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.576292+0000","last_change":"2024-05-10T14:07:26.576360+0000","last_active":"2024-05-10T14:07:26.576292+0000","last_peered":"2024-05-10T14:07:26.576292+0000","last_clean":"2024-05-10T14:07:26.576292+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:26.576292+0000","last_undegraded":"2024-05-10T14:07:26.576292+0000","last_fullsized":"2024-05-10T14:07:26.576292+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.576073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:06.688838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":887,"num_read_kb":646,"num_write":483,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":688,"ondisk_log_size":688,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39720,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332120,"statfs":{"total":96636764160,"available":96596090880,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710769,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33536,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338304,"statfs":{"total":96636764160,"available":96602423296,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41244,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330596,"statfs":{"total":96636764160,"available":96594530304,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39168,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332672,"statfs":{"total":96636764160,"available":96596656128,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37724,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334116,"statfs":{"total":96636764160,"available":96598134784,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37148,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334692,"statfs":{"total":96636764160,"available":96598724608,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:08:05.349 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-10T14:02:35.664094+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=14, tm_min=7, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T14:08:05.349 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T14:08:25.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T14:08:25.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-10T14:08:25.691 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-10T14:08:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-05-10T14:08:24.254536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11082444,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1042,"num_read_kb":785,"num_write":639,"num_write_kb":11919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":13766704,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":967,"ondisk_log_size":967,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302664,"kb_used_data":36104,"kb_used_omap":15,"kb_used_meta":266480,"kb_avail":754672056,"statfs":{"total":773094113280,"available":772784185344,"internally_reserved":0,"allocated":36970496,"data_stored":30838400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715,"internal_metadata":272876189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006856"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.237641+0000","last_change":"2024-05-10T14:07:32.237708+0000","last_active":"2024-05-10T14:07:32.237641+0000","last_peered":"2024-05-10T14:07:32.237641+0000","last_clean":"2024-05-10T14:07:32.237641+0000","last_became_active":"2024-05-10T14:06:56.366882+0000","last_became_peered":"2024-05-10T14:06:56.366882+0000","last_unstale":"2024-05-10T14:07:32.237641+0000","last_undegraded":"2024-05-10T14:07:32.237641+0000","last_fullsized":"2024-05-10T14:07:32.237641+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.237436+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.237436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:27.467926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.602388+0000","last_change":"2024-05-10T14:07:32.602442+0000","last_active":"2024-05-10T14:07:32.602388+0000","last_peered":"2024-05-10T14:07:32.602388+0000","last_clean":"2024-05-10T14:07:32.602388+0000","last_became_active":"2024-05-10T14:04:06.309475+0000","last_became_peered":"2024-05-10T14:04:06.309475+0000","last_unstale":"2024-05-10T14:07:32.602388+0000","last_undegraded":"2024-05-10T14:07:32.602388+0000","last_fullsized":"2024-05-10T14:07:32.602388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.602188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.602188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:48:02.195947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.416102+0000","last_change":"2024-05-10T14:07:38.416269+0000","last_active":"2024-05-10T14:07:38.416102+0000","last_peered":"2024-05-10T14:07:38.416102+0000","last_clean":"2024-05-10T14:07:38.416102+0000","last_became_active":"2024-05-10T14:02:30.631940+0000","last_became_peered":"2024-05-10T14:02:30.631940+0000","last_unstale":"2024-05-10T14:07:38.416102+0000","last_undegraded":"2024-05-10T14:07:38.416102+0000","last_fullsized":"2024-05-10T14:07:38.416102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.415868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.415868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:46.847601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.226377+0000","last_change":"2024-05-10T14:07:35.226431+0000","last_active":"2024-05-10T14:07:35.226377+0000","last_peered":"2024-05-10T14:07:35.226377+0000","last_clean":"2024-05-10T14:07:35.226377+0000","last_became_active":"2024-05-10T14:06:56.380433+0000","last_became_peered":"2024-05-10T14:06:56.380433+0000","last_unstale":"2024-05-10T14:07:35.226377+0000","last_undegraded":"2024-05-10T14:07:35.226377+0000","last_fullsized":"2024-05-10T14:07:35.226377+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.226183+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.226183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:23.586119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.883204+0000","last_change":"2024-05-10T14:07:44.883257+0000","last_active":"2024-05-10T14:07:44.883204+0000","last_peered":"2024-05-10T14:07:44.883204+0000","last_clean":"2024-05-10T14:07:44.883204+0000","last_became_active":"2024-05-10T14:02:30.635708+0000","last_became_peered":"2024-05-10T14:02:30.635708+0000","last_unstale":"2024-05-10T14:07:44.883204+0000","last_undegraded":"2024-05-10T14:07:44.883204+0000","last_fullsized":"2024-05-10T14:07:44.883204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.883028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.883028+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.883028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:22.038754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.665549+0000","last_change":"2024-05-10T14:07:27.665549+0000","last_active":"2024-05-10T14:07:27.665549+0000","last_peered":"2024-05-10T14:07:27.665549+0000","last_clean":"2024-05-10T14:07:27.665549+0000","last_became_active":"2024-05-10T14:02:32.680483+0000","last_became_peered":"2024-05-10T14:02:32.680483+0000","last_unstale":"2024-05-10T14:07:27.665549+0000","last_undegraded":"2024-05-10T14:07:27.665549+0000","last_fullsized":"2024-05-10T14:07:27.665549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.665294+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.665294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:00.718867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.577161+0000","last_change":"2024-05-10T14:07:42.577161+0000","last_active":"2024-05-10T14:07:42.577161+0000","last_peered":"2024-05-10T14:07:42.577161+0000","last_clean":"2024-05-10T14:07:42.577161+0000","last_became_active":"2024-05-10T14:04:06.308914+0000","last_became_peered":"2024-05-10T14:04:06.308914+0000","last_unstale":"2024-05-10T14:07:42.577161+0000","last_undegraded":"2024-05-10T14:07:42.577161+0000","last_fullsized":"2024-05-10T14:07:42.577161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.576785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.576785+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.576785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:38.678526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.814072+0000","last_change":"2024-05-10T14:07:48.814135+0000","last_active":"2024-05-10T14:07:48.814072+0000","last_peered":"2024-05-10T14:07:48.814072+0000","last_clean":"2024-05-10T14:07:48.814072+0000","last_became_active":"2024-05-10T14:02:32.676990+0000","last_became_peered":"2024-05-10T14:02:32.676990+0000","last_unstale":"2024-05-10T14:07:48.814072+0000","last_undegraded":"2024-05-10T14:07:48.814072+0000","last_fullsized":"2024-05-10T14:07:48.814072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.813866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.813866+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.813866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:27.772040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.267702+0000","last_change":"2024-05-10T14:07:30.267764+0000","last_active":"2024-05-10T14:07:30.267702+0000","last_peered":"2024-05-10T14:07:30.267702+0000","last_clean":"2024-05-10T14:07:30.267702+0000","last_became_active":"2024-05-10T14:06:56.367625+0000","last_became_peered":"2024-05-10T14:06:56.367625+0000","last_unstale":"2024-05-10T14:07:30.267702+0000","last_undegraded":"2024-05-10T14:07:30.267702+0000","last_fullsized":"2024-05-10T14:07:30.267702+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.267501+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.267501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:53.900308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.371220+0000","last_change":"2024-05-10T14:07:38.371368+0000","last_active":"2024-05-10T14:07:38.371220+0000","last_peered":"2024-05-10T14:07:38.371220+0000","last_clean":"2024-05-10T14:07:38.371220+0000","last_became_active":"2024-05-10T14:02:32.680691+0000","last_became_peered":"2024-05-10T14:02:32.680691+0000","last_unstale":"2024-05-10T14:07:38.371220+0000","last_undegraded":"2024-05-10T14:07:38.371220+0000","last_fullsized":"2024-05-10T14:07:38.371220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.370951+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.370951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:36.149428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.606354+0000","last_change":"2024-05-10T14:07:41.606412+0000","last_active":"2024-05-10T14:07:41.606354+0000","last_peered":"2024-05-10T14:07:41.606354+0000","last_clean":"2024-05-10T14:07:41.606354+0000","last_became_active":"2024-05-10T14:04:06.318522+0000","last_became_peered":"2024-05-10T14:04:06.318522+0000","last_unstale":"2024-05-10T14:07:41.606354+0000","last_undegraded":"2024-05-10T14:07:41.606354+0000","last_fullsized":"2024-05-10T14:07:41.606354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.606150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.606150+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.606150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:39.467629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.634740+0000","last_change":"2024-05-10T14:07:30.634849+0000","last_active":"2024-05-10T14:07:30.634740+0000","last_peered":"2024-05-10T14:07:30.634740+0000","last_clean":"2024-05-10T14:07:30.634740+0000","last_became_active":"2024-05-10T14:02:32.692606+0000","last_became_peered":"2024-05-10T14:02:32.692606+0000","last_unstale":"2024-05-10T14:07:30.634740+0000","last_undegraded":"2024-05-10T14:07:30.634740+0000","last_fullsized":"2024-05-10T14:07:30.634740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.634509+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.634509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:32.832602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.062368+0000","last_change":"2024-05-10T14:07:48.062423+0000","last_active":"2024-05-10T14:07:48.062368+0000","last_peered":"2024-05-10T14:07:48.062368+0000","last_clean":"2024-05-10T14:07:48.062368+0000","last_became_active":"2024-05-10T14:06:56.355250+0000","last_became_peered":"2024-05-10T14:06:56.355250+0000","last_unstale":"2024-05-10T14:07:48.062368+0000","last_undegraded":"2024-05-10T14:07:48.062368+0000","last_fullsized":"2024-05-10T14:07:48.062368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.062170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.062170+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.062170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:00.941221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":187,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.632859+0000","last_change":"2024-05-10T14:07:24.632859+0000","last_active":"2024-05-10T14:07:24.632859+0000","last_peered":"2024-05-10T14:07:24.632859+0000","last_clean":"2024-05-10T14:07:24.632859+0000","last_became_active":"2024-05-10T14:04:06.317393+0000","last_became_peered":"2024-05-10T14:04:06.317393+0000","last_unstale":"2024-05-10T14:07:24.632859+0000","last_undegraded":"2024-05-10T14:07:24.632859+0000","last_fullsized":"2024-05-10T14:07:24.632859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.632488+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.632488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:19.285245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.716664+0000","last_change":"2024-05-10T14:07:22.716664+0000","last_active":"2024-05-10T14:07:22.716664+0000","last_peered":"2024-05-10T14:07:22.716664+0000","last_clean":"2024-05-10T14:07:22.716664+0000","last_became_active":"2024-05-10T14:04:06.306498+0000","last_became_peered":"2024-05-10T14:04:06.306498+0000","last_unstale":"2024-05-10T14:07:22.716664+0000","last_undegraded":"2024-05-10T14:07:22.716664+0000","last_fullsized":"2024-05-10T14:07:22.716664+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.716512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.716512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:08.219910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.936216+0000","last_change":"2024-05-10T14:07:31.936276+0000","last_active":"2024-05-10T14:07:31.936216+0000","last_peered":"2024-05-10T14:07:31.936216+0000","last_clean":"2024-05-10T14:07:31.936216+0000","last_became_active":"2024-05-10T14:02:32.676091+0000","last_became_peered":"2024-05-10T14:02:32.676091+0000","last_unstale":"2024-05-10T14:07:31.936216+0000","last_undegraded":"2024-05-10T14:07:31.936216+0000","last_fullsized":"2024-05-10T14:07:31.936216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.936022+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.936022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:58.355521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.661027+0000","last_change":"2024-05-10T14:07:36.661124+0000","last_active":"2024-05-10T14:07:36.661027+0000","last_peered":"2024-05-10T14:07:36.661027+0000","last_clean":"2024-05-10T14:07:36.661027+0000","last_became_active":"2024-05-10T14:02:32.681437+0000","last_became_peered":"2024-05-10T14:02:32.681437+0000","last_unstale":"2024-05-10T14:07:36.661027+0000","last_undegraded":"2024-05-10T14:07:36.661027+0000","last_fullsized":"2024-05-10T14:07:36.661027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.660751+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:58.013075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.104577+0000","last_change":"2024-05-10T14:07:42.104635+0000","last_active":"2024-05-10T14:07:42.104577+0000","last_peered":"2024-05-10T14:07:42.104577+0000","last_clean":"2024-05-10T14:07:42.104577+0000","last_became_active":"2024-05-10T14:06:56.358627+0000","last_became_peered":"2024-05-10T14:06:56.358627+0000","last_unstale":"2024-05-10T14:07:42.104577+0000","last_undegraded":"2024-05-10T14:07:42.104577+0000","last_fullsized":"2024-05-10T14:07:42.104577+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.104368+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.104368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:16.126208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"151'2","reported_seq":50,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.051449+0000","last_change":"2024-05-10T14:07:55.051535+0000","last_active":"2024-05-10T14:07:55.051449+0000","last_peered":"2024-05-10T14:07:55.051449+0000","last_clean":"2024-05-10T14:07:55.051449+0000","last_became_active":"2024-05-10T14:06:56.380711+0000","last_became_peered":"2024-05-10T14:06:56.380711+0000","last_unstale":"2024-05-10T14:07:55.051449+0000","last_undegraded":"2024-05-10T14:07:55.051449+0000","last_fullsized":"2024-05-10T14:07:55.051449+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:55.051235+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:55.051235+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.051235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:41.640703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.449415+0000","last_change":"2024-05-10T14:07:41.449514+0000","last_active":"2024-05-10T14:07:41.449415+0000","last_peered":"2024-05-10T14:07:41.449415+0000","last_clean":"2024-05-10T14:07:41.449415+0000","last_became_active":"2024-05-10T14:04:06.319333+0000","last_became_peered":"2024-05-10T14:04:06.319333+0000","last_unstale":"2024-05-10T14:07:41.449415+0000","last_undegraded":"2024-05-10T14:07:41.449415+0000","last_fullsized":"2024-05-10T14:07:41.449415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.449090+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.449090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:15:30.448952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.611226+0000","last_change":"2024-05-10T14:07:37.611279+0000","last_active":"2024-05-10T14:07:37.611226+0000","last_peered":"2024-05-10T14:07:37.611226+0000","last_clean":"2024-05-10T14:07:37.611226+0000","last_became_active":"2024-05-10T14:04:06.316478+0000","last_became_peered":"2024-05-10T14:04:06.316478+0000","last_unstale":"2024-05-10T14:07:37.611226+0000","last_undegraded":"2024-05-10T14:07:37.611226+0000","last_fullsized":"2024-05-10T14:07:37.611226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.611035+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.611035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:58.598206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.486398+0000","last_change":"2024-05-10T14:07:44.486522+0000","last_active":"2024-05-10T14:07:44.486398+0000","last_peered":"2024-05-10T14:07:44.486398+0000","last_clean":"2024-05-10T14:07:44.486398+0000","last_became_active":"2024-05-10T14:04:06.320720+0000","last_became_peered":"2024-05-10T14:04:06.320720+0000","last_unstale":"2024-05-10T14:07:44.486398+0000","last_undegraded":"2024-05-10T14:07:44.486398+0000","last_fullsized":"2024-05-10T14:07:44.486398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.486110+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:41.514329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.998725+0000","last_change":"2024-05-10T14:07:29.998792+0000","last_active":"2024-05-10T14:07:29.998725+0000","last_peered":"2024-05-10T14:07:29.998725+0000","last_clean":"2024-05-10T14:07:29.998725+0000","last_became_active":"2024-05-10T14:02:32.667307+0000","last_became_peered":"2024-05-10T14:02:32.667307+0000","last_unstale":"2024-05-10T14:07:29.998725+0000","last_undegraded":"2024-05-10T14:07:29.998725+0000","last_fullsized":"2024-05-10T14:07:29.998725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.998522+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.998522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:47.669886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.760550+0000","last_change":"2024-05-10T14:07:45.760615+0000","last_active":"2024-05-10T14:07:45.760550+0000","last_peered":"2024-05-10T14:07:45.760550+0000","last_clean":"2024-05-10T14:07:45.760550+0000","last_became_active":"2024-05-10T14:02:30.662734+0000","last_became_peered":"2024-05-10T14:02:30.662734+0000","last_unstale":"2024-05-10T14:07:45.760550+0000","last_undegraded":"2024-05-10T14:07:45.760550+0000","last_fullsized":"2024-05-10T14:07:45.760550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.760311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.760311+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.760311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:40.832931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.961826+0000","last_change":"2024-05-10T14:07:30.961888+0000","last_active":"2024-05-10T14:07:30.961826+0000","last_peered":"2024-05-10T14:07:30.961826+0000","last_clean":"2024-05-10T14:07:30.961826+0000","last_became_active":"2024-05-10T14:02:32.674968+0000","last_became_peered":"2024-05-10T14:02:32.674968+0000","last_unstale":"2024-05-10T14:07:30.961826+0000","last_undegraded":"2024-05-10T14:07:30.961826+0000","last_fullsized":"2024-05-10T14:07:30.961826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.961576+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.961576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:58:37.950718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.608572+0000","last_change":"2024-05-10T14:07:52.608639+0000","last_active":"2024-05-10T14:07:52.608572+0000","last_peered":"2024-05-10T14:07:52.608572+0000","last_clean":"2024-05-10T14:07:52.608572+0000","last_became_active":"2024-05-10T14:02:30.650593+0000","last_became_peered":"2024-05-10T14:02:30.650593+0000","last_unstale":"2024-05-10T14:07:52.608572+0000","last_undegraded":"2024-05-10T14:07:52.608572+0000","last_fullsized":"2024-05-10T14:07:52.608572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.608368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.608368+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.608368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:30:43.289580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.692789+0000","last_change":"2024-05-10T14:07:32.692849+0000","last_active":"2024-05-10T14:07:32.692789+0000","last_peered":"2024-05-10T14:07:32.692789+0000","last_clean":"2024-05-10T14:07:32.692789+0000","last_became_active":"2024-05-10T14:02:32.691611+0000","last_became_peered":"2024-05-10T14:02:32.691611+0000","last_unstale":"2024-05-10T14:07:32.692789+0000","last_undegraded":"2024-05-10T14:07:32.692789+0000","last_fullsized":"2024-05-10T14:07:32.692789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.692565+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.692565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:52:59.551145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.797227+0000","last_change":"2024-05-10T14:07:47.797294+0000","last_active":"2024-05-10T14:07:47.797227+0000","last_peered":"2024-05-10T14:07:47.797227+0000","last_clean":"2024-05-10T14:07:47.797227+0000","last_became_active":"2024-05-10T14:02:30.647507+0000","last_became_peered":"2024-05-10T14:02:30.647507+0000","last_unstale":"2024-05-10T14:07:47.797227+0000","last_undegraded":"2024-05-10T14:07:47.797227+0000","last_fullsized":"2024-05-10T14:07:47.797227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.796955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.796955+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.796955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:11.167947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.644834+0000","last_change":"2024-05-10T14:07:25.644834+0000","last_active":"2024-05-10T14:07:25.644834+0000","last_peered":"2024-05-10T14:07:25.644834+0000","last_clean":"2024-05-10T14:07:25.644834+0000","last_became_active":"2024-05-10T14:02:40.722650+0000","last_became_peered":"2024-05-10T14:02:40.722650+0000","last_unstale":"2024-05-10T14:07:25.644834+0000","last_undegraded":"2024-05-10T14:07:25.644834+0000","last_fullsized":"2024-05-10T14:07:25.644834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.644578+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.644578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:23.828908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.952456+0000","last_change":"2024-05-10T14:07:38.952514+0000","last_active":"2024-05-10T14:07:38.952456+0000","last_peered":"2024-05-10T14:07:38.952456+0000","last_clean":"2024-05-10T14:07:38.952456+0000","last_became_active":"2024-05-10T14:06:12.293256+0000","last_became_peered":"2024-05-10T14:06:12.293256+0000","last_unstale":"2024-05-10T14:07:38.952456+0000","last_undegraded":"2024-05-10T14:07:38.952456+0000","last_fullsized":"2024-05-10T14:07:38.952456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.952232+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.952232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:17.359369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.069780+0000","last_change":"2024-05-10T14:07:46.069842+0000","last_active":"2024-05-10T14:07:46.069780+0000","last_peered":"2024-05-10T14:07:46.069780+0000","last_clean":"2024-05-10T14:07:46.069780+0000","last_became_active":"2024-05-10T14:06:56.354837+0000","last_became_peered":"2024-05-10T14:06:56.354837+0000","last_unstale":"2024-05-10T14:07:46.069780+0000","last_undegraded":"2024-05-10T14:07:46.069780+0000","last_fullsized":"2024-05-10T14:07:46.069780+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.069579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.069579+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.069579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:23.225305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.606269+0000","last_change":"2024-05-10T14:07:29.606325+0000","last_active":"2024-05-10T14:07:29.606269+0000","last_peered":"2024-05-10T14:07:29.606269+0000","last_clean":"2024-05-10T14:07:29.606269+0000","last_became_active":"2024-05-10T14:04:06.317631+0000","last_became_peered":"2024-05-10T14:04:06.317631+0000","last_unstale":"2024-05-10T14:07:29.606269+0000","last_undegraded":"2024-05-10T14:07:29.606269+0000","last_fullsized":"2024-05-10T14:07:29.606269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.606068+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.606068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:24.603115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"151'17","reported_seq":318,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.944161+0000","last_change":"2024-05-10T14:07:58.944272+0000","last_active":"2024-05-10T14:07:58.944161+0000","last_peered":"2024-05-10T14:07:58.944161+0000","last_clean":"2024-05-10T14:07:58.944161+0000","last_became_active":"2024-05-10T14:06:56.369959+0000","last_became_peered":"2024-05-10T14:06:56.369959+0000","last_unstale":"2024-05-10T14:07:58.944161+0000","last_undegraded":"2024-05-10T14:07:58.944161+0000","last_fullsized":"2024-05-10T14:07:58.944161+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:58.943969+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:58.943969+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.943969+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:06.995656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.144113+0000","last_change":"2024-05-10T14:07:40.144171+0000","last_active":"2024-05-10T14:07:40.144113+0000","last_peered":"2024-05-10T14:07:40.144113+0000","last_clean":"2024-05-10T14:07:40.144113+0000","last_became_active":"2024-05-10T14:06:56.358101+0000","last_became_peered":"2024-05-10T14:06:56.358101+0000","last_unstale":"2024-05-10T14:07:40.144113+0000","last_undegraded":"2024-05-10T14:07:40.144113+0000","last_fullsized":"2024-05-10T14:07:40.144113+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.143924+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.143924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:06.285310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"151'2","reported_seq":188,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.660750+0000","last_change":"2024-05-10T14:07:36.660899+0000","last_active":"2024-05-10T14:07:36.660750+0000","last_peered":"2024-05-10T14:07:36.660750+0000","last_clean":"2024-05-10T14:07:36.660750+0000","last_became_active":"2024-05-10T14:04:06.312169+0000","last_became_peered":"2024-05-10T14:04:06.312169+0000","last_unstale":"2024-05-10T14:07:36.660750+0000","last_undegraded":"2024-05-10T14:07:36.660750+0000","last_fullsized":"2024-05-10T14:07:36.660750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.660422+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.660422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:59:47.156144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.588894+0000","last_change":"2024-05-10T14:07:57.588958+0000","last_active":"2024-05-10T14:07:57.588894+0000","last_peered":"2024-05-10T14:07:57.588894+0000","last_clean":"2024-05-10T14:07:57.588894+0000","last_became_active":"2024-05-10T14:06:56.383399+0000","last_became_peered":"2024-05-10T14:06:56.383399+0000","last_unstale":"2024-05-10T14:07:57.588894+0000","last_undegraded":"2024-05-10T14:07:57.588894+0000","last_fullsized":"2024-05-10T14:07:57.588894+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:57.588686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:57.588686+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.588686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:58.987456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":231,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.536342+0000","last_change":"2024-05-10T14:07:51.536342+0000","last_active":"2024-05-10T14:07:51.536342+0000","last_peered":"2024-05-10T14:07:51.536342+0000","last_clean":"2024-05-10T14:07:51.536342+0000","last_became_active":"2024-05-10T14:06:56.395173+0000","last_became_peered":"2024-05-10T14:06:56.395173+0000","last_unstale":"2024-05-10T14:07:51.536342+0000","last_undegraded":"2024-05-10T14:07:51.536342+0000","last_fullsized":"2024-05-10T14:07:51.536342+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.535910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.535910+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.535910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:39:38.365141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.607177+0000","last_change":"2024-05-10T14:07:56.607236+0000","last_active":"2024-05-10T14:07:56.607177+0000","last_peered":"2024-05-10T14:07:56.607177+0000","last_clean":"2024-05-10T14:07:56.607177+0000","last_became_active":"2024-05-10T14:06:56.343805+0000","last_became_peered":"2024-05-10T14:06:56.343805+0000","last_unstale":"2024-05-10T14:07:56.607177+0000","last_undegraded":"2024-05-10T14:07:56.607177+0000","last_fullsized":"2024-05-10T14:07:56.607177+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.606960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.606960+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.606960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:01.221896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"151'9","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.660022+0000","last_change":"2024-05-10T14:07:39.660111+0000","last_active":"2024-05-10T14:07:39.660022+0000","last_peered":"2024-05-10T14:07:39.660022+0000","last_clean":"2024-05-10T14:07:39.660022+0000","last_became_active":"2024-05-10T14:02:36.697509+0000","last_became_peered":"2024-05-10T14:02:36.697509+0000","last_unstale":"2024-05-10T14:07:39.660022+0000","last_undegraded":"2024-05-10T14:07:39.660022+0000","last_fullsized":"2024-05-10T14:07:39.660022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'9","last_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_deep_scrub":"151'9","last_deep_scrub_stamp":"2024-05-10T14:07:39.659812+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.659812+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:39.197461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.630260+0000","last_change":"2024-05-10T14:07:23.630260+0000","last_active":"2024-05-10T14:07:23.630260+0000","last_peered":"2024-05-10T14:07:23.630260+0000","last_clean":"2024-05-10T14:07:23.630260+0000","last_became_active":"2024-05-10T14:02:38.716350+0000","last_became_peered":"2024-05-10T14:02:38.716350+0000","last_unstale":"2024-05-10T14:07:23.630260+0000","last_undegraded":"2024-05-10T14:07:23.630260+0000","last_fullsized":"2024-05-10T14:07:23.630260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.630010+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.630010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:01.557663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.898720+0000","last_change":"2024-05-10T14:07:39.898720+0000","last_active":"2024-05-10T14:07:39.898720+0000","last_peered":"2024-05-10T14:07:39.898720+0000","last_clean":"2024-05-10T14:07:39.898720+0000","last_became_active":"2024-05-10T14:02:40.715300+0000","last_became_peered":"2024-05-10T14:02:40.715300+0000","last_unstale":"2024-05-10T14:07:39.898720+0000","last_undegraded":"2024-05-10T14:07:39.898720+0000","last_fullsized":"2024-05-10T14:07:39.898720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.898472+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.898472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:05.577507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.748022+0000","last_change":"2024-05-10T14:07:50.748079+0000","last_active":"2024-05-10T14:07:50.748022+0000","last_peered":"2024-05-10T14:07:50.748022+0000","last_clean":"2024-05-10T14:07:50.748022+0000","last_became_active":"2024-05-10T14:02:32.678804+0000","last_became_peered":"2024-05-10T14:02:32.678804+0000","last_unstale":"2024-05-10T14:07:50.748022+0000","last_undegraded":"2024-05-10T14:07:50.748022+0000","last_fullsized":"2024-05-10T14:07:50.748022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.747827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.747827+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.747827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:34.205205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.110843+0000","last_change":"2024-05-10T14:07:49.110906+0000","last_active":"2024-05-10T14:07:49.110843+0000","last_peered":"2024-05-10T14:07:49.110843+0000","last_clean":"2024-05-10T14:07:49.110843+0000","last_became_active":"2024-05-10T14:06:56.355971+0000","last_became_peered":"2024-05-10T14:06:56.355971+0000","last_unstale":"2024-05-10T14:07:49.110843+0000","last_undegraded":"2024-05-10T14:07:49.110843+0000","last_fullsized":"2024-05-10T14:07:49.110843+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.110609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.110609+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.110609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:34.033793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.745852+0000","last_change":"2024-05-10T14:07:38.745908+0000","last_active":"2024-05-10T14:07:38.745852+0000","last_peered":"2024-05-10T14:07:38.745852+0000","last_clean":"2024-05-10T14:07:38.745852+0000","last_became_active":"2024-05-10T14:02:34.689076+0000","last_became_peered":"2024-05-10T14:02:34.689076+0000","last_unstale":"2024-05-10T14:07:38.745852+0000","last_undegraded":"2024-05-10T14:07:38.745852+0000","last_fullsized":"2024-05-10T14:07:38.745852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.745597+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.745597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:12.433474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"151'15","reported_seq":278,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.990369+0000","last_change":"2024-05-10T14:07:22.990427+0000","last_active":"2024-05-10T14:07:22.990369+0000","last_peered":"2024-05-10T14:07:22.990369+0000","last_clean":"2024-05-10T14:07:22.990369+0000","last_became_active":"2024-05-10T14:02:36.698705+0000","last_became_peered":"2024-05-10T14:02:36.698705+0000","last_unstale":"2024-05-10T14:07:22.990369+0000","last_undegraded":"2024-05-10T14:07:22.990369+0000","last_fullsized":"2024-05-10T14:07:22.990369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:22.990219+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.990219+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:57.666673+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"151'19","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.021918+0000","last_change":"2024-05-10T14:07:58.021987+0000","last_active":"2024-05-10T14:07:58.021918+0000","last_peered":"2024-05-10T14:07:58.021918+0000","last_clean":"2024-05-10T14:07:58.021918+0000","last_became_active":"2024-05-10T14:06:56.395432+0000","last_became_peered":"2024-05-10T14:06:56.395432+0000","last_unstale":"2024-05-10T14:07:58.021918+0000","last_undegraded":"2024-05-10T14:07:58.021918+0000","last_fullsized":"2024-05-10T14:07:58.021918+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:58.021702+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:58.021702+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.021702+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:40.193859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.886042+0000","last_change":"2024-05-10T14:07:54.886102+0000","last_active":"2024-05-10T14:07:54.886042+0000","last_peered":"2024-05-10T14:07:54.886042+0000","last_clean":"2024-05-10T14:07:54.886042+0000","last_became_active":"2024-05-10T14:02:40.756602+0000","last_became_peered":"2024-05-10T14:02:40.756602+0000","last_unstale":"2024-05-10T14:07:54.886042+0000","last_undegraded":"2024-05-10T14:07:54.886042+0000","last_fullsized":"2024-05-10T14:07:54.886042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.885836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.885836+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.885836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:28.573712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:08:00.639256+0000","last_change":"2024-05-10T14:08:00.639311+0000","last_active":"2024-05-10T14:08:00.639256+0000","last_peered":"2024-05-10T14:08:00.639256+0000","last_clean":"2024-05-10T14:08:00.639256+0000","last_became_active":"2024-05-10T14:06:56.375075+0000","last_became_peered":"2024-05-10T14:06:56.375075+0000","last_unstale":"2024-05-10T14:08:00.639256+0000","last_undegraded":"2024-05-10T14:08:00.639256+0000","last_fullsized":"2024-05-10T14:08:00.639256+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:08:00.639052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:08:00.639052+0000","last_clean_scrub_stamp":"2024-05-10T14:08:00.639052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:27.056850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.369943+0000","last_change":"2024-05-10T14:07:35.370001+0000","last_active":"2024-05-10T14:07:35.369943+0000","last_peered":"2024-05-10T14:07:35.369943+0000","last_clean":"2024-05-10T14:07:35.369943+0000","last_became_active":"2024-05-10T14:02:30.654460+0000","last_became_peered":"2024-05-10T14:02:30.654460+0000","last_unstale":"2024-05-10T14:07:35.369943+0000","last_undegraded":"2024-05-10T14:07:35.369943+0000","last_fullsized":"2024-05-10T14:07:35.369943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.369718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.369718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:16.478783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.698257+0000","last_change":"2024-05-10T14:07:46.698318+0000","last_active":"2024-05-10T14:07:46.698257+0000","last_peered":"2024-05-10T14:07:46.698257+0000","last_clean":"2024-05-10T14:07:46.698257+0000","last_became_active":"2024-05-10T14:04:06.305054+0000","last_became_peered":"2024-05-10T14:04:06.305054+0000","last_unstale":"2024-05-10T14:07:46.698257+0000","last_undegraded":"2024-05-10T14:07:46.698257+0000","last_fullsized":"2024-05-10T14:07:46.698257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.698054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.698054+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.698054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:52:22.310482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"151'17","reported_seq":66,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.066097+0000","last_change":"2024-05-10T14:07:56.066247+0000","last_active":"2024-05-10T14:07:56.066097+0000","last_peered":"2024-05-10T14:07:56.066097+0000","last_clean":"2024-05-10T14:07:56.066097+0000","last_became_active":"2024-05-10T14:06:56.393239+0000","last_became_peered":"2024-05-10T14:06:56.393239+0000","last_unstale":"2024-05-10T14:07:56.066097+0000","last_undegraded":"2024-05-10T14:07:56.066097+0000","last_fullsized":"2024-05-10T14:07:56.066097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:56.065789+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:56.065789+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.065789+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:34.531816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"151'18","reported_seq":306,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.745533+0000","last_change":"2024-05-10T14:07:37.745595+0000","last_active":"2024-05-10T14:07:37.745533+0000","last_peered":"2024-05-10T14:07:37.745533+0000","last_clean":"2024-05-10T14:07:37.745533+0000","last_became_active":"2024-05-10T14:02:38.699856+0000","last_became_peered":"2024-05-10T14:02:38.699856+0000","last_unstale":"2024-05-10T14:07:37.745533+0000","last_undegraded":"2024-05-10T14:07:37.745533+0000","last_fullsized":"2024-05-10T14:07:37.745533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:37.745330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.745330+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:29.621889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.580021+0000","last_change":"2024-05-10T14:07:53.580159+0000","last_active":"2024-05-10T14:07:53.580021+0000","last_peered":"2024-05-10T14:07:53.580021+0000","last_clean":"2024-05-10T14:07:53.580021+0000","last_became_active":"2024-05-10T14:06:56.382862+0000","last_became_peered":"2024-05-10T14:06:56.382862+0000","last_unstale":"2024-05-10T14:07:53.580021+0000","last_undegraded":"2024-05-10T14:07:53.580021+0000","last_fullsized":"2024-05-10T14:07:53.580021+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.579756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.579756+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.579756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:55:11.132034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.050086+0000","last_change":"2024-05-10T14:07:45.050191+0000","last_active":"2024-05-10T14:07:45.050086+0000","last_peered":"2024-05-10T14:07:45.050086+0000","last_clean":"2024-05-10T14:07:45.050086+0000","last_became_active":"2024-05-10T14:06:56.349816+0000","last_became_peered":"2024-05-10T14:06:56.349816+0000","last_unstale":"2024-05-10T14:07:45.050086+0000","last_undegraded":"2024-05-10T14:07:45.050086+0000","last_fullsized":"2024-05-10T14:07:45.050086+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.049852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.049852+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.049852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:56.783544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.260202+0000","last_change":"2024-05-10T14:07:36.260256+0000","last_active":"2024-05-10T14:07:36.260202+0000","last_peered":"2024-05-10T14:07:36.260202+0000","last_clean":"2024-05-10T14:07:36.260202+0000","last_became_active":"2024-05-10T14:06:56.366894+0000","last_became_peered":"2024-05-10T14:06:56.366894+0000","last_unstale":"2024-05-10T14:07:36.260202+0000","last_undegraded":"2024-05-10T14:07:36.260202+0000","last_fullsized":"2024-05-10T14:07:36.260202+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.259997+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.259997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:03.749329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"151'31","reported_seq":244,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.656642+0000","last_change":"2024-05-10T14:07:35.656737+0000","last_active":"2024-05-10T14:07:35.656642+0000","last_peered":"2024-05-10T14:07:35.656642+0000","last_clean":"2024-05-10T14:07:35.656642+0000","last_became_active":"2024-05-10T14:04:06.316236+0000","last_became_peered":"2024-05-10T14:04:06.316236+0000","last_unstale":"2024-05-10T14:07:35.656642+0000","last_undegraded":"2024-05-10T14:07:35.656642+0000","last_fullsized":"2024-05-10T14:07:35.656642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'31","last_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_deep_scrub":"151'31","last_deep_scrub_stamp":"2024-05-10T14:07:35.656449+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.656449+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.334700+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.453831+0000","last_change":"2024-05-10T14:07:48.453894+0000","last_active":"2024-05-10T14:07:48.453831+0000","last_peered":"2024-05-10T14:07:48.453831+0000","last_clean":"2024-05-10T14:07:48.453831+0000","last_became_active":"2024-05-10T14:04:06.318731+0000","last_became_peered":"2024-05-10T14:04:06.318731+0000","last_unstale":"2024-05-10T14:07:48.453831+0000","last_undegraded":"2024-05-10T14:07:48.453831+0000","last_fullsized":"2024-05-10T14:07:48.453831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.453557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.453557+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.453557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:20:16.859380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.692594+0000","last_change":"2024-05-10T14:07:34.692594+0000","last_active":"2024-05-10T14:07:34.692594+0000","last_peered":"2024-05-10T14:07:34.692594+0000","last_clean":"2024-05-10T14:07:34.692594+0000","last_became_active":"2024-05-10T14:04:06.312468+0000","last_became_peered":"2024-05-10T14:04:06.312468+0000","last_unstale":"2024-05-10T14:07:34.692594+0000","last_undegraded":"2024-05-10T14:07:34.692594+0000","last_fullsized":"2024-05-10T14:07:34.692594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.692340+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.692340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:57.318053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"151'2","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.684764+0000","last_change":"2024-05-10T14:07:29.684838+0000","last_active":"2024-05-10T14:07:29.684764+0000","last_peered":"2024-05-10T14:07:29.684764+0000","last_clean":"2024-05-10T14:07:29.684764+0000","last_became_active":"2024-05-10T14:02:32.698982+0000","last_became_peered":"2024-05-10T14:02:32.698982+0000","last_unstale":"2024-05-10T14:07:29.684764+0000","last_undegraded":"2024-05-10T14:07:29.684764+0000","last_fullsized":"2024-05-10T14:07:29.684764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.684552+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.684552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:27.463030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.060152+0000","last_change":"2024-05-10T14:07:47.060262+0000","last_active":"2024-05-10T14:07:47.060152+0000","last_peered":"2024-05-10T14:07:47.060152+0000","last_clean":"2024-05-10T14:07:47.060152+0000","last_became_active":"2024-05-10T14:06:56.350321+0000","last_became_peered":"2024-05-10T14:06:56.350321+0000","last_unstale":"2024-05-10T14:07:47.060152+0000","last_undegraded":"2024-05-10T14:07:47.060152+0000","last_fullsized":"2024-05-10T14:07:47.060152+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.059876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.059876+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.059876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:55.496465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.008143+0000","last_change":"2024-05-10T14:07:27.008196+0000","last_active":"2024-05-10T14:07:27.008143+0000","last_peered":"2024-05-10T14:07:27.008143+0000","last_clean":"2024-05-10T14:07:27.008143+0000","last_became_active":"2024-05-10T14:02:34.693104+0000","last_became_peered":"2024-05-10T14:02:34.693104+0000","last_unstale":"2024-05-10T14:07:27.008143+0000","last_undegraded":"2024-05-10T14:07:27.008143+0000","last_fullsized":"2024-05-10T14:07:27.008143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.007961+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.007961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:49:57.782722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"151'17","reported_seq":321,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:08:01.672054+0000","last_change":"2024-05-10T14:08:01.672145+0000","last_active":"2024-05-10T14:08:01.672054+0000","last_peered":"2024-05-10T14:08:01.672054+0000","last_clean":"2024-05-10T14:08:01.672054+0000","last_became_active":"2024-05-10T14:06:56.374957+0000","last_became_peered":"2024-05-10T14:06:56.374957+0000","last_unstale":"2024-05-10T14:08:01.672054+0000","last_undegraded":"2024-05-10T14:08:01.672054+0000","last_fullsized":"2024-05-10T14:08:01.672054+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:08:01.671825+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:08:01.671825+0000","last_clean_scrub_stamp":"2024-05-10T14:08:01.671825+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:46:48.003798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.697086+0000","last_change":"2024-05-10T14:07:43.697151+0000","last_active":"2024-05-10T14:07:43.697086+0000","last_peered":"2024-05-10T14:07:43.697086+0000","last_clean":"2024-05-10T14:07:43.697086+0000","last_became_active":"2024-05-10T14:02:38.709126+0000","last_became_peered":"2024-05-10T14:02:38.709126+0000","last_unstale":"2024-05-10T14:07:43.697086+0000","last_undegraded":"2024-05-10T14:07:43.697086+0000","last_fullsized":"2024-05-10T14:07:43.697086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.696865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.696865+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.696865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:44.553934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":250,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.304635+0000","last_change":"2024-05-10T14:07:31.304690+0000","last_active":"2024-05-10T14:07:31.304635+0000","last_peered":"2024-05-10T14:07:31.304635+0000","last_clean":"2024-05-10T14:07:31.304635+0000","last_became_active":"2024-05-10T14:02:40.725997+0000","last_became_peered":"2024-05-10T14:02:40.725997+0000","last_unstale":"2024-05-10T14:07:31.304635+0000","last_undegraded":"2024-05-10T14:07:31.304635+0000","last_fullsized":"2024-05-10T14:07:31.304635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.304411+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.304411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:20.601035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.412919+0000","last_change":"2024-05-10T14:07:39.412982+0000","last_active":"2024-05-10T14:07:39.412919+0000","last_peered":"2024-05-10T14:07:39.412919+0000","last_clean":"2024-05-10T14:07:39.412919+0000","last_became_active":"2024-05-10T14:02:32.694213+0000","last_became_peered":"2024-05-10T14:02:32.694213+0000","last_unstale":"2024-05-10T14:07:39.412919+0000","last_undegraded":"2024-05-10T14:07:39.412919+0000","last_fullsized":"2024-05-10T14:07:39.412919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.412716+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.412716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:18.236570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.088750+0000","last_change":"2024-05-10T14:07:51.088806+0000","last_active":"2024-05-10T14:07:51.088750+0000","last_peered":"2024-05-10T14:07:51.088750+0000","last_clean":"2024-05-10T14:07:51.088750+0000","last_became_active":"2024-05-10T14:06:56.395837+0000","last_became_peered":"2024-05-10T14:06:56.395837+0000","last_unstale":"2024-05-10T14:07:51.088750+0000","last_undegraded":"2024-05-10T14:07:51.088750+0000","last_fullsized":"2024-05-10T14:07:51.088750+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.088500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.088500+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.088500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:52:43.952432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.976781+0000","last_change":"2024-05-10T14:07:24.976835+0000","last_active":"2024-05-10T14:07:24.976781+0000","last_peered":"2024-05-10T14:07:24.976781+0000","last_clean":"2024-05-10T14:07:24.976781+0000","last_became_active":"2024-05-10T14:02:34.694676+0000","last_became_peered":"2024-05-10T14:02:34.694676+0000","last_unstale":"2024-05-10T14:07:24.976781+0000","last_undegraded":"2024-05-10T14:07:24.976781+0000","last_fullsized":"2024-05-10T14:07:24.976781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.976605+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.976605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:44.117604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"151'26","reported_seq":75,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.125769+0000","last_change":"2024-05-10T14:07:52.125939+0000","last_active":"2024-05-10T14:07:52.125769+0000","last_peered":"2024-05-10T14:07:52.125769+0000","last_clean":"2024-05-10T14:07:52.125769+0000","last_became_active":"2024-05-10T14:06:56.368578+0000","last_became_peered":"2024-05-10T14:06:56.368578+0000","last_unstale":"2024-05-10T14:07:52.125769+0000","last_undegraded":"2024-05-10T14:07:52.125769+0000","last_fullsized":"2024-05-10T14:07:52.125769+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'26","last_scrub_stamp":"2024-05-10T14:07:52.125551+0000","last_deep_scrub":"151'26","last_deep_scrub_stamp":"2024-05-10T14:07:52.125551+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.125551+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:27:35.582929+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.893802+0000","last_change":"2024-05-10T14:07:31.893901+0000","last_active":"2024-05-10T14:07:31.893802+0000","last_peered":"2024-05-10T14:07:31.893802+0000","last_clean":"2024-05-10T14:07:31.893802+0000","last_became_active":"2024-05-10T14:02:38.724458+0000","last_became_peered":"2024-05-10T14:02:38.724458+0000","last_unstale":"2024-05-10T14:07:31.893802+0000","last_undegraded":"2024-05-10T14:07:31.893802+0000","last_fullsized":"2024-05-10T14:07:31.893802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:31.893557+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.893557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:57.455457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.769929+0000","last_change":"2024-05-10T14:07:51.769987+0000","last_active":"2024-05-10T14:07:51.769929+0000","last_peered":"2024-05-10T14:07:51.769929+0000","last_clean":"2024-05-10T14:07:51.769929+0000","last_became_active":"2024-05-10T14:02:40.725493+0000","last_became_peered":"2024-05-10T14:02:40.725493+0000","last_unstale":"2024-05-10T14:07:51.769929+0000","last_undegraded":"2024-05-10T14:07:51.769929+0000","last_fullsized":"2024-05-10T14:07:51.769929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.769737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.769737+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.769737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:55.865801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.877121+0000","last_change":"2024-05-10T14:07:38.877175+0000","last_active":"2024-05-10T14:07:38.877121+0000","last_peered":"2024-05-10T14:07:38.877121+0000","last_clean":"2024-05-10T14:07:38.877121+0000","last_became_active":"2024-05-10T14:02:32.690571+0000","last_became_peered":"2024-05-10T14:02:32.690571+0000","last_unstale":"2024-05-10T14:07:38.877121+0000","last_undegraded":"2024-05-10T14:07:38.877121+0000","last_fullsized":"2024-05-10T14:07:38.877121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.876927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.876927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:05.018313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.608350+0000","last_change":"2024-05-10T14:07:50.608405+0000","last_active":"2024-05-10T14:07:50.608350+0000","last_peered":"2024-05-10T14:07:50.608350+0000","last_clean":"2024-05-10T14:07:50.608350+0000","last_became_active":"2024-05-10T14:04:06.308589+0000","last_became_peered":"2024-05-10T14:04:06.308589+0000","last_unstale":"2024-05-10T14:07:50.608350+0000","last_undegraded":"2024-05-10T14:07:50.608350+0000","last_fullsized":"2024-05-10T14:07:50.608350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.608118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.608118+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.608118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:01.972747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.916316+0000","last_change":"2024-05-10T14:07:34.916435+0000","last_active":"2024-05-10T14:07:34.916316+0000","last_peered":"2024-05-10T14:07:34.916316+0000","last_clean":"2024-05-10T14:07:34.916316+0000","last_became_active":"2024-05-10T14:02:34.686735+0000","last_became_peered":"2024-05-10T14:02:34.686735+0000","last_unstale":"2024-05-10T14:07:34.916316+0000","last_undegraded":"2024-05-10T14:07:34.916316+0000","last_fullsized":"2024-05-10T14:07:34.916316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.916072+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.916072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:12.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"151'25","reported_seq":338,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.954958+0000","last_change":"2024-05-10T14:07:57.955067+0000","last_active":"2024-05-10T14:07:57.954958+0000","last_peered":"2024-05-10T14:07:57.954958+0000","last_clean":"2024-05-10T14:07:57.954958+0000","last_became_active":"2024-05-10T14:06:56.370621+0000","last_became_peered":"2024-05-10T14:06:56.370621+0000","last_unstale":"2024-05-10T14:07:57.954958+0000","last_undegraded":"2024-05-10T14:07:57.954958+0000","last_fullsized":"2024-05-10T14:07:57.954958+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:57.954750+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:57.954750+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.954750+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:00.369633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.933155+0000","last_change":"2024-05-10T14:07:39.933209+0000","last_active":"2024-05-10T14:07:39.933155+0000","last_peered":"2024-05-10T14:07:39.933155+0000","last_clean":"2024-05-10T14:07:39.933155+0000","last_became_active":"2024-05-10T14:06:56.370035+0000","last_became_peered":"2024-05-10T14:06:56.370035+0000","last_unstale":"2024-05-10T14:07:39.933155+0000","last_undegraded":"2024-05-10T14:07:39.933155+0000","last_fullsized":"2024-05-10T14:07:39.933155+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.932969+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.932969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:54.182620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.342562+0000","last_change":"2024-05-10T14:07:26.342755+0000","last_active":"2024-05-10T14:07:26.342562+0000","last_peered":"2024-05-10T14:07:26.342562+0000","last_clean":"2024-05-10T14:07:26.342562+0000","last_became_active":"2024-05-10T14:02:40.722535+0000","last_became_peered":"2024-05-10T14:02:40.722535+0000","last_unstale":"2024-05-10T14:07:26.342562+0000","last_undegraded":"2024-05-10T14:07:26.342562+0000","last_fullsized":"2024-05-10T14:07:26.342562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.342326+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.342326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:08.559071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"151'2","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.846904+0000","last_change":"2024-05-10T14:07:48.846975+0000","last_active":"2024-05-10T14:07:48.846904+0000","last_peered":"2024-05-10T14:07:48.846904+0000","last_clean":"2024-05-10T14:07:48.846904+0000","last_became_active":"2024-05-10T14:02:32.673347+0000","last_became_peered":"2024-05-10T14:02:32.673347+0000","last_unstale":"2024-05-10T14:07:48.846904+0000","last_undegraded":"2024-05-10T14:07:48.846904+0000","last_fullsized":"2024-05-10T14:07:48.846904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:48.846708+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:48.846708+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.846708+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:13.364260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.610935+0000","last_change":"2024-05-10T14:07:50.611052+0000","last_active":"2024-05-10T14:07:50.610935+0000","last_peered":"2024-05-10T14:07:50.610935+0000","last_clean":"2024-05-10T14:07:50.610935+0000","last_became_active":"2024-05-10T14:02:30.642730+0000","last_became_peered":"2024-05-10T14:02:30.642730+0000","last_unstale":"2024-05-10T14:07:50.610935+0000","last_undegraded":"2024-05-10T14:07:50.610935+0000","last_fullsized":"2024-05-10T14:07:50.610935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.610701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.610701+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.610701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:21.912735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.974047+0000","last_change":"2024-05-10T14:07:40.974106+0000","last_active":"2024-05-10T14:07:40.974047+0000","last_peered":"2024-05-10T14:07:40.974047+0000","last_clean":"2024-05-10T14:07:40.974047+0000","last_became_active":"2024-05-10T14:06:56.370433+0000","last_became_peered":"2024-05-10T14:06:56.370433+0000","last_unstale":"2024-05-10T14:07:40.974047+0000","last_undegraded":"2024-05-10T14:07:40.974047+0000","last_fullsized":"2024-05-10T14:07:40.974047+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.973826+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.973826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:38.752303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"151'19","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.645048+0000","last_change":"2024-05-10T14:07:37.645212+0000","last_active":"2024-05-10T14:07:37.645048+0000","last_peered":"2024-05-10T14:07:37.645048+0000","last_clean":"2024-05-10T14:07:37.645048+0000","last_became_active":"2024-05-10T14:02:36.689661+0000","last_became_peered":"2024-05-10T14:02:36.689661+0000","last_unstale":"2024-05-10T14:07:37.645048+0000","last_undegraded":"2024-05-10T14:07:37.645048+0000","last_fullsized":"2024-05-10T14:07:37.645048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:37.644835+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.644835+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:01.315245+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.919490+0000","last_change":"2024-05-10T14:07:35.919556+0000","last_active":"2024-05-10T14:07:35.919490+0000","last_peered":"2024-05-10T14:07:35.919490+0000","last_clean":"2024-05-10T14:07:35.919490+0000","last_became_active":"2024-05-10T14:02:38.733363+0000","last_became_peered":"2024-05-10T14:02:38.733363+0000","last_unstale":"2024-05-10T14:07:35.919490+0000","last_undegraded":"2024-05-10T14:07:35.919490+0000","last_fullsized":"2024-05-10T14:07:35.919490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.919293+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.919293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:06:00.436845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.706055+0000","last_change":"2024-05-10T14:07:24.706107+0000","last_active":"2024-05-10T14:07:24.706055+0000","last_peered":"2024-05-10T14:07:24.706055+0000","last_clean":"2024-05-10T14:07:24.706055+0000","last_became_active":"2024-05-10T14:04:06.305992+0000","last_became_peered":"2024-05-10T14:04:06.305992+0000","last_unstale":"2024-05-10T14:07:24.706055+0000","last_undegraded":"2024-05-10T14:07:24.706055+0000","last_fullsized":"2024-05-10T14:07:24.706055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.705845+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.705845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:02.650652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.664306+0000","last_change":"2024-05-10T14:07:40.664371+0000","last_active":"2024-05-10T14:07:40.664306+0000","last_peered":"2024-05-10T14:07:40.664306+0000","last_clean":"2024-05-10T14:07:40.664306+0000","last_became_active":"2024-05-10T14:02:32.676309+0000","last_became_peered":"2024-05-10T14:02:32.676309+0000","last_unstale":"2024-05-10T14:07:40.664306+0000","last_undegraded":"2024-05-10T14:07:40.664306+0000","last_fullsized":"2024-05-10T14:07:40.664306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.664108+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.664108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:18.608914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.338530+0000","last_change":"2024-05-10T14:07:34.338590+0000","last_active":"2024-05-10T14:07:34.338530+0000","last_peered":"2024-05-10T14:07:34.338530+0000","last_clean":"2024-05-10T14:07:34.338530+0000","last_became_active":"2024-05-10T14:02:30.648155+0000","last_became_peered":"2024-05-10T14:02:30.648155+0000","last_unstale":"2024-05-10T14:07:34.338530+0000","last_undegraded":"2024-05-10T14:07:34.338530+0000","last_fullsized":"2024-05-10T14:07:34.338530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.338336+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.338336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:32.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.317337+0000","last_change":"2024-05-10T14:07:25.317396+0000","last_active":"2024-05-10T14:07:25.317337+0000","last_peered":"2024-05-10T14:07:25.317337+0000","last_clean":"2024-05-10T14:07:25.317337+0000","last_became_active":"2024-05-10T14:02:34.694871+0000","last_became_peered":"2024-05-10T14:02:34.694871+0000","last_unstale":"2024-05-10T14:07:25.317337+0000","last_undegraded":"2024-05-10T14:07:25.317337+0000","last_fullsized":"2024-05-10T14:07:25.317337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.317133+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.317133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:12:28.900454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"151'25","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.946829+0000","last_change":"2024-05-10T14:07:21.946892+0000","last_active":"2024-05-10T14:07:21.946829+0000","last_peered":"2024-05-10T14:07:21.946829+0000","last_clean":"2024-05-10T14:07:21.946829+0000","last_became_active":"2024-05-10T14:02:36.707547+0000","last_became_peered":"2024-05-10T14:02:36.707547+0000","last_unstale":"2024-05-10T14:07:21.946829+0000","last_undegraded":"2024-05-10T14:07:21.946829+0000","last_fullsized":"2024-05-10T14:07:21.946829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:21.946746+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.946746+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:50.542836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"151'20","reported_seq":308,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.930093+0000","last_change":"2024-05-10T14:07:35.930173+0000","last_active":"2024-05-10T14:07:35.930093+0000","last_peered":"2024-05-10T14:07:35.930093+0000","last_clean":"2024-05-10T14:07:35.930093+0000","last_became_active":"2024-05-10T14:04:06.324287+0000","last_became_peered":"2024-05-10T14:04:06.324287+0000","last_unstale":"2024-05-10T14:07:35.930093+0000","last_undegraded":"2024-05-10T14:07:35.930093+0000","last_fullsized":"2024-05-10T14:07:35.930093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:35.929856+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.929856+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:54.849062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.354694+0000","last_change":"2024-05-10T14:07:28.354817+0000","last_active":"2024-05-10T14:07:28.354694+0000","last_peered":"2024-05-10T14:07:28.354694+0000","last_clean":"2024-05-10T14:07:28.354694+0000","last_became_active":"2024-05-10T14:02:40.726981+0000","last_became_peered":"2024-05-10T14:02:40.726981+0000","last_unstale":"2024-05-10T14:07:28.354694+0000","last_undegraded":"2024-05-10T14:07:28.354694+0000","last_fullsized":"2024-05-10T14:07:28.354694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.354451+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.354451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:03.998380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.831409+0000","last_change":"2024-05-10T14:07:47.831465+0000","last_active":"2024-05-10T14:07:47.831409+0000","last_peered":"2024-05-10T14:07:47.831409+0000","last_clean":"2024-05-10T14:07:47.831409+0000","last_became_active":"2024-05-10T14:02:32.671975+0000","last_became_peered":"2024-05-10T14:02:32.671975+0000","last_unstale":"2024-05-10T14:07:47.831409+0000","last_undegraded":"2024-05-10T14:07:47.831409+0000","last_fullsized":"2024-05-10T14:07:47.831409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.831207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.831207+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.831207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:56:15.320539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.672334+0000","last_change":"2024-05-10T14:07:43.672390+0000","last_active":"2024-05-10T14:07:43.672334+0000","last_peered":"2024-05-10T14:07:43.672334+0000","last_clean":"2024-05-10T14:07:43.672334+0000","last_became_active":"2024-05-10T14:02:30.624356+0000","last_became_peered":"2024-05-10T14:02:30.624356+0000","last_unstale":"2024-05-10T14:07:43.672334+0000","last_undegraded":"2024-05-10T14:07:43.672334+0000","last_fullsized":"2024-05-10T14:07:43.672334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.672144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.672144+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.672144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:38.902633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"151'6","reported_seq":221,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.567781+0000","last_change":"2024-05-10T14:07:39.567863+0000","last_active":"2024-05-10T14:07:39.567781+0000","last_peered":"2024-05-10T14:07:39.567781+0000","last_clean":"2024-05-10T14:07:39.567781+0000","last_became_active":"2024-05-10T14:04:06.321880+0000","last_became_peered":"2024-05-10T14:04:06.321880+0000","last_unstale":"2024-05-10T14:07:39.567781+0000","last_undegraded":"2024-05-10T14:07:39.567781+0000","last_fullsized":"2024-05-10T14:07:39.567781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'6","last_scrub_stamp":"2024-05-10T14:07:39.567574+0000","last_deep_scrub":"151'6","last_deep_scrub_stamp":"2024-05-10T14:07:39.567574+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.567574+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:50:16.910729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"151'15","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.722747+0000","last_change":"2024-05-10T14:07:33.722826+0000","last_active":"2024-05-10T14:07:33.722747+0000","last_peered":"2024-05-10T14:07:33.722747+0000","last_clean":"2024-05-10T14:07:33.722747+0000","last_became_active":"2024-05-10T14:02:36.759324+0000","last_became_peered":"2024-05-10T14:02:36.759324+0000","last_unstale":"2024-05-10T14:07:33.722747+0000","last_undegraded":"2024-05-10T14:07:33.722747+0000","last_fullsized":"2024-05-10T14:07:33.722747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:33.722526+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.722526+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:19.592401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"151'18","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.335820+0000","last_change":"2024-05-10T14:07:27.335885+0000","last_active":"2024-05-10T14:07:27.335820+0000","last_peered":"2024-05-10T14:07:27.335820+0000","last_clean":"2024-05-10T14:07:27.335820+0000","last_became_active":"2024-05-10T14:02:38.723249+0000","last_became_peered":"2024-05-10T14:02:38.723249+0000","last_unstale":"2024-05-10T14:07:27.335820+0000","last_undegraded":"2024-05-10T14:07:27.335820+0000","last_fullsized":"2024-05-10T14:07:27.335820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:27.335623+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.335623+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:05.493216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.934152+0000","last_change":"2024-05-10T14:07:53.934210+0000","last_active":"2024-05-10T14:07:53.934152+0000","last_peered":"2024-05-10T14:07:53.934152+0000","last_clean":"2024-05-10T14:07:53.934152+0000","last_became_active":"2024-05-10T14:02:40.729524+0000","last_became_peered":"2024-05-10T14:02:40.729524+0000","last_unstale":"2024-05-10T14:07:53.934152+0000","last_undegraded":"2024-05-10T14:07:53.934152+0000","last_fullsized":"2024-05-10T14:07:53.934152+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.933945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.933945+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.933945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:45.810505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.450250+0000","last_change":"2024-05-10T14:07:35.450375+0000","last_active":"2024-05-10T14:07:35.450250+0000","last_peered":"2024-05-10T14:07:35.450250+0000","last_clean":"2024-05-10T14:07:35.450250+0000","last_became_active":"2024-05-10T14:02:32.682793+0000","last_became_peered":"2024-05-10T14:02:32.682793+0000","last_unstale":"2024-05-10T14:07:35.450250+0000","last_undegraded":"2024-05-10T14:07:35.450250+0000","last_fullsized":"2024-05-10T14:07:35.450250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.450011+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.450011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:37:23.168333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.564984+0000","last_change":"2024-05-10T14:07:51.565036+0000","last_active":"2024-05-10T14:07:51.564984+0000","last_peered":"2024-05-10T14:07:51.564984+0000","last_clean":"2024-05-10T14:07:51.564984+0000","last_became_active":"2024-05-10T14:02:30.642164+0000","last_became_peered":"2024-05-10T14:02:30.642164+0000","last_unstale":"2024-05-10T14:07:51.564984+0000","last_undegraded":"2024-05-10T14:07:51.564984+0000","last_fullsized":"2024-05-10T14:07:51.564984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.564801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.564801+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.564801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:28:25.742830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.810817+0000","last_change":"2024-05-10T14:07:56.810879+0000","last_active":"2024-05-10T14:07:56.810817+0000","last_peered":"2024-05-10T14:07:56.810817+0000","last_clean":"2024-05-10T14:07:56.810817+0000","last_became_active":"2024-05-10T14:04:06.302811+0000","last_became_peered":"2024-05-10T14:04:06.302811+0000","last_unstale":"2024-05-10T14:07:56.810817+0000","last_undegraded":"2024-05-10T14:07:56.810817+0000","last_fullsized":"2024-05-10T14:07:56.810817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.810597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.810597+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.810597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:51:08.544290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"151'28","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.661172+0000","last_change":"2024-05-10T14:07:31.661259+0000","last_active":"2024-05-10T14:07:31.661172+0000","last_peered":"2024-05-10T14:07:31.661172+0000","last_clean":"2024-05-10T14:07:31.661172+0000","last_became_active":"2024-05-10T14:04:06.317973+0000","last_became_peered":"2024-05-10T14:04:06.317973+0000","last_unstale":"2024-05-10T14:07:31.661172+0000","last_undegraded":"2024-05-10T14:07:31.661172+0000","last_fullsized":"2024-05-10T14:07:31.661172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'28","last_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_deep_scrub":"151'28","last_deep_scrub_stamp":"2024-05-10T14:07:31.660968+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.660968+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:32.223591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.354327+0000","last_change":"2024-05-10T14:07:29.354383+0000","last_active":"2024-05-10T14:07:29.354327+0000","last_peered":"2024-05-10T14:07:29.354327+0000","last_clean":"2024-05-10T14:07:29.354327+0000","last_became_active":"2024-05-10T14:02:38.731313+0000","last_became_peered":"2024-05-10T14:02:38.731313+0000","last_unstale":"2024-05-10T14:07:29.354327+0000","last_undegraded":"2024-05-10T14:07:29.354327+0000","last_fullsized":"2024-05-10T14:07:29.354327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.354128+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.354128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.564422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.426156+0000","last_change":"2024-05-10T14:07:46.426212+0000","last_active":"2024-05-10T14:07:46.426156+0000","last_peered":"2024-05-10T14:07:46.426156+0000","last_clean":"2024-05-10T14:07:46.426156+0000","last_became_active":"2024-05-10T14:04:06.318397+0000","last_became_peered":"2024-05-10T14:04:06.318397+0000","last_unstale":"2024-05-10T14:07:46.426156+0000","last_undegraded":"2024-05-10T14:07:46.426156+0000","last_fullsized":"2024-05-10T14:07:46.426156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.425956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.425956+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.425956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:49.430953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.420075+0000","last_change":"2024-05-10T14:07:40.420215+0000","last_active":"2024-05-10T14:07:40.420075+0000","last_peered":"2024-05-10T14:07:40.420075+0000","last_clean":"2024-05-10T14:07:40.420075+0000","last_became_active":"2024-05-10T14:02:32.700600+0000","last_became_peered":"2024-05-10T14:02:32.700600+0000","last_unstale":"2024-05-10T14:07:40.420075+0000","last_undegraded":"2024-05-10T14:07:40.420075+0000","last_fullsized":"2024-05-10T14:07:40.420075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.419823+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.419823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:00.289279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"151'74","reported_seq":53,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.098604+0000","last_change":"2024-05-10T14:07:54.098685+0000","last_active":"2024-05-10T14:07:54.098604+0000","last_peered":"2024-05-10T14:07:54.098604+0000","last_clean":"2024-05-10T14:07:54.098604+0000","last_became_active":"2024-05-10T14:06:56.378224+0000","last_became_peered":"2024-05-10T14:06:56.378224+0000","last_unstale":"2024-05-10T14:07:54.098604+0000","last_undegraded":"2024-05-10T14:07:54.098604+0000","last_fullsized":"2024-05-10T14:07:54.098604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'74","last_scrub_stamp":"2024-05-10T14:07:54.098410+0000","last_deep_scrub":"151'74","last_deep_scrub_stamp":"2024-05-10T14:07:54.098410+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.098410+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:58.973583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.604827+0000","last_change":"2024-05-10T14:07:51.604827+0000","last_active":"2024-05-10T14:07:51.604827+0000","last_peered":"2024-05-10T14:07:51.604827+0000","last_clean":"2024-05-10T14:07:51.604827+0000","last_became_active":"2024-05-10T14:04:06.316268+0000","last_became_peered":"2024-05-10T14:04:06.316268+0000","last_unstale":"2024-05-10T14:07:51.604827+0000","last_undegraded":"2024-05-10T14:07:51.604827+0000","last_fullsized":"2024-05-10T14:07:51.604827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:51.604565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:51.604565+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.604565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:35.651242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.674040+0000","last_change":"2024-05-10T14:07:26.674096+0000","last_active":"2024-05-10T14:07:26.674040+0000","last_peered":"2024-05-10T14:07:26.674040+0000","last_clean":"2024-05-10T14:07:26.674040+0000","last_became_active":"2024-05-10T14:04:06.295323+0000","last_became_peered":"2024-05-10T14:04:06.295323+0000","last_unstale":"2024-05-10T14:07:26.674040+0000","last_undegraded":"2024-05-10T14:07:26.674040+0000","last_fullsized":"2024-05-10T14:07:26.674040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.673817+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.673817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:48.085080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.218116+0000","last_change":"2024-05-10T14:07:28.218179+0000","last_active":"2024-05-10T14:07:28.218116+0000","last_peered":"2024-05-10T14:07:28.218116+0000","last_clean":"2024-05-10T14:07:28.218116+0000","last_became_active":"2024-05-10T14:06:56.374857+0000","last_became_peered":"2024-05-10T14:06:56.374857+0000","last_unstale":"2024-05-10T14:07:28.218116+0000","last_undegraded":"2024-05-10T14:07:28.218116+0000","last_fullsized":"2024-05-10T14:07:28.218116+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.217921+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.217921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:27.755571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"151'30","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.662228+0000","last_change":"2024-05-10T14:07:49.662313+0000","last_active":"2024-05-10T14:07:49.662228+0000","last_peered":"2024-05-10T14:07:49.662228+0000","last_clean":"2024-05-10T14:07:49.662228+0000","last_became_active":"2024-05-10T14:04:06.305747+0000","last_became_peered":"2024-05-10T14:04:06.305747+0000","last_unstale":"2024-05-10T14:07:49.662228+0000","last_undegraded":"2024-05-10T14:07:49.662228+0000","last_fullsized":"2024-05-10T14:07:49.662228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'30","last_scrub_stamp":"2024-05-10T14:07:49.662034+0000","last_deep_scrub":"151'30","last_deep_scrub_stamp":"2024-05-10T14:07:49.662034+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.662034+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:16.733530+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.866738+0000","last_change":"2024-05-10T14:07:54.866796+0000","last_active":"2024-05-10T14:07:54.866738+0000","last_peered":"2024-05-10T14:07:54.866738+0000","last_clean":"2024-05-10T14:07:54.866738+0000","last_became_active":"2024-05-10T14:06:56.369281+0000","last_became_peered":"2024-05-10T14:06:56.369281+0000","last_unstale":"2024-05-10T14:07:54.866738+0000","last_undegraded":"2024-05-10T14:07:54.866738+0000","last_fullsized":"2024-05-10T14:07:54.866738+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.866534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.866534+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.866534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:59:33.332561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":257,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.446434+0000","last_change":"2024-05-10T14:07:42.446496+0000","last_active":"2024-05-10T14:07:42.446434+0000","last_peered":"2024-05-10T14:07:42.446434+0000","last_clean":"2024-05-10T14:07:42.446434+0000","last_became_active":"2024-05-10T14:04:06.319651+0000","last_became_peered":"2024-05-10T14:04:06.319651+0000","last_unstale":"2024-05-10T14:07:42.446434+0000","last_undegraded":"2024-05-10T14:07:42.446434+0000","last_fullsized":"2024-05-10T14:07:42.446434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.446233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.446233+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.446233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:11.398647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.907821+0000","last_change":"2024-05-10T14:07:40.907880+0000","last_active":"2024-05-10T14:07:40.907821+0000","last_peered":"2024-05-10T14:07:40.907821+0000","last_clean":"2024-05-10T14:07:40.907821+0000","last_became_active":"2024-05-10T14:02:32.689972+0000","last_became_peered":"2024-05-10T14:02:32.689972+0000","last_unstale":"2024-05-10T14:07:40.907821+0000","last_undegraded":"2024-05-10T14:07:40.907821+0000","last_fullsized":"2024-05-10T14:07:40.907821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.907593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.907593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:34:32.784152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.156415+0000","last_change":"2024-05-10T14:07:39.156550+0000","last_active":"2024-05-10T14:07:39.156415+0000","last_peered":"2024-05-10T14:07:39.156415+0000","last_clean":"2024-05-10T14:07:39.156415+0000","last_became_active":"2024-05-10T14:06:56.393944+0000","last_became_peered":"2024-05-10T14:06:56.393944+0000","last_unstale":"2024-05-10T14:07:39.156415+0000","last_undegraded":"2024-05-10T14:07:39.156415+0000","last_fullsized":"2024-05-10T14:07:39.156415+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.156160+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.156160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:25.026036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.835015+0000","last_change":"2024-05-10T14:07:45.835072+0000","last_active":"2024-05-10T14:07:45.835015+0000","last_peered":"2024-05-10T14:07:45.835015+0000","last_clean":"2024-05-10T14:07:45.835015+0000","last_became_active":"2024-05-10T14:02:30.638110+0000","last_became_peered":"2024-05-10T14:02:30.638110+0000","last_unstale":"2024-05-10T14:07:45.835015+0000","last_undegraded":"2024-05-10T14:07:45.835015+0000","last_fullsized":"2024-05-10T14:07:45.835015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.834813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.834813+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.834813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:42.398082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.649059+0000","last_change":"2024-05-10T14:07:33.649117+0000","last_active":"2024-05-10T14:07:33.649059+0000","last_peered":"2024-05-10T14:07:33.649059+0000","last_clean":"2024-05-10T14:07:33.649059+0000","last_became_active":"2024-05-10T14:04:06.317952+0000","last_became_peered":"2024-05-10T14:04:06.317952+0000","last_unstale":"2024-05-10T14:07:33.649059+0000","last_undegraded":"2024-05-10T14:07:33.649059+0000","last_fullsized":"2024-05-10T14:07:33.649059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.648851+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.648851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:47:20.655715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"151'54","reported_seq":376,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.482240+0000","last_change":"2024-05-10T14:07:45.482402+0000","last_active":"2024-05-10T14:07:45.482240+0000","last_peered":"2024-05-10T14:07:45.482240+0000","last_clean":"2024-05-10T14:07:45.482240+0000","last_became_active":"2024-05-10T14:04:06.318448+0000","last_became_peered":"2024-05-10T14:04:06.318448+0000","last_unstale":"2024-05-10T14:07:45.482240+0000","last_undegraded":"2024-05-10T14:07:45.482240+0000","last_fullsized":"2024-05-10T14:07:45.482240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'54","last_scrub_stamp":"2024-05-10T14:07:45.482000+0000","last_deep_scrub":"151'54","last_deep_scrub_stamp":"2024-05-10T14:07:45.482000+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.482000+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:00.526626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.168061+0000","last_change":"2024-05-10T14:07:27.168120+0000","last_active":"2024-05-10T14:07:27.168061+0000","last_peered":"2024-05-10T14:07:27.168061+0000","last_clean":"2024-05-10T14:07:27.168061+0000","last_became_active":"2024-05-10T14:06:56.377831+0000","last_became_peered":"2024-05-10T14:06:56.377831+0000","last_unstale":"2024-05-10T14:07:27.168061+0000","last_undegraded":"2024-05-10T14:07:27.168061+0000","last_fullsized":"2024-05-10T14:07:27.168061+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.167863+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.167863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:12.671261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":251,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.413966+0000","last_change":"2024-05-10T14:07:30.414024+0000","last_active":"2024-05-10T14:07:30.413966+0000","last_peered":"2024-05-10T14:07:30.413966+0000","last_clean":"2024-05-10T14:07:30.413966+0000","last_became_active":"2024-05-10T14:02:40.753513+0000","last_became_peered":"2024-05-10T14:02:40.753513+0000","last_unstale":"2024-05-10T14:07:30.413966+0000","last_undegraded":"2024-05-10T14:07:30.413966+0000","last_fullsized":"2024-05-10T14:07:30.413966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.413749+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.413749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:18:42.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.461634+0000","last_change":"2024-05-10T14:07:47.461809+0000","last_active":"2024-05-10T14:07:47.461634+0000","last_peered":"2024-05-10T14:07:47.461634+0000","last_clean":"2024-05-10T14:07:47.461634+0000","last_became_active":"2024-05-10T14:04:06.318309+0000","last_became_peered":"2024-05-10T14:04:06.318309+0000","last_unstale":"2024-05-10T14:07:47.461634+0000","last_undegraded":"2024-05-10T14:07:47.461634+0000","last_fullsized":"2024-05-10T14:07:47.461634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:47.461398+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:47.461398+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.461398+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:39:47.174687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":276,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.995125+0000","last_change":"2024-05-10T14:07:27.995186+0000","last_active":"2024-05-10T14:07:27.995125+0000","last_peered":"2024-05-10T14:07:27.995125+0000","last_clean":"2024-05-10T14:07:27.995125+0000","last_became_active":"2024-05-10T14:02:24.589867+0000","last_became_peered":"2024-05-10T14:02:24.589867+0000","last_unstale":"2024-05-10T14:07:27.995125+0000","last_undegraded":"2024-05-10T14:07:27.995125+0000","last_fullsized":"2024-05-10T14:07:27.995125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.994931+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.994931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:05:35.411465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.403230+0000","last_change":"2024-05-10T14:07:40.403346+0000","last_active":"2024-05-10T14:07:40.403230+0000","last_peered":"2024-05-10T14:07:40.403230+0000","last_clean":"2024-05-10T14:07:40.403230+0000","last_became_active":"2024-05-10T14:02:30.635940+0000","last_became_peered":"2024-05-10T14:02:30.635940+0000","last_unstale":"2024-05-10T14:07:40.403230+0000","last_undegraded":"2024-05-10T14:07:40.403230+0000","last_fullsized":"2024-05-10T14:07:40.403230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.402962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.402962+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.402962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:07:35.504448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"151'2","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.891325+0000","last_change":"2024-05-10T14:07:36.891389+0000","last_active":"2024-05-10T14:07:36.891325+0000","last_peered":"2024-05-10T14:07:36.891325+0000","last_clean":"2024-05-10T14:07:36.891325+0000","last_became_active":"2024-05-10T14:04:06.327309+0000","last_became_peered":"2024-05-10T14:04:06.327309+0000","last_unstale":"2024-05-10T14:07:36.891325+0000","last_undegraded":"2024-05-10T14:07:36.891325+0000","last_fullsized":"2024-05-10T14:07:36.891325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:36.891129+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.891129+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.075459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"151'24","reported_seq":71,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.040863+0000","last_change":"2024-05-10T14:07:57.041028+0000","last_active":"2024-05-10T14:07:57.040863+0000","last_peered":"2024-05-10T14:07:57.040863+0000","last_clean":"2024-05-10T14:07:57.040863+0000","last_became_active":"2024-05-10T14:06:56.393242+0000","last_became_peered":"2024-05-10T14:06:56.393242+0000","last_unstale":"2024-05-10T14:07:57.040863+0000","last_undegraded":"2024-05-10T14:07:57.040863+0000","last_fullsized":"2024-05-10T14:07:57.040863+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'24","last_scrub_stamp":"2024-05-10T14:07:57.040642+0000","last_deep_scrub":"151'24","last_deep_scrub_stamp":"2024-05-10T14:07:57.040642+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.040642+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:51.016015+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.909436+0000","last_change":"2024-05-10T14:07:27.909553+0000","last_active":"2024-05-10T14:07:27.909436+0000","last_peered":"2024-05-10T14:07:27.909436+0000","last_clean":"2024-05-10T14:07:27.909436+0000","last_became_active":"2024-05-10T14:02:38.716078+0000","last_became_peered":"2024-05-10T14:02:38.716078+0000","last_unstale":"2024-05-10T14:07:27.909436+0000","last_undegraded":"2024-05-10T14:07:27.909436+0000","last_fullsized":"2024-05-10T14:07:27.909436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.909206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.909206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:05.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.604312+0000","last_change":"2024-05-10T14:07:55.604372+0000","last_active":"2024-05-10T14:07:55.604312+0000","last_peered":"2024-05-10T14:07:55.604312+0000","last_clean":"2024-05-10T14:07:55.604312+0000","last_became_active":"2024-05-10T14:02:40.717908+0000","last_became_peered":"2024-05-10T14:02:40.717908+0000","last_unstale":"2024-05-10T14:07:55.604312+0000","last_undegraded":"2024-05-10T14:07:55.604312+0000","last_fullsized":"2024-05-10T14:07:55.604312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.604105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.604105+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.604105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:09:15.825419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.424760+0000","last_change":"2024-05-10T14:07:31.424818+0000","last_active":"2024-05-10T14:07:31.424760+0000","last_peered":"2024-05-10T14:07:31.424760+0000","last_clean":"2024-05-10T14:07:31.424760+0000","last_became_active":"2024-05-10T14:02:32.692724+0000","last_became_peered":"2024-05-10T14:02:32.692724+0000","last_unstale":"2024-05-10T14:07:31.424760+0000","last_undegraded":"2024-05-10T14:07:31.424760+0000","last_fullsized":"2024-05-10T14:07:31.424760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.424555+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.424555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:12:55.196458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.612871+0000","last_change":"2024-05-10T14:07:44.612871+0000","last_active":"2024-05-10T14:07:44.612871+0000","last_peered":"2024-05-10T14:07:44.612871+0000","last_clean":"2024-05-10T14:07:44.612871+0000","last_became_active":"2024-05-10T14:04:06.302327+0000","last_became_peered":"2024-05-10T14:04:06.302327+0000","last_unstale":"2024-05-10T14:07:44.612871+0000","last_undegraded":"2024-05-10T14:07:44.612871+0000","last_fullsized":"2024-05-10T14:07:44.612871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.612591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.612591+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.612591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:38.766288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.716065+0000","last_change":"2024-05-10T14:07:44.716127+0000","last_active":"2024-05-10T14:07:44.716065+0000","last_peered":"2024-05-10T14:07:44.716065+0000","last_clean":"2024-05-10T14:07:44.716065+0000","last_became_active":"2024-05-10T14:02:30.634232+0000","last_became_peered":"2024-05-10T14:02:30.634232+0000","last_unstale":"2024-05-10T14:07:44.716065+0000","last_undegraded":"2024-05-10T14:07:44.716065+0000","last_fullsized":"2024-05-10T14:07:44.716065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.715846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.715846+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.715846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:44.950944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.918113+0000","last_change":"2024-05-10T14:07:34.918174+0000","last_active":"2024-05-10T14:07:34.918113+0000","last_peered":"2024-05-10T14:07:34.918113+0000","last_clean":"2024-05-10T14:07:34.918113+0000","last_became_active":"2024-05-10T14:02:34.691817+0000","last_became_peered":"2024-05-10T14:02:34.691817+0000","last_unstale":"2024-05-10T14:07:34.918113+0000","last_undegraded":"2024-05-10T14:07:34.918113+0000","last_fullsized":"2024-05-10T14:07:34.918113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.917893+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.917893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:03:28.952902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"151'18","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.749529+0000","last_change":"2024-05-10T14:07:34.749626+0000","last_active":"2024-05-10T14:07:34.749529+0000","last_peered":"2024-05-10T14:07:34.749529+0000","last_clean":"2024-05-10T14:07:34.749529+0000","last_became_active":"2024-05-10T14:02:36.700006+0000","last_became_peered":"2024-05-10T14:02:36.700006+0000","last_unstale":"2024-05-10T14:07:34.749529+0000","last_undegraded":"2024-05-10T14:07:34.749529+0000","last_fullsized":"2024-05-10T14:07:34.749529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:34.749322+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.749322+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:22:55.388007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.396463+0000","last_change":"2024-05-10T14:07:25.396519+0000","last_active":"2024-05-10T14:07:25.396463+0000","last_peered":"2024-05-10T14:07:25.396463+0000","last_clean":"2024-05-10T14:07:25.396463+0000","last_became_active":"2024-05-10T14:02:38.717250+0000","last_became_peered":"2024-05-10T14:02:38.717250+0000","last_unstale":"2024-05-10T14:07:25.396463+0000","last_undegraded":"2024-05-10T14:07:25.396463+0000","last_fullsized":"2024-05-10T14:07:25.396463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.396270+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.396270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:23.766029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.635601+0000","last_change":"2024-05-10T14:07:30.635716+0000","last_active":"2024-05-10T14:07:30.635601+0000","last_peered":"2024-05-10T14:07:30.635601+0000","last_clean":"2024-05-10T14:07:30.635601+0000","last_became_active":"2024-05-10T14:04:06.305983+0000","last_became_peered":"2024-05-10T14:04:06.305983+0000","last_unstale":"2024-05-10T14:07:30.635601+0000","last_undegraded":"2024-05-10T14:07:30.635601+0000","last_fullsized":"2024-05-10T14:07:30.635601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.635307+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.635307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:49:42.884913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.390727+0000","last_change":"2024-05-10T14:07:32.390796+0000","last_active":"2024-05-10T14:07:32.390727+0000","last_peered":"2024-05-10T14:07:32.390727+0000","last_clean":"2024-05-10T14:07:32.390727+0000","last_became_active":"2024-05-10T14:04:06.305475+0000","last_became_peered":"2024-05-10T14:04:06.305475+0000","last_unstale":"2024-05-10T14:07:32.390727+0000","last_undegraded":"2024-05-10T14:07:32.390727+0000","last_fullsized":"2024-05-10T14:07:32.390727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.390537+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.390537+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:00:21.254841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":220,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.952262+0000","last_change":"2024-05-10T14:07:23.952311+0000","last_active":"2024-05-10T14:07:23.952262+0000","last_peered":"2024-05-10T14:07:23.952262+0000","last_clean":"2024-05-10T14:07:23.952262+0000","last_became_active":"2024-05-10T14:03:11.205172+0000","last_became_peered":"2024-05-10T14:03:11.205172+0000","last_unstale":"2024-05-10T14:07:23.952262+0000","last_undegraded":"2024-05-10T14:07:23.952262+0000","last_fullsized":"2024-05-10T14:07:23.952262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.952085+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.952085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:36:24.299018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.430535+0000","last_change":"2024-05-10T14:07:37.430591+0000","last_active":"2024-05-10T14:07:37.430535+0000","last_peered":"2024-05-10T14:07:37.430535+0000","last_clean":"2024-05-10T14:07:37.430535+0000","last_became_active":"2024-05-10T14:02:24.796208+0000","last_became_peered":"2024-05-10T14:02:24.796208+0000","last_unstale":"2024-05-10T14:07:37.430535+0000","last_undegraded":"2024-05-10T14:07:37.430535+0000","last_fullsized":"2024-05-10T14:07:37.430535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.430330+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.430330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:45:37.578731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.942595+0000","last_change":"2024-05-10T14:07:32.942666+0000","last_active":"2024-05-10T14:07:32.942595+0000","last_peered":"2024-05-10T14:07:32.942595+0000","last_clean":"2024-05-10T14:07:32.942595+0000","last_became_active":"2024-05-10T14:02:34.692330+0000","last_became_peered":"2024-05-10T14:02:34.692330+0000","last_unstale":"2024-05-10T14:07:32.942595+0000","last_undegraded":"2024-05-10T14:07:32.942595+0000","last_fullsized":"2024-05-10T14:07:32.942595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.942400+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.942400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:28.015020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"151'32","reported_seq":314,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.948039+0000","last_change":"2024-05-10T14:07:28.948130+0000","last_active":"2024-05-10T14:07:28.948039+0000","last_peered":"2024-05-10T14:07:28.948039+0000","last_clean":"2024-05-10T14:07:28.948039+0000","last_became_active":"2024-05-10T14:02:36.707868+0000","last_became_peered":"2024-05-10T14:02:36.707868+0000","last_unstale":"2024-05-10T14:07:28.948039+0000","last_undegraded":"2024-05-10T14:07:28.948039+0000","last_fullsized":"2024-05-10T14:07:28.948039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'32","last_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_deep_scrub":"151'32","last_deep_scrub_stamp":"2024-05-10T14:07:28.947807+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.947807+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:52.580613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.681099+0000","last_change":"2024-05-10T14:07:26.681166+0000","last_active":"2024-05-10T14:07:26.681099+0000","last_peered":"2024-05-10T14:07:26.681099+0000","last_clean":"2024-05-10T14:07:26.681099+0000","last_became_active":"2024-05-10T14:02:38.706259+0000","last_became_peered":"2024-05-10T14:02:38.706259+0000","last_unstale":"2024-05-10T14:07:26.681099+0000","last_undegraded":"2024-05-10T14:07:26.681099+0000","last_fullsized":"2024-05-10T14:07:26.681099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.680864+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.680864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:07.789929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"151'2","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.956250+0000","last_change":"2024-05-10T14:07:26.956314+0000","last_active":"2024-05-10T14:07:26.956250+0000","last_peered":"2024-05-10T14:07:26.956250+0000","last_clean":"2024-05-10T14:07:26.956250+0000","last_became_active":"2024-05-10T14:02:40.755299+0000","last_became_peered":"2024-05-10T14:02:40.755299+0000","last_unstale":"2024-05-10T14:07:26.956250+0000","last_undegraded":"2024-05-10T14:07:26.956250+0000","last_fullsized":"2024-05-10T14:07:26.956250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.956051+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.956051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:53.568515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"151'4","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.975303+0000","last_change":"2024-05-10T14:07:23.975376+0000","last_active":"2024-05-10T14:07:23.975303+0000","last_peered":"2024-05-10T14:07:23.975303+0000","last_clean":"2024-05-10T14:07:23.975303+0000","last_became_active":"2024-05-10T14:04:06.318520+0000","last_became_peered":"2024-05-10T14:04:06.318520+0000","last_unstale":"2024-05-10T14:07:23.975303+0000","last_undegraded":"2024-05-10T14:07:23.975303+0000","last_fullsized":"2024-05-10T14:07:23.975303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2024-05-10T14:07:23.975105+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.975105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:18:57.825330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.373385+0000","last_change":"2024-05-10T14:07:39.373441+0000","last_active":"2024-05-10T14:07:39.373385+0000","last_peered":"2024-05-10T14:07:39.373385+0000","last_clean":"2024-05-10T14:07:39.373385+0000","last_became_active":"2024-05-10T14:02:30.635713+0000","last_became_peered":"2024-05-10T14:02:30.635713+0000","last_unstale":"2024-05-10T14:07:39.373385+0000","last_undegraded":"2024-05-10T14:07:39.373385+0000","last_fullsized":"2024-05-10T14:07:39.373385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:39.373188+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.373188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:55.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.232810+0000","last_change":"2024-05-10T14:07:29.232870+0000","last_active":"2024-05-10T14:07:29.232810+0000","last_peered":"2024-05-10T14:07:29.232810+0000","last_clean":"2024-05-10T14:07:29.232810+0000","last_became_active":"2024-05-10T14:06:56.378717+0000","last_became_peered":"2024-05-10T14:06:56.378717+0000","last_unstale":"2024-05-10T14:07:29.232810+0000","last_undegraded":"2024-05-10T14:07:29.232810+0000","last_fullsized":"2024-05-10T14:07:29.232810+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.232614+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.232614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:25:07.177421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.339054+0000","last_change":"2024-05-10T14:07:32.339109+0000","last_active":"2024-05-10T14:07:32.339054+0000","last_peered":"2024-05-10T14:07:32.339054+0000","last_clean":"2024-05-10T14:07:32.339054+0000","last_became_active":"2024-05-10T14:02:34.685419+0000","last_became_peered":"2024-05-10T14:02:34.685419+0000","last_unstale":"2024-05-10T14:07:32.339054+0000","last_undegraded":"2024-05-10T14:07:32.339054+0000","last_fullsized":"2024-05-10T14:07:32.339054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:32.338865+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.338865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:38:10.266519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"151'21","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.310389+0000","last_change":"2024-05-10T14:07:21.310444+0000","last_active":"2024-05-10T14:07:21.310389+0000","last_peered":"2024-05-10T14:07:21.310389+0000","last_clean":"2024-05-10T14:07:21.310389+0000","last_became_active":"2024-05-10T14:02:36.759022+0000","last_became_peered":"2024-05-10T14:02:36.759022+0000","last_unstale":"2024-05-10T14:07:21.310389+0000","last_undegraded":"2024-05-10T14:07:21.310389+0000","last_fullsized":"2024-05-10T14:07:21.310389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'21","last_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_deep_scrub":"151'21","last_deep_scrub_stamp":"2024-05-10T14:07:21.310310+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.310310+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:56.364173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"151'20","reported_seq":207,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.590832+0000","last_change":"2024-05-10T14:07:23.590832+0000","last_active":"2024-05-10T14:07:23.590832+0000","last_peered":"2024-05-10T14:07:23.590832+0000","last_clean":"2024-05-10T14:07:23.590832+0000","last_became_active":"2024-05-10T14:04:06.316219+0000","last_became_peered":"2024-05-10T14:04:06.316219+0000","last_unstale":"2024-05-10T14:07:23.590832+0000","last_undegraded":"2024-05-10T14:07:23.590832+0000","last_fullsized":"2024-05-10T14:07:23.590832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'20","last_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_deep_scrub":"151'20","last_deep_scrub_stamp":"2024-05-10T14:07:23.590396+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.590396+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:50.454066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.722849+0000","last_change":"2024-05-10T14:07:30.723007+0000","last_active":"2024-05-10T14:07:30.722849+0000","last_peered":"2024-05-10T14:07:30.722849+0000","last_clean":"2024-05-10T14:07:30.722849+0000","last_became_active":"2024-05-10T14:02:40.753466+0000","last_became_peered":"2024-05-10T14:02:40.753466+0000","last_unstale":"2024-05-10T14:07:30.722849+0000","last_undegraded":"2024-05-10T14:07:30.722849+0000","last_fullsized":"2024-05-10T14:07:30.722849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.722607+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.722607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:19.082543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.623607+0000","last_change":"2024-05-10T14:07:58.623662+0000","last_active":"2024-05-10T14:07:58.623607+0000","last_peered":"2024-05-10T14:07:58.623607+0000","last_clean":"2024-05-10T14:07:58.623607+0000","last_became_active":"2024-05-10T14:06:56.374338+0000","last_became_peered":"2024-05-10T14:06:56.374338+0000","last_unstale":"2024-05-10T14:07:58.623607+0000","last_undegraded":"2024-05-10T14:07:58.623607+0000","last_fullsized":"2024-05-10T14:07:58.623607+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:58.623403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:58.623403+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.623403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:27.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:59.625878+0000","last_change":"2024-05-10T14:07:59.625946+0000","last_active":"2024-05-10T14:07:59.625878+0000","last_peered":"2024-05-10T14:07:59.625878+0000","last_clean":"2024-05-10T14:07:59.625878+0000","last_became_active":"2024-05-10T14:06:56.374738+0000","last_became_peered":"2024-05-10T14:06:56.374738+0000","last_unstale":"2024-05-10T14:07:59.625878+0000","last_undegraded":"2024-05-10T14:07:59.625878+0000","last_fullsized":"2024-05-10T14:07:59.625878+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:59.625650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:59.625650+0000","last_clean_scrub_stamp":"2024-05-10T14:07:59.625650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:55.176487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.463795+0000","last_change":"2024-05-10T14:07:36.463852+0000","last_active":"2024-05-10T14:07:36.463795+0000","last_peered":"2024-05-10T14:07:36.463795+0000","last_clean":"2024-05-10T14:07:36.463795+0000","last_became_active":"2024-05-10T14:02:24.591237+0000","last_became_peered":"2024-05-10T14:02:24.591237+0000","last_unstale":"2024-05-10T14:07:36.463795+0000","last_undegraded":"2024-05-10T14:07:36.463795+0000","last_fullsized":"2024-05-10T14:07:36.463795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.463569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.463569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:35:46.544710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.676778+0000","last_change":"2024-05-10T14:07:31.676842+0000","last_active":"2024-05-10T14:07:31.676778+0000","last_peered":"2024-05-10T14:07:31.676778+0000","last_clean":"2024-05-10T14:07:31.676778+0000","last_became_active":"2024-05-10T14:02:34.680033+0000","last_became_peered":"2024-05-10T14:02:34.680033+0000","last_unstale":"2024-05-10T14:07:31.676778+0000","last_undegraded":"2024-05-10T14:07:31.676778+0000","last_fullsized":"2024-05-10T14:07:31.676778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.676593+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.676593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:51.546049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.657801+0000","last_change":"2024-05-10T14:07:41.657876+0000","last_active":"2024-05-10T14:07:41.657801+0000","last_peered":"2024-05-10T14:07:41.657801+0000","last_clean":"2024-05-10T14:07:41.657801+0000","last_became_active":"2024-05-10T14:02:36.702259+0000","last_became_peered":"2024-05-10T14:02:36.702259+0000","last_unstale":"2024-05-10T14:07:41.657801+0000","last_undegraded":"2024-05-10T14:07:41.657801+0000","last_fullsized":"2024-05-10T14:07:41.657801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:41.657598+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.657598+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:05.290405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"151'18","reported_seq":298,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:39.728833+0000","last_change":"2024-05-10T14:07:39.728896+0000","last_active":"2024-05-10T14:07:39.728833+0000","last_peered":"2024-05-10T14:07:39.728833+0000","last_clean":"2024-05-10T14:07:39.728833+0000","last_became_active":"2024-05-10T14:02:38.701546+0000","last_became_peered":"2024-05-10T14:02:38.701546+0000","last_unstale":"2024-05-10T14:07:39.728833+0000","last_undegraded":"2024-05-10T14:07:39.728833+0000","last_fullsized":"2024-05-10T14:07:39.728833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:39.728603+0000","last_clean_scrub_stamp":"2024-05-10T14:07:39.728603+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:16.910850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.855396+0000","last_change":"2024-05-10T14:07:37.855543+0000","last_active":"2024-05-10T14:07:37.855396+0000","last_peered":"2024-05-10T14:07:37.855396+0000","last_clean":"2024-05-10T14:07:37.855396+0000","last_became_active":"2024-05-10T14:02:40.715138+0000","last_became_peered":"2024-05-10T14:02:40.715138+0000","last_unstale":"2024-05-10T14:07:37.855396+0000","last_undegraded":"2024-05-10T14:07:37.855396+0000","last_fullsized":"2024-05-10T14:07:37.855396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.855137+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.855137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:53:59.761135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.859817+0000","last_change":"2024-05-10T14:07:55.859933+0000","last_active":"2024-05-10T14:07:55.859817+0000","last_peered":"2024-05-10T14:07:55.859817+0000","last_clean":"2024-05-10T14:07:55.859817+0000","last_became_active":"2024-05-10T14:04:06.298720+0000","last_became_peered":"2024-05-10T14:04:06.298720+0000","last_unstale":"2024-05-10T14:07:55.859817+0000","last_undegraded":"2024-05-10T14:07:55.859817+0000","last_fullsized":"2024-05-10T14:07:55.859817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.859516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.859516+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.859516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:33.041762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.905970+0000","last_change":"2024-05-10T14:07:43.906031+0000","last_active":"2024-05-10T14:07:43.905970+0000","last_peered":"2024-05-10T14:07:43.905970+0000","last_clean":"2024-05-10T14:07:43.905970+0000","last_became_active":"2024-05-10T14:02:30.632093+0000","last_became_peered":"2024-05-10T14:02:30.632093+0000","last_unstale":"2024-05-10T14:07:43.905970+0000","last_undegraded":"2024-05-10T14:07:43.905970+0000","last_fullsized":"2024-05-10T14:07:43.905970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.905765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.905765+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.905765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:55.639457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.474917+0000","last_change":"2024-05-10T14:07:46.474969+0000","last_active":"2024-05-10T14:07:46.474917+0000","last_peered":"2024-05-10T14:07:46.474917+0000","last_clean":"2024-05-10T14:07:46.474917+0000","last_became_active":"2024-05-10T14:06:56.375523+0000","last_became_peered":"2024-05-10T14:06:56.375523+0000","last_unstale":"2024-05-10T14:07:46.474917+0000","last_undegraded":"2024-05-10T14:07:46.474917+0000","last_fullsized":"2024-05-10T14:07:46.474917+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.474718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.474718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.474718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:19.374029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.737833+0000","last_change":"2024-05-10T14:07:40.737891+0000","last_active":"2024-05-10T14:07:40.737833+0000","last_peered":"2024-05-10T14:07:40.737833+0000","last_clean":"2024-05-10T14:07:40.737833+0000","last_became_active":"2024-05-10T14:02:34.689016+0000","last_became_peered":"2024-05-10T14:02:34.689016+0000","last_unstale":"2024-05-10T14:07:40.737833+0000","last_undegraded":"2024-05-10T14:07:40.737833+0000","last_fullsized":"2024-05-10T14:07:40.737833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.737577+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.737577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:50:52.471269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"151'36","reported_seq":89,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.147958+0000","last_change":"2024-05-10T14:07:25.148049+0000","last_active":"2024-05-10T14:07:25.147958+0000","last_peered":"2024-05-10T14:07:25.147958+0000","last_clean":"2024-05-10T14:07:25.147958+0000","last_became_active":"2024-05-10T14:06:56.367133+0000","last_became_peered":"2024-05-10T14:06:56.367133+0000","last_unstale":"2024-05-10T14:07:25.147958+0000","last_undegraded":"2024-05-10T14:07:25.147958+0000","last_fullsized":"2024-05-10T14:07:25.147958+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'36","last_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_deep_scrub":"151'36","last_deep_scrub_stamp":"2024-05-10T14:07:25.147756+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.147756+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:46.500080+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.648209+0000","last_change":"2024-05-10T14:07:45.648267+0000","last_active":"2024-05-10T14:07:45.648209+0000","last_peered":"2024-05-10T14:07:45.648209+0000","last_clean":"2024-05-10T14:07:45.648209+0000","last_became_active":"2024-05-10T14:02:38.721032+0000","last_became_peered":"2024-05-10T14:02:38.721032+0000","last_unstale":"2024-05-10T14:07:45.648209+0000","last_undegraded":"2024-05-10T14:07:45.648209+0000","last_fullsized":"2024-05-10T14:07:45.648209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.648006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.648006+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.648006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:24.606180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"151'4","reported_seq":209,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.544085+0000","last_change":"2024-05-10T14:07:58.544153+0000","last_active":"2024-05-10T14:07:58.544085+0000","last_peered":"2024-05-10T14:07:58.544085+0000","last_clean":"2024-05-10T14:07:58.544085+0000","last_became_active":"2024-05-10T14:06:56.385794+0000","last_became_peered":"2024-05-10T14:06:56.385794+0000","last_unstale":"2024-05-10T14:07:58.544085+0000","last_undegraded":"2024-05-10T14:07:58.544085+0000","last_fullsized":"2024-05-10T14:07:58.544085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2024-05-10T14:07:58.543846+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2024-05-10T14:07:58.543846+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.543846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:20.543892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"151'2","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:21.003773+0000","last_change":"2024-05-10T14:07:21.003800+0000","last_active":"2024-05-10T14:07:21.003773+0000","last_peered":"2024-05-10T14:07:21.003773+0000","last_clean":"2024-05-10T14:07:21.003773+0000","last_became_active":"2024-05-10T14:04:06.328867+0000","last_became_peered":"2024-05-10T14:04:06.328867+0000","last_unstale":"2024-05-10T14:07:21.003773+0000","last_undegraded":"2024-05-10T14:07:21.003773+0000","last_fullsized":"2024-05-10T14:07:21.003773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:21.003698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:21.003698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:46:49.956112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.709014+0000","last_change":"2024-05-10T14:07:34.709073+0000","last_active":"2024-05-10T14:07:34.709014+0000","last_peered":"2024-05-10T14:07:34.709014+0000","last_clean":"2024-05-10T14:07:34.709014+0000","last_became_active":"2024-05-10T14:02:32.679203+0000","last_became_peered":"2024-05-10T14:02:32.679203+0000","last_unstale":"2024-05-10T14:07:34.709014+0000","last_undegraded":"2024-05-10T14:07:34.709014+0000","last_fullsized":"2024-05-10T14:07:34.709014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.708821+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.708821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:40.383875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"151'2","reported_seq":295,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:58.780949+0000","last_change":"2024-05-10T14:07:58.781021+0000","last_active":"2024-05-10T14:07:58.780949+0000","last_peered":"2024-05-10T14:07:58.780949+0000","last_clean":"2024-05-10T14:07:58.780949+0000","last_became_active":"2024-05-10T14:06:56.371166+0000","last_became_peered":"2024-05-10T14:06:56.371166+0000","last_unstale":"2024-05-10T14:07:58.780949+0000","last_undegraded":"2024-05-10T14:07:58.780949+0000","last_fullsized":"2024-05-10T14:07:58.780949+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:58.780721+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:58.780721+0000","last_clean_scrub_stamp":"2024-05-10T14:07:58.780721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:55.343990+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.503900+0000","last_change":"2024-05-10T14:07:44.503958+0000","last_active":"2024-05-10T14:07:44.503900+0000","last_peered":"2024-05-10T14:07:44.503900+0000","last_clean":"2024-05-10T14:07:44.503900+0000","last_became_active":"2024-05-10T14:04:06.305715+0000","last_became_peered":"2024-05-10T14:04:06.305715+0000","last_unstale":"2024-05-10T14:07:44.503900+0000","last_undegraded":"2024-05-10T14:07:44.503900+0000","last_fullsized":"2024-05-10T14:07:44.503900+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.503708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.503708+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.503708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:13:31.221399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.761588+0000","last_change":"2024-05-10T14:07:32.761686+0000","last_active":"2024-05-10T14:07:32.761588+0000","last_peered":"2024-05-10T14:07:32.761588+0000","last_clean":"2024-05-10T14:07:32.761588+0000","last_became_active":"2024-05-10T14:02:36.700735+0000","last_became_peered":"2024-05-10T14:02:36.700735+0000","last_unstale":"2024-05-10T14:07:32.761588+0000","last_undegraded":"2024-05-10T14:07:32.761588+0000","last_fullsized":"2024-05-10T14:07:32.761588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:32.761359+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.761359+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:57.278911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":259,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.759852+0000","last_change":"2024-05-10T14:07:41.759908+0000","last_active":"2024-05-10T14:07:41.759852+0000","last_peered":"2024-05-10T14:07:41.759852+0000","last_clean":"2024-05-10T14:07:41.759852+0000","last_became_active":"2024-05-10T14:02:38.705823+0000","last_became_peered":"2024-05-10T14:02:38.705823+0000","last_unstale":"2024-05-10T14:07:41.759852+0000","last_undegraded":"2024-05-10T14:07:41.759852+0000","last_fullsized":"2024-05-10T14:07:41.759852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.759647+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.759647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:02:59.566098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":265,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.711976+0000","last_change":"2024-05-10T14:07:29.712034+0000","last_active":"2024-05-10T14:07:29.711976+0000","last_peered":"2024-05-10T14:07:29.711976+0000","last_clean":"2024-05-10T14:07:29.711976+0000","last_became_active":"2024-05-10T14:06:56.341816+0000","last_became_peered":"2024-05-10T14:06:56.341816+0000","last_unstale":"2024-05-10T14:07:29.711976+0000","last_undegraded":"2024-05-10T14:07:29.711976+0000","last_fullsized":"2024-05-10T14:07:29.711976+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.711766+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.711766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:24.784387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.370765+0000","last_change":"2024-05-10T14:07:27.370827+0000","last_active":"2024-05-10T14:07:27.370765+0000","last_peered":"2024-05-10T14:07:27.370765+0000","last_clean":"2024-05-10T14:07:27.370765+0000","last_became_active":"2024-05-10T14:02:32.696817+0000","last_became_peered":"2024-05-10T14:02:32.696817+0000","last_unstale":"2024-05-10T14:07:27.370765+0000","last_undegraded":"2024-05-10T14:07:27.370765+0000","last_fullsized":"2024-05-10T14:07:27.370765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.370559+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.370559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:25:48.876276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.239346+0000","last_change":"2024-05-10T14:07:37.239403+0000","last_active":"2024-05-10T14:07:37.239346+0000","last_peered":"2024-05-10T14:07:37.239346+0000","last_clean":"2024-05-10T14:07:37.239346+0000","last_became_active":"2024-05-10T14:06:56.390048+0000","last_became_peered":"2024-05-10T14:06:56.390048+0000","last_unstale":"2024-05-10T14:07:37.239346+0000","last_undegraded":"2024-05-10T14:07:37.239346+0000","last_fullsized":"2024-05-10T14:07:37.239346+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.239146+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.239146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:31:00.357237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.761971+0000","last_change":"2024-05-10T14:07:36.762032+0000","last_active":"2024-05-10T14:07:36.761971+0000","last_peered":"2024-05-10T14:07:36.761971+0000","last_clean":"2024-05-10T14:07:36.761971+0000","last_became_active":"2024-05-10T14:02:34.693841+0000","last_became_peered":"2024-05-10T14:02:34.693841+0000","last_unstale":"2024-05-10T14:07:36.761971+0000","last_undegraded":"2024-05-10T14:07:36.761971+0000","last_fullsized":"2024-05-10T14:07:36.761971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.761768+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.761768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:02.440802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"151'8","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.014343+0000","last_change":"2024-05-10T14:07:23.014483+0000","last_active":"2024-05-10T14:07:23.014343+0000","last_peered":"2024-05-10T14:07:23.014343+0000","last_clean":"2024-05-10T14:07:23.014343+0000","last_became_active":"2024-05-10T14:04:06.318492+0000","last_became_peered":"2024-05-10T14:04:06.318492+0000","last_unstale":"2024-05-10T14:07:23.014343+0000","last_undegraded":"2024-05-10T14:07:23.014343+0000","last_fullsized":"2024-05-10T14:07:23.014343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'8","last_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_deep_scrub":"151'8","last_deep_scrub_stamp":"2024-05-10T14:07:23.014096+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.014096+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:20.042315+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.229385+0000","last_change":"2024-05-10T14:07:34.229441+0000","last_active":"2024-05-10T14:07:34.229385+0000","last_peered":"2024-05-10T14:07:34.229385+0000","last_clean":"2024-05-10T14:07:34.229385+0000","last_became_active":"2024-05-10T14:06:56.367032+0000","last_became_peered":"2024-05-10T14:06:56.367032+0000","last_unstale":"2024-05-10T14:07:34.229385+0000","last_undegraded":"2024-05-10T14:07:34.229385+0000","last_fullsized":"2024-05-10T14:07:34.229385+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:34.229194+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.229194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:59.791093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":252,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.943622+0000","last_change":"2024-05-10T14:07:41.943622+0000","last_active":"2024-05-10T14:07:41.943622+0000","last_peered":"2024-05-10T14:07:41.943622+0000","last_clean":"2024-05-10T14:07:41.943622+0000","last_became_active":"2024-05-10T14:02:40.718926+0000","last_became_peered":"2024-05-10T14:02:40.718926+0000","last_unstale":"2024-05-10T14:07:41.943622+0000","last_undegraded":"2024-05-10T14:07:41.943622+0000","last_fullsized":"2024-05-10T14:07:41.943622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.943342+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.943342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:15.631218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"151'2","reported_seq":241,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.946117+0000","last_change":"2024-05-10T14:07:41.946117+0000","last_active":"2024-05-10T14:07:41.946117+0000","last_peered":"2024-05-10T14:07:41.946117+0000","last_clean":"2024-05-10T14:07:41.946117+0000","last_became_active":"2024-05-10T14:06:56.386444+0000","last_became_peered":"2024-05-10T14:06:56.386444+0000","last_unstale":"2024-05-10T14:07:41.946117+0000","last_undegraded":"2024-05-10T14:07:41.946117+0000","last_fullsized":"2024-05-10T14:07:41.946117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:41.945868+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.945868+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:31:20.769723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.612477+0000","last_change":"2024-05-10T14:07:25.612530+0000","last_active":"2024-05-10T14:07:25.612477+0000","last_peered":"2024-05-10T14:07:25.612477+0000","last_clean":"2024-05-10T14:07:25.612477+0000","last_became_active":"2024-05-10T14:06:56.379221+0000","last_became_peered":"2024-05-10T14:06:56.379221+0000","last_unstale":"2024-05-10T14:07:25.612477+0000","last_undegraded":"2024-05-10T14:07:25.612477+0000","last_fullsized":"2024-05-10T14:07:25.612477+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.612253+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.612253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:06:34.416095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.255540+0000","last_change":"2024-05-10T14:07:33.255596+0000","last_active":"2024-05-10T14:07:33.255540+0000","last_peered":"2024-05-10T14:07:33.255540+0000","last_clean":"2024-05-10T14:07:33.255540+0000","last_became_active":"2024-05-10T14:06:56.379433+0000","last_became_peered":"2024-05-10T14:06:56.379433+0000","last_unstale":"2024-05-10T14:07:33.255540+0000","last_undegraded":"2024-05-10T14:07:33.255540+0000","last_fullsized":"2024-05-10T14:07:33.255540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.255282+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.255282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:33.490379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.770161+0000","last_change":"2024-05-10T14:07:31.770235+0000","last_active":"2024-05-10T14:07:31.770161+0000","last_peered":"2024-05-10T14:07:31.770161+0000","last_clean":"2024-05-10T14:07:31.770161+0000","last_became_active":"2024-05-10T14:02:36.700300+0000","last_became_peered":"2024-05-10T14:02:36.700300+0000","last_unstale":"2024-05-10T14:07:31.770161+0000","last_undegraded":"2024-05-10T14:07:31.770161+0000","last_fullsized":"2024-05-10T14:07:31.770161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:31.769945+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.769945+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:55:59.259278+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.438072+0000","last_change":"2024-05-10T14:07:24.438125+0000","last_active":"2024-05-10T14:07:24.438072+0000","last_peered":"2024-05-10T14:07:24.438072+0000","last_clean":"2024-05-10T14:07:24.438072+0000","last_became_active":"2024-05-10T14:02:38.716833+0000","last_became_peered":"2024-05-10T14:02:38.716833+0000","last_unstale":"2024-05-10T14:07:24.438072+0000","last_undegraded":"2024-05-10T14:07:24.438072+0000","last_fullsized":"2024-05-10T14:07:24.438072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.437873+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.437873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:18:07.966698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.581497+0000","last_change":"2024-05-10T14:07:52.581561+0000","last_active":"2024-05-10T14:07:52.581497+0000","last_peered":"2024-05-10T14:07:52.581497+0000","last_clean":"2024-05-10T14:07:52.581497+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:07:52.581497+0000","last_undegraded":"2024-05-10T14:07:52.581497+0000","last_fullsized":"2024-05-10T14:07:52.581497+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.581292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.581292+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.581292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:29.194725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.721110+0000","last_change":"2024-05-10T14:07:23.721130+0000","last_active":"2024-05-10T14:07:23.721110+0000","last_peered":"2024-05-10T14:07:23.721110+0000","last_clean":"2024-05-10T14:07:23.721110+0000","last_became_active":"2024-05-10T14:04:06.306330+0000","last_became_peered":"2024-05-10T14:04:06.306330+0000","last_unstale":"2024-05-10T14:07:23.721110+0000","last_undegraded":"2024-05-10T14:07:23.721110+0000","last_fullsized":"2024-05-10T14:07:23.721110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.721037+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.721037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:59:50.333501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.020307+0000","last_change":"2024-05-10T14:07:22.020307+0000","last_active":"2024-05-10T14:07:22.020307+0000","last_peered":"2024-05-10T14:07:22.020307+0000","last_clean":"2024-05-10T14:07:22.020307+0000","last_became_active":"2024-05-10T14:04:06.329152+0000","last_became_peered":"2024-05-10T14:04:06.329152+0000","last_unstale":"2024-05-10T14:07:22.020307+0000","last_undegraded":"2024-05-10T14:07:22.020307+0000","last_fullsized":"2024-05-10T14:07:22.020307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.020202+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.020202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:27.695256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.323006+0000","last_change":"2024-05-10T14:07:28.323062+0000","last_active":"2024-05-10T14:07:28.323006+0000","last_peered":"2024-05-10T14:07:28.323006+0000","last_clean":"2024-05-10T14:07:28.323006+0000","last_became_active":"2024-05-10T14:02:34.690991+0000","last_became_peered":"2024-05-10T14:02:34.690991+0000","last_unstale":"2024-05-10T14:07:28.323006+0000","last_undegraded":"2024-05-10T14:07:28.323006+0000","last_fullsized":"2024-05-10T14:07:28.323006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.322800+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.322800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:38.102769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"151'17","reported_seq":66,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.095947+0000","last_change":"2024-05-10T14:07:53.096026+0000","last_active":"2024-05-10T14:07:53.095947+0000","last_peered":"2024-05-10T14:07:53.095947+0000","last_clean":"2024-05-10T14:07:53.095947+0000","last_became_active":"2024-05-10T14:06:56.369024+0000","last_became_peered":"2024-05-10T14:06:56.369024+0000","last_unstale":"2024-05-10T14:07:53.095947+0000","last_undegraded":"2024-05-10T14:07:53.095947+0000","last_fullsized":"2024-05-10T14:07:53.095947+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:53.095759+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:53.095759+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.095759+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:27:42.966597+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.837489+0000","last_change":"2024-05-10T14:07:53.837548+0000","last_active":"2024-05-10T14:07:53.837489+0000","last_peered":"2024-05-10T14:07:53.837489+0000","last_clean":"2024-05-10T14:07:53.837489+0000","last_became_active":"2024-05-10T14:06:56.370079+0000","last_became_peered":"2024-05-10T14:06:56.370079+0000","last_unstale":"2024-05-10T14:07:53.837489+0000","last_undegraded":"2024-05-10T14:07:53.837489+0000","last_fullsized":"2024-05-10T14:07:53.837489+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:53.837235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:53.837235+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.837235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:24.391423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.443950+0000","last_change":"2024-05-10T14:07:43.444010+0000","last_active":"2024-05-10T14:07:43.443950+0000","last_peered":"2024-05-10T14:07:43.443950+0000","last_clean":"2024-05-10T14:07:43.443950+0000","last_became_active":"2024-05-10T14:04:06.320507+0000","last_became_peered":"2024-05-10T14:04:06.320507+0000","last_unstale":"2024-05-10T14:07:43.443950+0000","last_undegraded":"2024-05-10T14:07:43.443950+0000","last_fullsized":"2024-05-10T14:07:43.443950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.443742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.443742+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.443742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:49.118796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.619589+0000","last_change":"2024-05-10T14:07:49.619649+0000","last_active":"2024-05-10T14:07:49.619589+0000","last_peered":"2024-05-10T14:07:49.619589+0000","last_clean":"2024-05-10T14:07:49.619589+0000","last_became_active":"2024-05-10T14:02:30.642701+0000","last_became_peered":"2024-05-10T14:02:30.642701+0000","last_unstale":"2024-05-10T14:07:49.619589+0000","last_undegraded":"2024-05-10T14:07:49.619589+0000","last_fullsized":"2024-05-10T14:07:49.619589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.619373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.619373+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.619373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:36.208841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":274,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.913606+0000","last_change":"2024-05-10T14:07:56.913683+0000","last_active":"2024-05-10T14:07:56.913606+0000","last_peered":"2024-05-10T14:07:56.913606+0000","last_clean":"2024-05-10T14:07:56.913606+0000","last_became_active":"2024-05-10T14:06:56.371462+0000","last_became_peered":"2024-05-10T14:06:56.371462+0000","last_unstale":"2024-05-10T14:07:56.913606+0000","last_undegraded":"2024-05-10T14:07:56.913606+0000","last_fullsized":"2024-05-10T14:07:56.913606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.913399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.913399+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.913399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:39.085556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"151'25","reported_seq":310,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.461773+0000","last_change":"2024-05-10T14:07:49.461864+0000","last_active":"2024-05-10T14:07:49.461773+0000","last_peered":"2024-05-10T14:07:49.461773+0000","last_clean":"2024-05-10T14:07:49.461773+0000","last_became_active":"2024-05-10T14:04:06.327728+0000","last_became_peered":"2024-05-10T14:04:06.327728+0000","last_unstale":"2024-05-10T14:07:49.461773+0000","last_undegraded":"2024-05-10T14:07:49.461773+0000","last_fullsized":"2024-05-10T14:07:49.461773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:49.461543+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:49.461543+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.461543+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:31:03.370077+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:40.569731+0000","last_change":"2024-05-10T14:07:40.569790+0000","last_active":"2024-05-10T14:07:40.569731+0000","last_peered":"2024-05-10T14:07:40.569731+0000","last_clean":"2024-05-10T14:07:40.569731+0000","last_became_active":"2024-05-10T14:04:06.308547+0000","last_became_peered":"2024-05-10T14:04:06.308547+0000","last_unstale":"2024-05-10T14:07:40.569731+0000","last_undegraded":"2024-05-10T14:07:40.569731+0000","last_fullsized":"2024-05-10T14:07:40.569731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:40.569536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:40.569536+0000","last_clean_scrub_stamp":"2024-05-10T14:07:40.569536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:00.743525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.690736+0000","last_change":"2024-05-10T14:07:27.690800+0000","last_active":"2024-05-10T14:07:27.690736+0000","last_peered":"2024-05-10T14:07:27.690736+0000","last_clean":"2024-05-10T14:07:27.690736+0000","last_became_active":"2024-05-10T14:02:40.756681+0000","last_became_peered":"2024-05-10T14:02:40.756681+0000","last_unstale":"2024-05-10T14:07:27.690736+0000","last_undegraded":"2024-05-10T14:07:27.690736+0000","last_fullsized":"2024-05-10T14:07:27.690736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.690535+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.690535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:27.925633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":278,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.904800+0000","last_change":"2024-05-10T14:07:55.904860+0000","last_active":"2024-05-10T14:07:55.904800+0000","last_peered":"2024-05-10T14:07:55.904800+0000","last_clean":"2024-05-10T14:07:55.904800+0000","last_became_active":"2024-05-10T14:06:56.370730+0000","last_became_peered":"2024-05-10T14:06:56.370730+0000","last_unstale":"2024-05-10T14:07:55.904800+0000","last_undegraded":"2024-05-10T14:07:55.904800+0000","last_fullsized":"2024-05-10T14:07:55.904800+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.904595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.904595+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.904595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:00.894505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.436569+0000","last_change":"2024-05-10T14:07:42.436630+0000","last_active":"2024-05-10T14:07:42.436569+0000","last_peered":"2024-05-10T14:07:42.436569+0000","last_clean":"2024-05-10T14:07:42.436569+0000","last_became_active":"2024-05-10T14:02:30.640939+0000","last_became_peered":"2024-05-10T14:02:30.640939+0000","last_unstale":"2024-05-10T14:07:42.436569+0000","last_undegraded":"2024-05-10T14:07:42.436569+0000","last_fullsized":"2024-05-10T14:07:42.436569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.436354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.436354+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.436354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:27:36.961316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.337729+0000","last_change":"2024-05-10T14:07:30.337788+0000","last_active":"2024-05-10T14:07:30.337729+0000","last_peered":"2024-05-10T14:07:30.337729+0000","last_clean":"2024-05-10T14:07:30.337729+0000","last_became_active":"2024-05-10T14:02:34.690670+0000","last_became_peered":"2024-05-10T14:02:34.690670+0000","last_unstale":"2024-05-10T14:07:30.337729+0000","last_undegraded":"2024-05-10T14:07:30.337729+0000","last_fullsized":"2024-05-10T14:07:30.337729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:30.337517+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.337517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:27.544286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"151'25","reported_seq":74,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.120169+0000","last_change":"2024-05-10T14:07:24.120261+0000","last_active":"2024-05-10T14:07:24.120169+0000","last_peered":"2024-05-10T14:07:24.120169+0000","last_clean":"2024-05-10T14:07:24.120169+0000","last_became_active":"2024-05-10T14:06:56.355087+0000","last_became_peered":"2024-05-10T14:06:56.355087+0000","last_unstale":"2024-05-10T14:07:24.120169+0000","last_undegraded":"2024-05-10T14:07:24.120169+0000","last_fullsized":"2024-05-10T14:07:24.120169+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:24.119966+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.119966+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:19.091644+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:22.313330+0000","last_change":"2024-05-10T14:07:22.313330+0000","last_active":"2024-05-10T14:07:22.313330+0000","last_peered":"2024-05-10T14:07:22.313330+0000","last_clean":"2024-05-10T14:07:22.313330+0000","last_became_active":"2024-05-10T14:02:38.711147+0000","last_became_peered":"2024-05-10T14:02:38.711147+0000","last_unstale":"2024-05-10T14:07:22.313330+0000","last_undegraded":"2024-05-10T14:07:22.313330+0000","last_fullsized":"2024-05-10T14:07:22.313330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:22.313230+0000","last_clean_scrub_stamp":"2024-05-10T14:07:22.313230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.934216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":260,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.536735+0000","last_change":"2024-05-10T14:07:48.536790+0000","last_active":"2024-05-10T14:07:48.536735+0000","last_peered":"2024-05-10T14:07:48.536735+0000","last_clean":"2024-05-10T14:07:48.536735+0000","last_became_active":"2024-05-10T14:06:56.377009+0000","last_became_peered":"2024-05-10T14:06:56.377009+0000","last_unstale":"2024-05-10T14:07:48.536735+0000","last_undegraded":"2024-05-10T14:07:48.536735+0000","last_fullsized":"2024-05-10T14:07:48.536735+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.536510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.536510+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.536510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:24:48.074159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.633501+0000","last_change":"2024-05-10T14:07:46.633555+0000","last_active":"2024-05-10T14:07:46.633501+0000","last_peered":"2024-05-10T14:07:46.633501+0000","last_clean":"2024-05-10T14:07:46.633501+0000","last_became_active":"2024-05-10T14:02:32.684677+0000","last_became_peered":"2024-05-10T14:02:32.684677+0000","last_unstale":"2024-05-10T14:07:46.633501+0000","last_undegraded":"2024-05-10T14:07:46.633501+0000","last_fullsized":"2024-05-10T14:07:46.633501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.633304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.633304+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.633304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:41:14.598165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":67,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.911515+0000","last_change":"2024-05-10T14:07:37.911659+0000","last_active":"2024-05-10T14:07:37.911515+0000","last_peered":"2024-05-10T14:07:37.911515+0000","last_clean":"2024-05-10T14:07:37.911515+0000","last_became_active":"2024-05-10T14:06:12.293187+0000","last_became_peered":"2024-05-10T14:06:12.293187+0000","last_unstale":"2024-05-10T14:07:37.911515+0000","last_undegraded":"2024-05-10T14:07:37.911515+0000","last_fullsized":"2024-05-10T14:07:37.911515+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.911259+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.911259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:19.020325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.685681+0000","last_change":"2024-05-10T14:07:33.685681+0000","last_active":"2024-05-10T14:07:33.685681+0000","last_peered":"2024-05-10T14:07:33.685681+0000","last_clean":"2024-05-10T14:07:33.685681+0000","last_became_active":"2024-05-10T14:02:34.681714+0000","last_became_peered":"2024-05-10T14:02:34.681714+0000","last_unstale":"2024-05-10T14:07:33.685681+0000","last_undegraded":"2024-05-10T14:07:33.685681+0000","last_fullsized":"2024-05-10T14:07:33.685681+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.685427+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.685427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:49.104767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"151'19","reported_seq":294,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.748857+0000","last_change":"2024-05-10T14:07:35.748938+0000","last_active":"2024-05-10T14:07:35.748857+0000","last_peered":"2024-05-10T14:07:35.748857+0000","last_clean":"2024-05-10T14:07:35.748857+0000","last_became_active":"2024-05-10T14:02:36.759240+0000","last_became_peered":"2024-05-10T14:02:36.759240+0000","last_unstale":"2024-05-10T14:07:35.748857+0000","last_undegraded":"2024-05-10T14:07:35.748857+0000","last_fullsized":"2024-05-10T14:07:35.748857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'19","last_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_deep_scrub":"151'19","last_deep_scrub_stamp":"2024-05-10T14:07:35.748668+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.748668+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:43.158045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.357623+0000","last_change":"2024-05-10T14:07:24.357756+0000","last_active":"2024-05-10T14:07:24.357623+0000","last_peered":"2024-05-10T14:07:24.357623+0000","last_clean":"2024-05-10T14:07:24.357623+0000","last_became_active":"2024-05-10T14:02:38.730178+0000","last_became_peered":"2024-05-10T14:02:38.730178+0000","last_unstale":"2024-05-10T14:07:24.357623+0000","last_undegraded":"2024-05-10T14:07:24.357623+0000","last_fullsized":"2024-05-10T14:07:24.357623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.357369+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.357369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:06.230763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:55.594199+0000","last_change":"2024-05-10T14:07:55.594350+0000","last_active":"2024-05-10T14:07:55.594199+0000","last_peered":"2024-05-10T14:07:55.594199+0000","last_clean":"2024-05-10T14:07:55.594199+0000","last_became_active":"2024-05-10T14:06:56.383588+0000","last_became_peered":"2024-05-10T14:06:56.383588+0000","last_unstale":"2024-05-10T14:07:55.594199+0000","last_undegraded":"2024-05-10T14:07:55.594199+0000","last_fullsized":"2024-05-10T14:07:55.594199+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:55.593978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:55.593978+0000","last_clean_scrub_stamp":"2024-05-10T14:07:55.593978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:54:28.225035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.905735+0000","last_change":"2024-05-10T14:07:33.905800+0000","last_active":"2024-05-10T14:07:33.905735+0000","last_peered":"2024-05-10T14:07:33.905735+0000","last_clean":"2024-05-10T14:07:33.905735+0000","last_became_active":"2024-05-10T14:02:32.687227+0000","last_became_peered":"2024-05-10T14:02:32.687227+0000","last_unstale":"2024-05-10T14:07:33.905735+0000","last_undegraded":"2024-05-10T14:07:33.905735+0000","last_fullsized":"2024-05-10T14:07:33.905735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:33.905512+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.905512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:23.202136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.823161+0000","last_change":"2024-05-10T14:07:46.823298+0000","last_active":"2024-05-10T14:07:46.823161+0000","last_peered":"2024-05-10T14:07:46.823161+0000","last_clean":"2024-05-10T14:07:46.823161+0000","last_became_active":"2024-05-10T14:02:30.639486+0000","last_became_peered":"2024-05-10T14:02:30.639486+0000","last_unstale":"2024-05-10T14:07:46.823161+0000","last_undegraded":"2024-05-10T14:07:46.823161+0000","last_fullsized":"2024-05-10T14:07:46.823161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.822924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.822924+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.822924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:05:47.679993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:23.308065+0000","last_change":"2024-05-10T14:07:23.308065+0000","last_active":"2024-05-10T14:07:23.308065+0000","last_peered":"2024-05-10T14:07:23.308065+0000","last_clean":"2024-05-10T14:07:23.308065+0000","last_became_active":"2024-05-10T14:02:34.698884+0000","last_became_peered":"2024-05-10T14:02:34.698884+0000","last_unstale":"2024-05-10T14:07:23.308065+0000","last_undegraded":"2024-05-10T14:07:23.308065+0000","last_fullsized":"2024-05-10T14:07:23.308065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:23.307952+0000","last_clean_scrub_stamp":"2024-05-10T14:07:23.307952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:18:33.043262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"151'15","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:51.908990+0000","last_change":"2024-05-10T14:07:51.909094+0000","last_active":"2024-05-10T14:07:51.908990+0000","last_peered":"2024-05-10T14:07:51.908990+0000","last_clean":"2024-05-10T14:07:51.908990+0000","last_became_active":"2024-05-10T14:02:36.759700+0000","last_became_peered":"2024-05-10T14:02:36.759700+0000","last_unstale":"2024-05-10T14:07:51.908990+0000","last_undegraded":"2024-05-10T14:07:51.908990+0000","last_fullsized":"2024-05-10T14:07:51.908990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'15","last_scrub_stamp":"2024-05-10T14:07:51.908765+0000","last_deep_scrub":"151'15","last_deep_scrub_stamp":"2024-05-10T14:07:51.908765+0000","last_clean_scrub_stamp":"2024-05-10T14:07:51.908765+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.318141+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"151'18","reported_seq":293,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.357918+0000","last_change":"2024-05-10T14:07:26.357993+0000","last_active":"2024-05-10T14:07:26.357918+0000","last_peered":"2024-05-10T14:07:26.357918+0000","last_clean":"2024-05-10T14:07:26.357918+0000","last_became_active":"2024-05-10T14:02:38.714198+0000","last_became_peered":"2024-05-10T14:02:38.714198+0000","last_unstale":"2024-05-10T14:07:26.357918+0000","last_undegraded":"2024-05-10T14:07:26.357918+0000","last_fullsized":"2024-05-10T14:07:26.357918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'18","last_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_deep_scrub":"151'18","last_deep_scrub_stamp":"2024-05-10T14:07:26.357703+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.357703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:47:44.029068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.155101+0000","last_change":"2024-05-10T14:07:26.155160+0000","last_active":"2024-05-10T14:07:26.155101+0000","last_peered":"2024-05-10T14:07:26.155101+0000","last_clean":"2024-05-10T14:07:26.155101+0000","last_became_active":"2024-05-10T14:06:56.396838+0000","last_became_peered":"2024-05-10T14:06:56.396838+0000","last_unstale":"2024-05-10T14:07:26.155101+0000","last_undegraded":"2024-05-10T14:07:26.155101+0000","last_fullsized":"2024-05-10T14:07:26.155101+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.154906+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.154906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:47:49.825316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:46.804267+0000","last_change":"2024-05-10T14:07:46.804325+0000","last_active":"2024-05-10T14:07:46.804267+0000","last_peered":"2024-05-10T14:07:46.804267+0000","last_clean":"2024-05-10T14:07:46.804267+0000","last_became_active":"2024-05-10T14:02:32.672585+0000","last_became_peered":"2024-05-10T14:02:32.672585+0000","last_unstale":"2024-05-10T14:07:46.804267+0000","last_undegraded":"2024-05-10T14:07:46.804267+0000","last_fullsized":"2024-05-10T14:07:46.804267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:46.804069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:46.804069+0000","last_clean_scrub_stamp":"2024-05-10T14:07:46.804069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:35.164005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.590161+0000","last_change":"2024-05-10T14:07:28.590216+0000","last_active":"2024-05-10T14:07:28.590161+0000","last_peered":"2024-05-10T14:07:28.590161+0000","last_clean":"2024-05-10T14:07:28.590161+0000","last_became_active":"2024-05-10T14:04:06.313887+0000","last_became_peered":"2024-05-10T14:04:06.313887+0000","last_unstale":"2024-05-10T14:07:28.590161+0000","last_undegraded":"2024-05-10T14:07:28.590161+0000","last_fullsized":"2024-05-10T14:07:28.590161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.589947+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.589947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:04:13.568622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.053296+0000","last_change":"2024-05-10T14:07:44.053402+0000","last_active":"2024-05-10T14:07:44.053296+0000","last_peered":"2024-05-10T14:07:44.053296+0000","last_clean":"2024-05-10T14:07:44.053296+0000","last_became_active":"2024-05-10T14:06:56.348688+0000","last_became_peered":"2024-05-10T14:06:56.348688+0000","last_unstale":"2024-05-10T14:07:44.053296+0000","last_undegraded":"2024-05-10T14:07:44.053296+0000","last_fullsized":"2024-05-10T14:07:44.053296+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.053068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.053068+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.053068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:10:00.556250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"151'25","reported_seq":236,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.675524+0000","last_change":"2024-05-10T14:07:45.675691+0000","last_active":"2024-05-10T14:07:45.675524+0000","last_peered":"2024-05-10T14:07:45.675524+0000","last_clean":"2024-05-10T14:07:45.675524+0000","last_became_active":"2024-05-10T14:04:06.302598+0000","last_became_peered":"2024-05-10T14:04:06.302598+0000","last_unstale":"2024-05-10T14:07:45.675524+0000","last_undegraded":"2024-05-10T14:07:45.675524+0000","last_fullsized":"2024-05-10T14:07:45.675524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'25","last_scrub_stamp":"2024-05-10T14:07:45.675181+0000","last_deep_scrub":"151'25","last_deep_scrub_stamp":"2024-05-10T14:07:45.675181+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.675181+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:48:35.010311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.934930+0000","last_change":"2024-05-10T14:07:29.934930+0000","last_active":"2024-05-10T14:07:29.934930+0000","last_peered":"2024-05-10T14:07:29.934930+0000","last_clean":"2024-05-10T14:07:29.934930+0000","last_became_active":"2024-05-10T14:02:38.721282+0000","last_became_peered":"2024-05-10T14:02:38.721282+0000","last_unstale":"2024-05-10T14:07:29.934930+0000","last_undegraded":"2024-05-10T14:07:29.934930+0000","last_fullsized":"2024-05-10T14:07:29.934930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:29.934670+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.934670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:41:51.345933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.071225+0000","last_change":"2024-05-10T14:07:50.071285+0000","last_active":"2024-05-10T14:07:50.071225+0000","last_peered":"2024-05-10T14:07:50.071225+0000","last_clean":"2024-05-10T14:07:50.071225+0000","last_became_active":"2024-05-10T14:06:56.355875+0000","last_became_peered":"2024-05-10T14:06:56.355875+0000","last_unstale":"2024-05-10T14:07:50.071225+0000","last_undegraded":"2024-05-10T14:07:50.071225+0000","last_fullsized":"2024-05-10T14:07:50.071225+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.071027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.071027+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.071027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:29.029200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.891505+0000","last_change":"2024-05-10T14:07:50.891569+0000","last_active":"2024-05-10T14:07:50.891505+0000","last_peered":"2024-05-10T14:07:50.891505+0000","last_clean":"2024-05-10T14:07:50.891505+0000","last_became_active":"2024-05-10T14:02:32.674899+0000","last_became_peered":"2024-05-10T14:02:32.674899+0000","last_unstale":"2024-05-10T14:07:50.891505+0000","last_undegraded":"2024-05-10T14:07:50.891505+0000","last_fullsized":"2024-05-10T14:07:50.891505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.891282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.891282+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.891282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:11.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.697852+0000","last_change":"2024-05-10T14:07:48.697912+0000","last_active":"2024-05-10T14:07:48.697852+0000","last_peered":"2024-05-10T14:07:48.697852+0000","last_clean":"2024-05-10T14:07:48.697852+0000","last_became_active":"2024-05-10T14:04:06.308402+0000","last_became_peered":"2024-05-10T14:04:06.308402+0000","last_unstale":"2024-05-10T14:07:48.697852+0000","last_undegraded":"2024-05-10T14:07:48.697852+0000","last_fullsized":"2024-05-10T14:07:48.697852+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.697663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.697663+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.697663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:47:22.871090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:27.580771+0000","last_change":"2024-05-10T14:07:27.580831+0000","last_active":"2024-05-10T14:07:27.580771+0000","last_peered":"2024-05-10T14:07:27.580771+0000","last_clean":"2024-05-10T14:07:27.580771+0000","last_became_active":"2024-05-10T14:04:06.316443+0000","last_became_peered":"2024-05-10T14:04:06.316443+0000","last_unstale":"2024-05-10T14:07:27.580771+0000","last_undegraded":"2024-05-10T14:07:27.580771+0000","last_fullsized":"2024-05-10T14:07:27.580771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:27.580569+0000","last_clean_scrub_stamp":"2024-05-10T14:07:27.580569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:57:31.176260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"151'16","reported_seq":287,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:30.920255+0000","last_change":"2024-05-10T14:07:30.920335+0000","last_active":"2024-05-10T14:07:30.920255+0000","last_peered":"2024-05-10T14:07:30.920255+0000","last_clean":"2024-05-10T14:07:30.920255+0000","last_became_active":"2024-05-10T14:02:36.694479+0000","last_became_peered":"2024-05-10T14:02:36.694479+0000","last_unstale":"2024-05-10T14:07:30.920255+0000","last_undegraded":"2024-05-10T14:07:30.920255+0000","last_fullsized":"2024-05-10T14:07:30.920255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'16","last_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_deep_scrub":"151'16","last_deep_scrub_stamp":"2024-05-10T14:07:30.920046+0000","last_clean_scrub_stamp":"2024-05-10T14:07:30.920046+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:31.155143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.491933+0000","last_change":"2024-05-10T14:07:47.492059+0000","last_active":"2024-05-10T14:07:47.491933+0000","last_peered":"2024-05-10T14:07:47.491933+0000","last_clean":"2024-05-10T14:07:47.491933+0000","last_became_active":"2024-05-10T14:06:56.375910+0000","last_became_peered":"2024-05-10T14:06:56.375910+0000","last_unstale":"2024-05-10T14:07:47.491933+0000","last_undegraded":"2024-05-10T14:07:47.491933+0000","last_fullsized":"2024-05-10T14:07:47.491933+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.491675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.491675+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.491675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:32.995073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.673929+0000","last_change":"2024-05-10T14:07:28.673929+0000","last_active":"2024-05-10T14:07:28.673929+0000","last_peered":"2024-05-10T14:07:28.673929+0000","last_clean":"2024-05-10T14:07:28.673929+0000","last_became_active":"2024-05-10T14:02:40.756457+0000","last_became_peered":"2024-05-10T14:02:40.756457+0000","last_unstale":"2024-05-10T14:07:28.673929+0000","last_undegraded":"2024-05-10T14:07:28.673929+0000","last_fullsized":"2024-05-10T14:07:28.673929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.673633+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.673633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:23:54.235533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.619959+0000","last_change":"2024-05-10T14:07:54.620019+0000","last_active":"2024-05-10T14:07:54.619959+0000","last_peered":"2024-05-10T14:07:54.619959+0000","last_clean":"2024-05-10T14:07:54.619959+0000","last_became_active":"2024-05-10T14:02:32.663969+0000","last_became_peered":"2024-05-10T14:02:32.663969+0000","last_unstale":"2024-05-10T14:07:54.619959+0000","last_undegraded":"2024-05-10T14:07:54.619959+0000","last_fullsized":"2024-05-10T14:07:54.619959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.619722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.619722+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.619722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:43:19.666589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"151'2","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:53.636959+0000","last_change":"2024-05-10T14:07:53.637029+0000","last_active":"2024-05-10T14:07:53.636959+0000","last_peered":"2024-05-10T14:07:53.636959+0000","last_clean":"2024-05-10T14:07:53.636959+0000","last_became_active":"2024-05-10T14:02:30.650743+0000","last_became_peered":"2024-05-10T14:02:30.650743+0000","last_unstale":"2024-05-10T14:07:53.636959+0000","last_undegraded":"2024-05-10T14:07:53.636959+0000","last_fullsized":"2024-05-10T14:07:53.636959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:53.636766+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:53.636766+0000","last_clean_scrub_stamp":"2024-05-10T14:07:53.636766+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:24.532748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:35.676906+0000","last_change":"2024-05-10T14:07:35.676964+0000","last_active":"2024-05-10T14:07:35.676906+0000","last_peered":"2024-05-10T14:07:35.676906+0000","last_clean":"2024-05-10T14:07:35.676906+0000","last_became_active":"2024-05-10T14:02:34.693074+0000","last_became_peered":"2024-05-10T14:02:34.693074+0000","last_unstale":"2024-05-10T14:07:35.676906+0000","last_undegraded":"2024-05-10T14:07:35.676906+0000","last_fullsized":"2024-05-10T14:07:35.676906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:35.676718+0000","last_clean_scrub_stamp":"2024-05-10T14:07:35.676718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:17:32.704938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"151'11","reported_seq":305,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:08:02.651694+0000","last_change":"2024-05-10T14:08:02.651772+0000","last_active":"2024-05-10T14:08:02.651694+0000","last_peered":"2024-05-10T14:08:02.651694+0000","last_clean":"2024-05-10T14:08:02.651694+0000","last_became_active":"2024-05-10T14:06:56.375290+0000","last_became_peered":"2024-05-10T14:06:56.375290+0000","last_unstale":"2024-05-10T14:08:02.651694+0000","last_undegraded":"2024-05-10T14:08:02.651694+0000","last_fullsized":"2024-05-10T14:08:02.651694+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'11","last_scrub_stamp":"2024-05-10T14:08:02.651479+0000","last_deep_scrub":"151'11","last_deep_scrub_stamp":"2024-05-10T14:08:02.651479+0000","last_clean_scrub_stamp":"2024-05-10T14:08:02.651479+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:49:41.811257+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.607383+0000","last_change":"2024-05-10T14:07:24.607383+0000","last_active":"2024-05-10T14:07:24.607383+0000","last_peered":"2024-05-10T14:07:24.607383+0000","last_clean":"2024-05-10T14:07:24.607383+0000","last_became_active":"2024-05-10T14:02:38.709338+0000","last_became_peered":"2024-05-10T14:02:38.709338+0000","last_unstale":"2024-05-10T14:07:24.607383+0000","last_undegraded":"2024-05-10T14:07:24.607383+0000","last_fullsized":"2024-05-10T14:07:24.607383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.607117+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.607117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:43.526323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.096405+0000","last_change":"2024-05-10T14:07:41.096459+0000","last_active":"2024-05-10T14:07:41.096405+0000","last_peered":"2024-05-10T14:07:41.096405+0000","last_clean":"2024-05-10T14:07:41.096405+0000","last_became_active":"2024-05-10T14:06:56.394375+0000","last_became_peered":"2024-05-10T14:06:56.394375+0000","last_unstale":"2024-05-10T14:07:41.096405+0000","last_undegraded":"2024-05-10T14:07:41.096405+0000","last_fullsized":"2024-05-10T14:07:41.096405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.096206+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.096206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:23.589611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.636395+0000","last_change":"2024-05-10T14:07:38.636490+0000","last_active":"2024-05-10T14:07:38.636395+0000","last_peered":"2024-05-10T14:07:38.636395+0000","last_clean":"2024-05-10T14:07:38.636395+0000","last_became_active":"2024-05-10T14:02:32.678941+0000","last_became_peered":"2024-05-10T14:02:32.678941+0000","last_unstale":"2024-05-10T14:07:38.636395+0000","last_undegraded":"2024-05-10T14:07:38.636395+0000","last_fullsized":"2024-05-10T14:07:38.636395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.636149+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.636149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:24.139548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":279,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.968095+0000","last_change":"2024-05-10T14:07:25.968201+0000","last_active":"2024-05-10T14:07:25.968095+0000","last_peered":"2024-05-10T14:07:25.968095+0000","last_clean":"2024-05-10T14:07:25.968095+0000","last_became_active":"2024-05-10T14:04:06.329359+0000","last_became_peered":"2024-05-10T14:04:06.329359+0000","last_unstale":"2024-05-10T14:07:25.968095+0000","last_undegraded":"2024-05-10T14:07:25.968095+0000","last_fullsized":"2024-05-10T14:07:25.968095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.967836+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.967836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:06.239366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"151'2","reported_seq":272,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:34.462243+0000","last_change":"2024-05-10T14:07:34.462313+0000","last_active":"2024-05-10T14:07:34.462243+0000","last_peered":"2024-05-10T14:07:34.462243+0000","last_clean":"2024-05-10T14:07:34.462243+0000","last_became_active":"2024-05-10T14:04:06.305534+0000","last_became_peered":"2024-05-10T14:04:06.305534+0000","last_unstale":"2024-05-10T14:07:34.462243+0000","last_undegraded":"2024-05-10T14:07:34.462243+0000","last_fullsized":"2024-05-10T14:07:34.462243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:34.462056+0000","last_clean_scrub_stamp":"2024-05-10T14:07:34.462056+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:20.507444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"151'17","reported_seq":297,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.788450+0000","last_change":"2024-05-10T14:07:57.788535+0000","last_active":"2024-05-10T14:07:57.788450+0000","last_peered":"2024-05-10T14:07:57.788450+0000","last_clean":"2024-05-10T14:07:57.788450+0000","last_became_active":"2024-05-10T14:04:06.321215+0000","last_became_peered":"2024-05-10T14:04:06.321215+0000","last_unstale":"2024-05-10T14:07:57.788450+0000","last_undegraded":"2024-05-10T14:07:57.788450+0000","last_fullsized":"2024-05-10T14:07:57.788450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'17","last_scrub_stamp":"2024-05-10T14:07:57.788223+0000","last_deep_scrub":"151'17","last_deep_scrub_stamp":"2024-05-10T14:07:57.788223+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.788223+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:34.943950+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":256,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.895329+0000","last_change":"2024-05-10T14:07:33.895329+0000","last_active":"2024-05-10T14:07:33.895329+0000","last_peered":"2024-05-10T14:07:33.895329+0000","last_clean":"2024-05-10T14:07:33.895329+0000","last_became_active":"2024-05-10T14:02:38.726660+0000","last_became_peered":"2024-05-10T14:02:38.726660+0000","last_unstale":"2024-05-10T14:07:33.895329+0000","last_undegraded":"2024-05-10T14:07:33.895329+0000","last_fullsized":"2024-05-10T14:07:33.895329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.894965+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.894965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:13:22.254901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":254,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.938387+0000","last_change":"2024-05-10T14:07:52.938446+0000","last_active":"2024-05-10T14:07:52.938387+0000","last_peered":"2024-05-10T14:07:52.938387+0000","last_clean":"2024-05-10T14:07:52.938387+0000","last_became_active":"2024-05-10T14:02:40.726075+0000","last_became_peered":"2024-05-10T14:02:40.726075+0000","last_unstale":"2024-05-10T14:07:52.938387+0000","last_undegraded":"2024-05-10T14:07:52.938387+0000","last_fullsized":"2024-05-10T14:07:52.938387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.938193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.938193+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.938193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:52:18.617227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"151'2","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:29.393384+0000","last_change":"2024-05-10T14:07:29.393455+0000","last_active":"2024-05-10T14:07:29.393384+0000","last_peered":"2024-05-10T14:07:29.393384+0000","last_clean":"2024-05-10T14:07:29.393384+0000","last_became_active":"2024-05-10T14:02:32.696732+0000","last_became_peered":"2024-05-10T14:02:32.696732+0000","last_unstale":"2024-05-10T14:07:29.393384+0000","last_undegraded":"2024-05-10T14:07:29.393384+0000","last_fullsized":"2024-05-10T14:07:29.393384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:29.393159+0000","last_clean_scrub_stamp":"2024-05-10T14:07:29.393159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:00.930447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.340471+0000","last_change":"2024-05-10T14:07:36.340528+0000","last_active":"2024-05-10T14:07:36.340471+0000","last_peered":"2024-05-10T14:07:36.340471+0000","last_clean":"2024-05-10T14:07:36.340471+0000","last_became_active":"2024-05-10T14:02:30.655138+0000","last_became_peered":"2024-05-10T14:02:30.655138+0000","last_unstale":"2024-05-10T14:07:36.340471+0000","last_undegraded":"2024-05-10T14:07:36.340471+0000","last_fullsized":"2024-05-10T14:07:36.340471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.340267+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.340267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:08:14.747404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.411067+0000","last_change":"2024-05-10T14:07:33.411126+0000","last_active":"2024-05-10T14:07:33.411067+0000","last_peered":"2024-05-10T14:07:33.411067+0000","last_clean":"2024-05-10T14:07:33.411067+0000","last_became_active":"2024-05-10T14:02:32.692920+0000","last_became_peered":"2024-05-10T14:02:32.692920+0000","last_unstale":"2024-05-10T14:07:33.411067+0000","last_undegraded":"2024-05-10T14:07:33.411067+0000","last_fullsized":"2024-05-10T14:07:33.411067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.410857+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.410857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:50.448699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.015430+0000","last_change":"2024-05-10T14:07:26.015489+0000","last_active":"2024-05-10T14:07:26.015430+0000","last_peered":"2024-05-10T14:07:26.015430+0000","last_clean":"2024-05-10T14:07:26.015430+0000","last_became_active":"2024-05-10T14:04:06.320152+0000","last_became_peered":"2024-05-10T14:04:06.320152+0000","last_unstale":"2024-05-10T14:07:26.015430+0000","last_undegraded":"2024-05-10T14:07:26.015430+0000","last_fullsized":"2024-05-10T14:07:26.015430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:26.015233+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.015233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:27:52.736449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":196,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:56.607194+0000","last_change":"2024-05-10T14:07:56.607255+0000","last_active":"2024-05-10T14:07:56.607194+0000","last_peered":"2024-05-10T14:07:56.607194+0000","last_clean":"2024-05-10T14:07:56.607194+0000","last_became_active":"2024-05-10T14:06:56.383337+0000","last_became_peered":"2024-05-10T14:06:56.383337+0000","last_unstale":"2024-05-10T14:07:56.607194+0000","last_undegraded":"2024-05-10T14:07:56.607194+0000","last_fullsized":"2024-05-10T14:07:56.607194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:56.606933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:56.606933+0000","last_clean_scrub_stamp":"2024-05-10T14:07:56.606933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:03.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":186,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.677408+0000","last_change":"2024-05-10T14:07:47.677408+0000","last_active":"2024-05-10T14:07:47.677408+0000","last_peered":"2024-05-10T14:07:47.677408+0000","last_clean":"2024-05-10T14:07:47.677408+0000","last_became_active":"2024-05-10T14:04:06.304819+0000","last_became_peered":"2024-05-10T14:04:06.304819+0000","last_unstale":"2024-05-10T14:07:47.677408+0000","last_undegraded":"2024-05-10T14:07:47.677408+0000","last_fullsized":"2024-05-10T14:07:47.677408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.677146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.677146+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.677146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:11.354851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:50.488503+0000","last_change":"2024-05-10T14:07:50.488565+0000","last_active":"2024-05-10T14:07:50.488503+0000","last_peered":"2024-05-10T14:07:50.488503+0000","last_clean":"2024-05-10T14:07:50.488503+0000","last_became_active":"2024-05-10T14:06:56.383230+0000","last_became_peered":"2024-05-10T14:06:56.383230+0000","last_unstale":"2024-05-10T14:07:50.488503+0000","last_undegraded":"2024-05-10T14:07:50.488503+0000","last_fullsized":"2024-05-10T14:07:50.488503+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:50.488286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:50.488286+0000","last_clean_scrub_stamp":"2024-05-10T14:07:50.488286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:28:30.610434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":277,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:24.974978+0000","last_change":"2024-05-10T14:07:24.975077+0000","last_active":"2024-05-10T14:07:24.974978+0000","last_peered":"2024-05-10T14:07:24.974978+0000","last_clean":"2024-05-10T14:07:24.974978+0000","last_became_active":"2024-05-10T14:03:11.211057+0000","last_became_peered":"2024-05-10T14:03:11.211057+0000","last_unstale":"2024-05-10T14:07:24.974978+0000","last_undegraded":"2024-05-10T14:07:24.974978+0000","last_fullsized":"2024-05-10T14:07:24.974978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:24.974724+0000","last_clean_scrub_stamp":"2024-05-10T14:07:24.974724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:57.874035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":281,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:57.656082+0000","last_change":"2024-05-10T14:07:57.656139+0000","last_active":"2024-05-10T14:07:57.656082+0000","last_peered":"2024-05-10T14:07:57.656082+0000","last_clean":"2024-05-10T14:07:57.656082+0000","last_became_active":"2024-05-10T14:06:56.373840+0000","last_became_peered":"2024-05-10T14:06:56.373840+0000","last_unstale":"2024-05-10T14:07:57.656082+0000","last_undegraded":"2024-05-10T14:07:57.656082+0000","last_fullsized":"2024-05-10T14:07:57.656082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:57.655844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:57.655844+0000","last_clean_scrub_stamp":"2024-05-10T14:07:57.655844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:47.193985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:25.703198+0000","last_change":"2024-05-10T14:07:25.703260+0000","last_active":"2024-05-10T14:07:25.703198+0000","last_peered":"2024-05-10T14:07:25.703198+0000","last_clean":"2024-05-10T14:07:25.703198+0000","last_became_active":"2024-05-10T14:06:12.276751+0000","last_became_peered":"2024-05-10T14:06:12.276751+0000","last_unstale":"2024-05-10T14:07:25.703198+0000","last_undegraded":"2024-05-10T14:07:25.703198+0000","last_fullsized":"2024-05-10T14:07:25.703198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:25.703009+0000","last_clean_scrub_stamp":"2024-05-10T14:07:25.703009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:07:49.335815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.654654+0000","last_change":"2024-05-10T14:07:28.654715+0000","last_active":"2024-05-10T14:07:28.654654+0000","last_peered":"2024-05-10T14:07:28.654654+0000","last_clean":"2024-05-10T14:07:28.654654+0000","last_became_active":"2024-05-10T14:02:32.694182+0000","last_became_peered":"2024-05-10T14:02:32.694182+0000","last_unstale":"2024-05-10T14:07:28.654654+0000","last_undegraded":"2024-05-10T14:07:28.654654+0000","last_fullsized":"2024-05-10T14:07:28.654654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.654459+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.654459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:03.589053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.485915+0000","last_change":"2024-05-10T14:07:43.485974+0000","last_active":"2024-05-10T14:07:43.485915+0000","last_peered":"2024-05-10T14:07:43.485915+0000","last_clean":"2024-05-10T14:07:43.485915+0000","last_became_active":"2024-05-10T14:02:30.642789+0000","last_became_peered":"2024-05-10T14:02:30.642789+0000","last_unstale":"2024-05-10T14:07:43.485915+0000","last_undegraded":"2024-05-10T14:07:43.485915+0000","last_fullsized":"2024-05-10T14:07:43.485915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.485705+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:08:06.431514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.734567+0000","last_change":"2024-05-10T14:07:42.734627+0000","last_active":"2024-05-10T14:07:42.734567+0000","last_peered":"2024-05-10T14:07:42.734567+0000","last_clean":"2024-05-10T14:07:42.734567+0000","last_became_active":"2024-05-10T14:02:32.689862+0000","last_became_peered":"2024-05-10T14:02:32.689862+0000","last_unstale":"2024-05-10T14:07:42.734567+0000","last_undegraded":"2024-05-10T14:07:42.734567+0000","last_fullsized":"2024-05-10T14:07:42.734567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.734296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.734296+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.734296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:33:39.297565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":280,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:45.462413+0000","last_change":"2024-05-10T14:07:45.462474+0000","last_active":"2024-05-10T14:07:45.462413+0000","last_peered":"2024-05-10T14:07:45.462413+0000","last_clean":"2024-05-10T14:07:45.462413+0000","last_became_active":"2024-05-10T14:06:56.374572+0000","last_became_peered":"2024-05-10T14:06:56.374572+0000","last_unstale":"2024-05-10T14:07:45.462413+0000","last_undegraded":"2024-05-10T14:07:45.462413+0000","last_fullsized":"2024-05-10T14:07:45.462413+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:45.462199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:45.462199+0000","last_clean_scrub_stamp":"2024-05-10T14:07:45.462199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T23:19:19.312424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":266,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:37.388125+0000","last_change":"2024-05-10T14:07:37.388183+0000","last_active":"2024-05-10T14:07:37.388125+0000","last_peered":"2024-05-10T14:07:37.388125+0000","last_clean":"2024-05-10T14:07:37.388125+0000","last_became_active":"2024-05-10T14:02:32.671933+0000","last_became_peered":"2024-05-10T14:02:32.671933+0000","last_unstale":"2024-05-10T14:07:37.388125+0000","last_undegraded":"2024-05-10T14:07:37.388125+0000","last_fullsized":"2024-05-10T14:07:37.388125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:37.387927+0000","last_clean_scrub_stamp":"2024-05-10T14:07:37.387927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:51.637579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:47.589033+0000","last_change":"2024-05-10T14:07:47.589087+0000","last_active":"2024-05-10T14:07:47.589033+0000","last_peered":"2024-05-10T14:07:47.589033+0000","last_clean":"2024-05-10T14:07:47.589033+0000","last_became_active":"2024-05-10T14:02:30.624646+0000","last_became_peered":"2024-05-10T14:02:30.624646+0000","last_unstale":"2024-05-10T14:07:47.589033+0000","last_undegraded":"2024-05-10T14:07:47.589033+0000","last_fullsized":"2024-05-10T14:07:47.589033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:47.588837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:47.588837+0000","last_clean_scrub_stamp":"2024-05-10T14:07:47.588837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:26.322625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.770029+0000","last_change":"2024-05-10T14:07:49.770085+0000","last_active":"2024-05-10T14:07:49.770029+0000","last_peered":"2024-05-10T14:07:49.770029+0000","last_clean":"2024-05-10T14:07:49.770029+0000","last_became_active":"2024-05-10T14:02:32.677062+0000","last_became_peered":"2024-05-10T14:02:32.677062+0000","last_unstale":"2024-05-10T14:07:49.770029+0000","last_undegraded":"2024-05-10T14:07:49.770029+0000","last_fullsized":"2024-05-10T14:07:49.770029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.769797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.769797+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.769797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:52:42.633729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.596591+0000","last_change":"2024-05-10T14:07:38.596644+0000","last_active":"2024-05-10T14:07:38.596591+0000","last_peered":"2024-05-10T14:07:38.596591+0000","last_clean":"2024-05-10T14:07:38.596591+0000","last_became_active":"2024-05-10T14:04:06.308703+0000","last_became_peered":"2024-05-10T14:04:06.308703+0000","last_unstale":"2024-05-10T14:07:38.596591+0000","last_undegraded":"2024-05-10T14:07:38.596591+0000","last_fullsized":"2024-05-10T14:07:38.596591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.596387+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.596387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:03.750556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:49.873497+0000","last_change":"2024-05-10T14:07:49.873626+0000","last_active":"2024-05-10T14:07:49.873497+0000","last_peered":"2024-05-10T14:07:49.873497+0000","last_clean":"2024-05-10T14:07:49.873497+0000","last_became_active":"2024-05-10T14:02:32.672947+0000","last_became_peered":"2024-05-10T14:02:32.672947+0000","last_unstale":"2024-05-10T14:07:49.873497+0000","last_undegraded":"2024-05-10T14:07:49.873497+0000","last_fullsized":"2024-05-10T14:07:49.873497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:49.873164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:49.873164+0000","last_clean_scrub_stamp":"2024-05-10T14:07:49.873164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:29:35.743040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":275,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:48.590282+0000","last_change":"2024-05-10T14:07:48.590342+0000","last_active":"2024-05-10T14:07:48.590282+0000","last_peered":"2024-05-10T14:07:48.590282+0000","last_clean":"2024-05-10T14:07:48.590282+0000","last_became_active":"2024-05-10T14:02:30.637191+0000","last_became_peered":"2024-05-10T14:02:30.637191+0000","last_unstale":"2024-05-10T14:07:48.590282+0000","last_undegraded":"2024-05-10T14:07:48.590282+0000","last_fullsized":"2024-05-10T14:07:48.590282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:48.590060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:48.590060+0000","last_clean_scrub_stamp":"2024-05-10T14:07:48.590060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T00:41:53.465233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"151'2","reported_seq":269,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:32.946505+0000","last_change":"2024-05-10T14:07:32.946590+0000","last_active":"2024-05-10T14:07:32.946505+0000","last_peered":"2024-05-10T14:07:32.946505+0000","last_clean":"2024-05-10T14:07:32.946505+0000","last_became_active":"2024-05-10T14:02:32.682124+0000","last_became_peered":"2024-05-10T14:02:32.682124+0000","last_unstale":"2024-05-10T14:07:32.946505+0000","last_undegraded":"2024-05-10T14:07:32.946505+0000","last_fullsized":"2024-05-10T14:07:32.946505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:32.946291+0000","last_clean_scrub_stamp":"2024-05-10T14:07:32.946291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:09.668951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"151'2","reported_seq":240,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.974887+0000","last_change":"2024-05-10T14:07:42.974954+0000","last_active":"2024-05-10T14:07:42.974887+0000","last_peered":"2024-05-10T14:07:42.974887+0000","last_clean":"2024-05-10T14:07:42.974887+0000","last_became_active":"2024-05-10T14:06:56.386684+0000","last_became_peered":"2024-05-10T14:06:56.386684+0000","last_unstale":"2024-05-10T14:07:42.974887+0000","last_undegraded":"2024-05-10T14:07:42.974887+0000","last_fullsized":"2024-05-10T14:07:42.974887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:42.974698+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:42.974698+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.974698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:02.844155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.685592+0000","last_change":"2024-05-10T14:07:42.685658+0000","last_active":"2024-05-10T14:07:42.685592+0000","last_peered":"2024-05-10T14:07:42.685592+0000","last_clean":"2024-05-10T14:07:42.685592+0000","last_became_active":"2024-05-10T14:02:32.676436+0000","last_became_peered":"2024-05-10T14:02:32.676436+0000","last_unstale":"2024-05-10T14:07:42.685592+0000","last_undegraded":"2024-05-10T14:07:42.685592+0000","last_fullsized":"2024-05-10T14:07:42.685592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.685357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.685357+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.685357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:46.179728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":282,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:52.816097+0000","last_change":"2024-05-10T14:07:52.816153+0000","last_active":"2024-05-10T14:07:52.816097+0000","last_peered":"2024-05-10T14:07:52.816097+0000","last_clean":"2024-05-10T14:07:52.816097+0000","last_became_active":"2024-05-10T14:06:56.369702+0000","last_became_peered":"2024-05-10T14:06:56.369702+0000","last_unstale":"2024-05-10T14:07:52.816097+0000","last_undegraded":"2024-05-10T14:07:52.816097+0000","last_fullsized":"2024-05-10T14:07:52.816097+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:52.815877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:52.815877+0000","last_clean_scrub_stamp":"2024-05-10T14:07:52.815877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:35:50.096071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.091026+0000","last_change":"2024-05-10T14:07:43.091086+0000","last_active":"2024-05-10T14:07:43.091026+0000","last_peered":"2024-05-10T14:07:43.091026+0000","last_clean":"2024-05-10T14:07:43.091026+0000","last_became_active":"2024-05-10T14:06:56.346339+0000","last_became_peered":"2024-05-10T14:06:56.346339+0000","last_unstale":"2024-05-10T14:07:43.091026+0000","last_undegraded":"2024-05-10T14:07:43.091026+0000","last_fullsized":"2024-05-10T14:07:43.091026+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.090798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.090798+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.090798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:16.778674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:33.336946+0000","last_change":"2024-05-10T14:07:33.337101+0000","last_active":"2024-05-10T14:07:33.336946+0000","last_peered":"2024-05-10T14:07:33.336946+0000","last_clean":"2024-05-10T14:07:33.336946+0000","last_became_active":"2024-05-10T14:02:30.653254+0000","last_became_peered":"2024-05-10T14:02:30.653254+0000","last_unstale":"2024-05-10T14:07:33.336946+0000","last_undegraded":"2024-05-10T14:07:33.336946+0000","last_fullsized":"2024-05-10T14:07:33.336946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:33.336663+0000","last_clean_scrub_stamp":"2024-05-10T14:07:33.336663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:52.255869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:36.896333+0000","last_change":"2024-05-10T14:07:36.896395+0000","last_active":"2024-05-10T14:07:36.896333+0000","last_peered":"2024-05-10T14:07:36.896333+0000","last_clean":"2024-05-10T14:07:36.896333+0000","last_became_active":"2024-05-10T14:02:32.692106+0000","last_became_peered":"2024-05-10T14:02:32.692106+0000","last_unstale":"2024-05-10T14:07:36.896333+0000","last_undegraded":"2024-05-10T14:07:36.896333+0000","last_fullsized":"2024-05-10T14:07:36.896333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:36.896107+0000","last_clean_scrub_stamp":"2024-05-10T14:07:36.896107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:42:33.864403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:31.222300+0000","last_change":"2024-05-10T14:07:31.222361+0000","last_active":"2024-05-10T14:07:31.222300+0000","last_peered":"2024-05-10T14:07:31.222300+0000","last_clean":"2024-05-10T14:07:31.222300+0000","last_became_active":"2024-05-10T14:06:56.378126+0000","last_became_peered":"2024-05-10T14:06:56.378126+0000","last_unstale":"2024-05-10T14:07:31.222300+0000","last_undegraded":"2024-05-10T14:07:31.222300+0000","last_fullsized":"2024-05-10T14:07:31.222300+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:31.222075+0000","last_clean_scrub_stamp":"2024-05-10T14:07:31.222075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:34.716445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:44.650439+0000","last_change":"2024-05-10T14:07:44.650495+0000","last_active":"2024-05-10T14:07:44.650439+0000","last_peered":"2024-05-10T14:07:44.650439+0000","last_clean":"2024-05-10T14:07:44.650439+0000","last_became_active":"2024-05-10T14:02:32.682926+0000","last_became_peered":"2024-05-10T14:02:32.682926+0000","last_unstale":"2024-05-10T14:07:44.650439+0000","last_undegraded":"2024-05-10T14:07:44.650439+0000","last_fullsized":"2024-05-10T14:07:44.650439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:44.650240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:44.650240+0000","last_clean_scrub_stamp":"2024-05-10T14:07:44.650240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:08.021232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":270,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:28.981090+0000","last_change":"2024-05-10T14:07:28.981147+0000","last_active":"2024-05-10T14:07:28.981090+0000","last_peered":"2024-05-10T14:07:28.981090+0000","last_clean":"2024-05-10T14:07:28.981090+0000","last_became_active":"2024-05-10T14:02:30.650346+0000","last_became_peered":"2024-05-10T14:02:30.650346+0000","last_unstale":"2024-05-10T14:07:28.981090+0000","last_undegraded":"2024-05-10T14:07:28.981090+0000","last_fullsized":"2024-05-10T14:07:28.981090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:28.980896+0000","last_clean_scrub_stamp":"2024-05-10T14:07:28.980896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:10.026254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":45,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:38.192046+0000","last_change":"2024-05-10T14:07:38.192104+0000","last_active":"2024-05-10T14:07:38.192046+0000","last_peered":"2024-05-10T14:07:38.192046+0000","last_clean":"2024-05-10T14:07:38.192046+0000","last_became_active":"2024-05-10T14:06:56.356497+0000","last_became_peered":"2024-05-10T14:06:56.356497+0000","last_unstale":"2024-05-10T14:07:38.192046+0000","last_undegraded":"2024-05-10T14:07:38.192046+0000","last_fullsized":"2024-05-10T14:07:38.192046+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:38.191843+0000","last_clean_scrub_stamp":"2024-05-10T14:07:38.191843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:27.198510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":195,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:54.555277+0000","last_change":"2024-05-10T14:07:54.555386+0000","last_active":"2024-05-10T14:07:54.555277+0000","last_peered":"2024-05-10T14:07:54.555277+0000","last_clean":"2024-05-10T14:07:54.555277+0000","last_became_active":"2024-05-10T14:06:56.382985+0000","last_became_peered":"2024-05-10T14:06:56.382985+0000","last_unstale":"2024-05-10T14:07:54.555277+0000","last_undegraded":"2024-05-10T14:07:54.555277+0000","last_fullsized":"2024-05-10T14:07:54.555277+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:54.554972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:54.554972+0000","last_clean_scrub_stamp":"2024-05-10T14:07:54.554972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:07.913429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":185,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:43.573792+0000","last_change":"2024-05-10T14:07:43.573845+0000","last_active":"2024-05-10T14:07:43.573792+0000","last_peered":"2024-05-10T14:07:43.573792+0000","last_clean":"2024-05-10T14:07:43.573792+0000","last_became_active":"2024-05-10T14:04:06.299364+0000","last_became_peered":"2024-05-10T14:04:06.299364+0000","last_unstale":"2024-05-10T14:07:43.573792+0000","last_undegraded":"2024-05-10T14:07:43.573792+0000","last_fullsized":"2024-05-10T14:07:43.573792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:43.573599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:43.573599+0000","last_clean_scrub_stamp":"2024-05-10T14:07:43.573599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:43.723309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":268,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:42.909443+0000","last_change":"2024-05-10T14:07:42.909501+0000","last_active":"2024-05-10T14:07:42.909443+0000","last_peered":"2024-05-10T14:07:42.909443+0000","last_clean":"2024-05-10T14:07:42.909443+0000","last_became_active":"2024-05-10T14:02:32.678353+0000","last_became_peered":"2024-05-10T14:02:32.678353+0000","last_unstale":"2024-05-10T14:07:42.909443+0000","last_undegraded":"2024-05-10T14:07:42.909443+0000","last_fullsized":"2024-05-10T14:07:42.909443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:42.909207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:42.909207+0000","last_clean_scrub_stamp":"2024-05-10T14:07:42.909207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:20.091453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:41.428747+0000","last_change":"2024-05-10T14:07:41.428809+0000","last_active":"2024-05-10T14:07:41.428747+0000","last_peered":"2024-05-10T14:07:41.428747+0000","last_clean":"2024-05-10T14:07:41.428747+0000","last_became_active":"2024-05-10T14:02:30.638605+0000","last_became_peered":"2024-05-10T14:02:30.638605+0000","last_unstale":"2024-05-10T14:07:41.428747+0000","last_undegraded":"2024-05-10T14:07:41.428747+0000","last_fullsized":"2024-05-10T14:07:41.428747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T14:07:41.428540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T14:07:41.428540+0000","last_clean_scrub_stamp":"2024-05-10T14:07:41.428540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:12.173956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"151'2","reported_seq":189,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-10T14:07:26.576292+0000","last_change":"2024-05-10T14:07:26.576360+0000","last_active":"2024-05-10T14:07:26.576292+0000","last_peered":"2024-05-10T14:07:26.576292+0000","last_clean":"2024-05-10T14:07:26.576292+0000","last_became_active":"2024-05-10T14:04:06.317657+0000","last_became_peered":"2024-05-10T14:04:06.317657+0000","last_unstale":"2024-05-10T14:07:26.576292+0000","last_undegraded":"2024-05-10T14:07:26.576292+0000","last_fullsized":"2024-05-10T14:07:26.576292+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'2","last_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_deep_scrub":"151'2","last_deep_scrub_stamp":"2024-05-10T14:07:26.576073+0000","last_clean_scrub_stamp":"2024-05-10T14:07:26.576073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:06.688838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":812,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":887,"num_read_kb":646,"num_write":483,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":2244,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},"log_size":690,"ondisk_log_size":690,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39720,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332120,"statfs":{"total":96636764160,"available":96596090880,"internally_reserved":0,"allocated":8749056,"data_stored":7967893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6033408,"data_stored":5279743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":70,"seq":300647710773,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33536,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":31675,"kb_avail":94338304,"statfs":{"total":96636764160,"available":96602423296,"internally_reserved":0,"allocated":1892352,"data_stored":1087422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558,"internal_metadata":32435762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":5880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":6021120,"data_stored":5279798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41244,"kb_used_data":5908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330596,"statfs":{"total":96636764160,"available":96594530304,"internally_reserved":0,"allocated":6049792,"data_stored":5280095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39168,"kb_used_data":3832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332672,"statfs":{"total":96636764160,"available":96596656128,"internally_reserved":0,"allocated":3923968,"data_stored":3181728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37724,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334116,"statfs":{"total":96636764160,"available":96598134784,"internally_reserved":0,"allocated":2445312,"data_stored":1676076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37148,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334692,"statfs":{"total":96636764160,"available":96598724608,"internally_reserved":0,"allocated":1855488,"data_stored":1085645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1318,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T14:08:25.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T14:08:26.074 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T14:08:26.074 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T14:08:26.075 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T14:08:26.075 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.155 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T14:08:26.156 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T14:08:26.156 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.220 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T14:08:26.221 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T14:08:26.221 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.297 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T14:08:26.298 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T14:08:26.298 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.382 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T14:08:26.382 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T14:08:26.382 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.458 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T14:08:26.459 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T14:08:26.459 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.528 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T14:08:26.529 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T14:08:26.529 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.624 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T14:08:26.624 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T14:08:26.624 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.718 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T14:08:26.718 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T14:08:26.718 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T14:08:26.718 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.757 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T14:08:26.758 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T14:08:26.758 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.786 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T14:08:26.786 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T14:08:26.786 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T14:08:26.787 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.825 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T14:08:26.825 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T14:08:26.825 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.890 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T14:08:26.890 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T14:08:26.890 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T14:08:26.911 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T14:08:26.912 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T14:08:26.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-10T14:08:26.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:08:26.952 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T14:08:27.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:08:27.197 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T14:08:27.376 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:08:27.377 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T14:08:27.518 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:08:27.518 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T14:08:27.653 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:08:27.653 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T14:08:27.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:08:27.881 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T14:08:28.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:08:28.067 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T14:08:28.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:08:28.307 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T14:08:28.524 INFO:tasks.ceph:Archiving mon data... 2024-05-10T14:08:28.526 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/data/mon.a.tgz 2024-05-10T14:08:28.526 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-05-10T14:08:28.532 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.gb9pBlso9z 2024-05-10T14:08:28.533 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gb9pBlso9z 2024-05-10T14:08:28.731 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.gb9pBlso9z 2024-05-10T14:08:28.793 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.gb9pBlso9z is 651KB 2024-05-10T14:08:28.856 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.gb9pBlso9z 2024-05-10T14:08:28.861 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/data/mon.c.tgz 2024-05-10T14:08:28.861 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-05-10T14:08:28.910 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.QtRTScrMNO 2024-05-10T14:08:28.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QtRTScrMNO 2024-05-10T14:08:29.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.QtRTScrMNO 2024-05-10T14:08:29.214 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.QtRTScrMNO is 837KB 2024-05-10T14:08:29.280 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.QtRTScrMNO 2024-05-10T14:08:29.286 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/data/mon.b.tgz 2024-05-10T14:08:29.286 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-05-10T14:08:29.291 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.RLlwT8Cfdu 2024-05-10T14:08:29.292 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RLlwT8Cfdu 2024-05-10T14:08:29.528 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.RLlwT8Cfdu 2024-05-10T14:08:29.596 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.RLlwT8Cfdu is 837KB 2024-05-10T14:08:29.707 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.RLlwT8Cfdu 2024-05-10T14:08:29.713 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T14:08:29.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T14:08:29.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T14:08:29.779 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T14:08:29.817 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T14:08:29.817 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T14:08:29.819 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi016/crash 2024-05-10T14:08:29.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T14:08:29.841 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi130/crash 2024-05-10T14:08:29.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T14:08:29.872 INFO:tasks.ceph:Compressing logs... 2024-05-10T14:08:29.872 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T14:08:29.879 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T14:08:29.898 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31434.log 2024-05-10T14:08:29.899 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38394.log 2024-05-10T14:08:29.899 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41993.log 2024-05-10T14:08:29.899 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31434.log.gz 2024-05-10T14:08:29.900 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38394.log.gz 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34128.log 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41993.log.gz 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-05-10T14:08:29.901 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-05-10T14:08:29.904 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34128.log: /var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32161.log 2024-05-10T14:08:29.904 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34128.log.gz 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29530.log 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32161.log.gz 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29753.log 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29530.log.gz 2024-05-10T14:08:29.905 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37618.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33576.log 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29753.log.gz 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33576.log.gz 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-05-10T14:08:29.906 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33133.log 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44484.log: /var/log/ceph/ceph-client.admin.44666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29547.log 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33133.log.gz 2024-05-10T14:08:29.914 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-05-10T14:08:29.915 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2024-05-10T14:08:29.915 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40072.log 2024-05-10T14:08:29.915 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29547.log.gz 2024-05-10T14:08:29.915 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-10T14:08:29.915 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32317.log 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40072.log.gz 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-05-10T14:08:29.916 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32317.log.gz 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29766.log 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42745.log 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-05-10T14:08:29.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29766.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.29766.log.gz 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20187.log 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42745.log.gz 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.20187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35422.log 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20187.log.gz 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34072.log 2024-05-10T14:08:29.918 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35422.log.gz 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32663.log 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34072.log.gz 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31166.log 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32663.log.gz 2024-05-10T14:08:29.919 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31166.log.gz 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41121.log 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41121.log.gz 2024-05-10T14:08:29.920 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2024-05-10T14:08:29.953 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25189.log 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25165.log 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25237.log 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25189.log.gz 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25165.log.gz 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-10T14:08:29.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.25237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25117.log 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25237.log.gz 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.25117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25093.log 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25117.log.gz 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25213.log 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25093.log.gz 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25069.log 2024-05-10T14:08:29.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25141.log 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25213.log: /var/log/ceph/ceph-client.admin.25069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25213.log.gz 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25069.log.gz 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25141.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25141.log.gz 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T14:08:29.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-10T14:08:29.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-10T14:08:29.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T14:08:29.960 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T14:08:29.960 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29764.log 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30022.log 2024-05-10T14:08:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29764.log.gz 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43093.log 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30022.log.gz 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43093.log.gz 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40163.log 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42255.log 2024-05-10T14:08:29.972 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40163.log.gz 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29972.log 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29244.log 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42255.log.gz 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29972.log.gz 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34192.log 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42431.log 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29244.log.gz 2024-05-10T14:08:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34192.log.gz 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33758.log 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-05-10T14:08:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33758.log.gz 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37956.log 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37956.log.gz 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42797.log 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31057.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.42322.log 2024-05-10T14:08:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42797.log.gz 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42322.log.gz 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32568.log 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42138.log 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32568.log.gz 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42849.log 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42693.log 2024-05-10T14:08:29.976 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42138.log.gz 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42849.log.gz 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42693.log.gz 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42903.log 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31162.log 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-05-10T14:08:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42903.log.gz 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30927.log 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33315.log 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31162.log.gz 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30927.log.gz 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29341.log 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33315.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33315.log.gz 2024-05-10T14:08:29.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29341.log.gz 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40696.log 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40696.log.gz 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25128.log 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-05-10T14:08:29.979 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.25128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25128.log.gz 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33607.log 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37577.log 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2024-05-10T14:08:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33607.log.gz 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41176.log 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37577.log.gz 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31983.log 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41176.log.gz 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2024-05-10T14:08:29.981 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31983.log.gz 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29749.log 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31797.log 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31347.log 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29749.log.gz 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31797.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31797.log.gz 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-05-10T14:08:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31347.log.gz 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29998.log 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39073.log 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42563.log 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29998.log.gz 2024-05-10T14:08:29.983 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39073.log.gz 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44380.log 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42563.log.gz 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39890.log 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37466.log 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44380.log.gz 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41658.log 2024-05-10T14:08:29.984 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39890.log.gz 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37462.log 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37466.log.gz 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41658.log.gz 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33711.log 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37462.log.gz 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2024-05-10T14:08:29.985 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40254.log 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33711.log.gz 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33657.log 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40254.log.gz 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32614.log 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33657.log.gz 2024-05-10T14:08:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42823.log 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32614.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32614.log.gz -5 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42823.log.gz 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-05-10T14:08:29.987 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31979.log 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31979.log.gz 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39437.log 2024-05-10T14:08:29.988 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39680.log 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38228.log 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39437.log.gz 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30924.log 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39680.log.gz 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33842.log 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2024-05-10T14:08:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29550.log 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30924.log.gz 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38732.log 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33842.log.gz 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29550.log.gz 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39775.log 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38732.log.gz 2024-05-10T14:08:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39387.log 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39775.log.gz 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39387.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39387.log.gz 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz 2024-05-10T14:08:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38575.log 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41434.log 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38575.log.gz 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41434.log.gz 2024-05-10T14:08:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37419.log 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.41014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41716.log 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39593.log 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37419.log.gz 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41716.log.gz/var/log/ceph/ceph-client.admin.39593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:29.993 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39593.log.gz 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44820.log 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30926.log 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44820.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29218.log 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44820.log.gz 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30926.log.gz 2024-05-10T14:08:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41097.log 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29218.log.gz 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29546.log 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44458.log: /var/log/ceph/ceph-client.admin.41097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39965.log 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41097.log.gz/var/log/ceph/ceph-client.admin.29546.log: 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29546.log.gz 2024-05-10T14:08:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41799.log 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39965.log: /var/log/ceph/ceph-client.admin.38279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39965.log.gz 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41799.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42348.log 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41799.log.gz 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44640.log: /var/log/ceph/ceph-client.admin.42348.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-10T14:08:29.996 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42348.log.gz/var/log/ceph/ceph-client.admin.34444.log: 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.44692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44224.log 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2024-05-10T14:08:29.997 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40982.log 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44224.log: 0.0%/var/log/ceph/ceph-client.admin.40982.log: -- replaced with /var/log/ceph/ceph-client.admin.44224.log.gz 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40982.log.gz 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41955.log 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37848.log 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2024-05-10T14:08:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41955.log.gz 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32345.log 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.37848.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37848.log.gz 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32345.log.gz 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40356.log 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34037.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.40228.log 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40356.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41617.log 2024-05-10T14:08:29.999 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40356.log.gz 2024-05-10T14:08:30.000 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40228.log.gz 2024-05-10T14:08:30.036 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40956.log 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41617.log.gz 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40956.log.gz 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31301.log 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2024-05-10T14:08:30.037 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31095.log 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31301.log.gz 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39338.log 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38435.log 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31095.log.gz 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39338.log.gz 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40113.log 2024-05-10T14:08:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38435.log.gz 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40113.log.gz 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25224.log 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37231.log 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.25224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25224.log.gz 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29558.log 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.37231.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42615.log 2024-05-10T14:08:30.039 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37231.log.gz 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29558.log.gz 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29094.log 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42615.log.gz 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38017.log 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34600.log 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29094.log.gz 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38017.log.gz 2024-05-10T14:08:30.040 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34600.log.gz 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29765.log 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31405.log 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29765.log.gz 2024-05-10T14:08:30.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32270.log 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31405.log.gz 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43605.log 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32270.log.gz 2024-05-10T14:08:30.042 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.43605.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.0.43605.log.gz 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31917.log: /var/log/ceph/ceph-client.admin.40569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-05-10T14:08:30.043 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz 2024-05-10T14:08:30.044 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30803.log 2024-05-10T14:08:30.044 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-05-10T14:08:30.044 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42457.log: /var/log/ceph/ceph-client.admin.30803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-05-10T14:08:30.044 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30803.log.gz 2024-05-10T14:08:30.044 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42771.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29557.log 2024-05-10T14:08:30.045 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29557.log.gz 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29535.log 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29946.log 2024-05-10T14:08:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41320.log 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29535.log: /var/log/ceph/ceph-client.admin.29946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29535.log.gz 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29946.log.gz 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41518.log 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37915.log 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41320.log: /var/log/ceph/ceph-client.admin.41518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41320.log.gz 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41518.log.gz 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39255.log 2024-05-10T14:08:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37915.log: /var/log/ceph/ceph-client.admin.44562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37915.log.gz 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34353.log 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39255.log: /var/log/ceph/ceph-client.admin.42897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39255.log.gz 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30072.log 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29296.log 2024-05-10T14:08:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34353.log: /var/log/ceph/ceph-client.admin.30072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34353.log.gz 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30072.log.gz 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40889.log 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29296.log: /var/log/ceph/ceph-client.admin.40889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29296.log.gz 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40889.log.gz 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29347.log 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33285.log 2024-05-10T14:08:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38123.log: /var/log/ceph/ceph-client.admin.29347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29347.log.gz 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32696.log 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44718.log 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33285.log: /var/log/ceph/ceph-client.admin.32696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33285.log.gz 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32696.log.gz 2024-05-10T14:08:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32473.log 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31682.log 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44718.log: /var/log/ceph/ceph-client.admin.32473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44718.log.gz 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32473.log.gz 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39077.log 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36617.log 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31682.log: /var/log/ceph/ceph-client.admin.39077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31682.log.gz 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39077.log.gz 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29339.log 2024-05-10T14:08:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36617.log.gz 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29339.log.gz 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38071.log 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30098.log 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38071.log.gz 2024-05-10T14:08:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31534.log 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30098.log.gz 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42065.log 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31534.log.gz 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42065.log.gz 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29349.log 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32135.log 2024-05-10T14:08:30.053 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29349.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29349.log.gz 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32135.log.gz 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31251.log 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41864.log 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31251.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2024-05-10T14:08:30.054 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31251.log.gz 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41864.log.gz/var/log/ceph/ceph-client.admin.43317.log: 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37660.log 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33910.log 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37660.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43085.log 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37660.log.gz 2024-05-10T14:08:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33910.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33910.log.gz 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43085.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43085.log.gz/var/log/ceph/ceph-client.admin.32976.log: 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42405.log 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40648.log 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr: 73.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42405.log.gz 2024-05-10T14:08:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40648.log.gz 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29540.log 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29540.log: /var/log/ceph/ceph-client.admin.31562.log 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29540.log.gz 2024-05-10T14:08:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39998.log 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31099.log 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39998.log.gz 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31474.log 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31099.log.gz 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31474.log.gz 2024-05-10T14:08:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32868.log 2024-05-10T14:08:30.059 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9%/var/log/ceph/ceph-client.admin.44302.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T14:08:30.059 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-05-10T14:08:30.059 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-05-10T14:08:30.059 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29754.log 2024-05-10T14:08:30.059 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32868.log.gz 2024-05-10T14:08:30.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34390.log: /var/log/ceph/ceph-client.admin.29754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29754.log.gz 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31641.log 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42537.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29738.log 2024-05-10T14:08:30.097 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31641.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29738.log: 0.0%/var/log/ceph/ceph-client.admin.34226.log: -- replaced with /var/log/ceph/ceph-client.admin.29738.log.gz 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-05-10T14:08:30.098 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37759.log 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44510.log: /var/log/ceph/ceph-client.admin.42111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24965.log 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32931.log 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37759.log.gz 2024-05-10T14:08:30.099 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.24965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24965.log.gz 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33023.log 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32931.log.gz 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43315.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34508.log 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33023.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-05-10T14:08:30.100 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42902.log 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34508.log.gz 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38657.log 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42902.log.gz 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2024-05-10T14:08:30.101 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32080.log 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29350.log 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38657.log.gz 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32080.log.gz 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30829.log 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29350.log.gz 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33959.log: /var/log/ceph/ceph-client.admin.30829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-05-10T14:08:30.102 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30829.log.gz 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41901.log 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31218.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41901.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42898.log 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%/var/log/ceph/ceph-client.admin.43103.log: -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38192.log 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42898.log.gz 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38192.log.gz 2024-05-10T14:08:30.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37729.log 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30855.log 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37729.log.gz 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30855.log.gz 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40322.log 2024-05-10T14:08:30.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34741.log 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gz 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40322.log.gz 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44744.log 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34741.log.gz 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40417.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31823.log 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-05-10T14:08:30.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44744.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30885.log 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31823.log: /var/log/ceph/ceph-client.admin.39280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31823.log.gz 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gz 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29192.log 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40523.log 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30885.log.gz 2024-05-10T14:08:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29192.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44354.log 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40523.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29167.log 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44354.log.gz 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40775.log 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29167.log.gz 2024-05-10T14:08:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42641.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29348.log 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40775.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41461.log 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29348.log.gz 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-05-10T14:08:30.109 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34628.log 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38966.log 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41461.log.gz/var/log/ceph/ceph-client.admin.34628.log: 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34628.log.gz 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38469.log 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29335.log 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38966.log.gz 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38469.log.gz 2024-05-10T14:08:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41203.log 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38308.log 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29335.log.gz 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38822.log 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41203.log.gz 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38308.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38308.log.gz 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30048.log 2024-05-10T14:08:30.111 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%/var/log/ceph/ceph-client.admin.43525.log: -- replaced with /var/log/ceph/ceph-client.admin.38822.log.gz 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30048.log.gz 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38075.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41366.log 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42296.log 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41366.log.gz 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-05-10T14:08:30.113 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42296.log.gz 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43102.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29747.log 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz/var/log/ceph/ceph-client.admin.42887.log: 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2024-05-10T14:08:30.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29747.log.gz 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42667.log 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42667.log.gz 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-05-10T14:08:30.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39619.log 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39916.log 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39619.log.gz 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39916.log.gz 2024-05-10T14:08:30.116 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29345.log 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43111.log 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29345.log.gz 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29270.log 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40418.log 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43111.log.gz 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.29270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29270.log.gz 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44588.log 2024-05-10T14:08:30.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40418.log.gz 2024-05-10T14:08:30.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44588.log.gz 2024-05-10T14:08:30.118 INFO:teuthology.orchestra.run.smithi130.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-10T14:08:30.224 INFO:teuthology.orchestra.run.smithi016.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-10T14:08:30.465 INFO:teuthology.orchestra.run.smithi016.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-10T14:08:30.526 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-10T14:08:30.577 INFO:teuthology.orchestra.run.smithi016.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-10T14:08:30.647 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-10T14:08:30.647 INFO:teuthology.orchestra.run.smithi130.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-10T14:08:30.722 INFO:teuthology.orchestra.run.smithi130.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-10T14:08:30.723 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-05-10T14:08:30.723 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m0.799s 2024-05-10T14:08:30.723 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m2.826s 2024-05-10T14:08:30.724 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.119s 2024-05-10T14:08:30.769 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-10T14:08:30.808 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-10T14:08:30.864 INFO:teuthology.orchestra.run.smithi016.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-10T14:08:30.865 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-10T14:08:30.865 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m0.985s 2024-05-10T14:08:30.865 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m4.229s 2024-05-10T14:08:30.866 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.242s 2024-05-10T14:08:30.867 INFO:tasks.ceph:Archiving logs... 2024-05-10T14:08:30.867 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi016/log 2024-05-10T14:08:30.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T14:08:31.632 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi130/log 2024-05-10T14:08:31.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T14:08:31.989 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T14:08:32.004 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T14:08:32.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T14:08:32.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T14:08:32.081 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T14:08:32.090 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T14:08:32.090 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T14:08:32.093 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T14:08:32.103 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T14:08:32.104 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-05-10T14:08:32.104 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.076 -2.199 0.671 2024-05-10T14:08:32.104 INFO:teuthology.orchestra.run.smithi016.stdout:+hv02.front.sepi 63.231.80.2 3 u 8 64 377 0.068 -0.887 0.728 2024-05-10T14:08:32.104 INFO:teuthology.orchestra.run.smithi016.stdout:*hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.074 -1.466 0.835 2024-05-10T14:08:32.104 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.064 -2.576 0.802 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.110 +0.251 0.693 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:*hv03.front.sepi 74.6.168.72 3 u 11 64 377 0.084 -1.242 0.620 2024-05-10T14:08:32.107 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T14:08:32.109 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T14:08:32.124 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T14:08:32.125 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T14:08:32.176 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T14:08:32.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T14:08:32.277 INFO:teuthology.task.internal:Duration was 974.034872 seconds 2024-05-10T14:08:32.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T14:08:32.326 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T14:08:32.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T14:08:32.329 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T14:08:32.367 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T14:08:32.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-05-10T14:08:32.367 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T14:08:32.419 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-05-10T14:08:32.420 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T14:08:32.431 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T14:08:32.432 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T14:08:32.467 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T14:08:32.502 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T14:08:32.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T14:08:32.543 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T14:08:32.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T14:08:32.631 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T14:08:32.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T14:08:32.643 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T14:08:32.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T14:08:32.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T14:08:32.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T14:08:32.696 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-05-10T14:08:32.705 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-05-10T14:08:32.801 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T14:08:32.806 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi016.front.sepia.ceph.com, flagging run as failed 2024-05-10T14:08:32.807 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T14:08:32.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:08:32.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T14:08:32.860 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T14:08:32.861 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi016 2024-05-10T14:08:32.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T14:10:26.443 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-05-10T14:10:26.723 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219/remote/smithi016/coredump/1715349861.30136.core.gz: gzip compressed data, was "1715349861.30136.core", last modified: Fri May 10 14:08:32 2024, max compression, original size modulo 2^32 906616832 2024-05-10T14:10:26.724 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-05-10T14:10:48.746 INFO:teuthology.task.internal: core looks like: /tmp/tmpbnaacfui: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/radosgw', platform: 'x86_64' 2024-05-10T14:10:49.760 INFO:teuthology.task.internal: dump_program: radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c 2024-05-10T14:10:49.761 DEBUG:teuthology.orchestra.run.smithi016:> which 'radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c' 2024-05-10T14:10:49.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:10:49.769 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 1: "which 'radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c'" 2024-05-10T14:10:49.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T14:10:49.794 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T14:10:49.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T14:10:49.843 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T14:10:49.843 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T14:10:49.862 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T14:10:49.863 INFO:teuthology.orchestra.run.smithi016.stdout: 658624 4 drwxr-xr-x 4 ubuntu ubuntu 4096 May 10 14:08 /home/ubuntu/cephtest 2024-05-10T14:10:49.863 INFO:teuthology.orchestra.run.smithi016.stdout: 658625 4 drwxr-xr-x 4 ubuntu ubuntu 4096 May 10 13:52 /home/ubuntu/cephtest/archive 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 658627 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 14:08 /home/ubuntu/cephtest/archive/syslog 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 658629 4 -rw-rw-rw- 1 ubuntu ubuntu 800 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 658628 192 -rw-rw-r-- 1 ubuntu ubuntu 193202 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 663783 188 -rw-rw-rw- 1 ubuntu ubuntu 190184 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 658626 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 14:04 /home/ubuntu/cephtest/archive/coredump 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 688822 89004 -rw------- 1 root root 5201584128 May 10 14:04 /home/ubuntu/cephtest/archive/coredump/1715349861.30136.core 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 674997 4 drwxrwxr-x 3 ubuntu ubuntu 4096 May 10 14:02 /home/ubuntu/cephtest/mnt.0 2024-05-10T14:10:49.864 INFO:teuthology.orchestra.run.smithi016.stdout: 674998 4 drwxrwxr-x 3 ubuntu ubuntu 4096 May 10 14:04 /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T14:10:49.865 INFO:teuthology.orchestra.run.smithi016.stdout: 789533 4 drwxrwxr-x 2 ubuntu ubuntu 4096 May 10 14:04 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-10T14:10:49.865 INFO:teuthology.orchestra.run.smithi016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-10T14:10:49.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T14:10:49.869 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 1: "which 'radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-10T14:10:49.884 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T14:10:49.895 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T14:10:49.919 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi016 with status 1: "which 'radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/c'" 2024-05-10T14:10:49.920 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T14:10:49.926 INFO:teuthology.orchestra.run.smithi130.stdout: 658636 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 10 14:08 /home/ubuntu/cephtest 2024-05-10T14:10:49.926 INFO:teuthology.orchestra.run.smithi130.stdout: 658637 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 10 14:08 /home/ubuntu/cephtest/archive 2024-05-10T14:10:49.927 INFO:teuthology.orchestra.run.smithi130.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 14:08 /home/ubuntu/cephtest/archive/syslog 2024-05-10T14:10:49.927 INFO:teuthology.orchestra.run.smithi130.stdout: 658641 4 -rw-rw-rw- 1 ubuntu ubuntu 825 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-05-10T14:10:49.927 INFO:teuthology.orchestra.run.smithi130.stdout: 658640 184 -rw-rw-r-- 1 ubuntu ubuntu 186949 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T14:10:49.928 INFO:teuthology.orchestra.run.smithi130.stdout: 655432 180 -rw-rw-rw- 1 ubuntu ubuntu 180784 May 10 14:08 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-05-10T14:10:49.933 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-10T14:10:49.957 DEBUG:teuthology.nuke:shortname: smithi016 2024-05-10T14:10:49.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T14:10:49.986 DEBUG:teuthology.nuke:shortname: smithi130 2024-05-10T14:10:49.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T14:10:49.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 13:43:17.988372', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJiduOxAmO/MABrCKSOVU34H443J7P4Laq509Rd/Ph/8gq1zYv6OXZQyrP1/NDeKpg3HyOLqPf+P7kEfi1nZ7U='} 2024-05-10T14:10:50.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dang-2024-05-10_09:33:25-rgw-wip-dang-obj-state-distro-default-smithi/7701219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 13:43:17.990849', 'locked_by': 'scheduled_dang@sidious.arb.redhat.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyZxTL71kJa9cHapAb6a70E7lAdq4EYTk0Bti5PvxazbFdWhf/I9ACUlzDTQKpJUnXCUS43xQTt9BLw4R9kz/4='} 2024-05-10T14:10:50.043 INFO:teuthology.orchestra.console.smithi016:Power off 2024-05-10T14:10:50.043 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T14:10:50.075 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-05-10T14:10:50.075 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:50.098 INFO:teuthology.orchestra.console.smithi130:Power off 2024-05-10T14:10:50.098 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T14:10:50.110 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-10T14:10:50.124 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-05-10T14:10:50.124 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:50.150 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-05-10T14:10:54.112 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:54.151 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:54.223 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-10T14:10:54.265 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-05-10T14:10:58.226 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:58.266 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:10:58.338 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-10T14:10:58.378 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-05-10T14:11:02.341 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:11:02.379 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T14:11:02.454 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-05-10T14:11:02.491 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-05-10T14:11:02.555 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-05-10T14:11:02.592 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-05-10T14:11:02.698 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 974.0348718166351 failure_reason: 'Command failed (workunit test rgw/s3_bucket_quota.pl) on smithi016 with status 111: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7ef97a7233c4db41f8dc134b8d64f95427147ce5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl''' flavor: default owner: scheduled_dang@sidious.arb.redhat.com sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ff12cff891034221b25cdcd960356193 status: fail success: false 2024-05-10T14:11:02.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T14:11:02.786 INFO:teuthology.run:FAIL